[已解决]求助读取网页数据问题

liu306178205 · 发表于 2018-7-20 17:38:19

马上注册，结交更多好友，享用更多功能^_^

您需要登录才可以下载或查看，没有账号？立即注册

x

我代码直接print（data）可以显示出数据，但是保存到文档中就变成了<!DOCTYPE html>

import urllib.request
import os
os.chdir(r'C:\Users\Administrator\Desktop')
url = 'https://www.baidu.com/s?ie=utf-8&f=8&rsv_bp=1&tn=baidu&wd=666&oq=sads&rsv_pq=9c9e6b33000019f2&rsv_t=bcf3S7elqgCeYZMNgx%2BO8GSS%2BTnAZY3qdj%2Bz9yFtDfdOKWjc0DoBlE4WFIU&rqlang=cn&rsv_enter=1&inputT=2806&rsv_sug3=11&rsv_sug1=9&rsv_sug7=100&bs=sads'
req = urllib.request.Request(url)
req.add_header('User-Agent','Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.139 Safari/537.36')
data = urllib.request.urlopen(req).read()
with open('百度搜索hello代码.txt','wb') as f:
f.write(data)

复制代码

最佳答案

月排行榜 / 总排行榜

运运520

2018-7-20 18:15:34

不是没有，只是没有展示，你往下拖就看到了！！！

import urllib.request
import os

url = 'https://www.baidu.com/s?ie=utf-8&f=8&rsv_bp=1&tn=baidu&wd=666&oq=sads&rsv_pq=9c9e6b33000019f2&rsv_t=bcf3S7elqgCeYZMNgx%2BO8GSS%2BTnAZY3qdj%2Bz9yFtDfdOKWjc0DoBlE4WFIU&rqlang=cn&rsv_enter=1&inputT=2806&rsv_sug3=11&rsv_sug1=9&rsv_sug7=100&bs=sads'

req = urllib.request.Request(url)
req.add_header('User-Agent',
'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.139 Safari/537.36')
data = urllib.request.urlopen(req).read()
response = str(data, encoding='utf-8')
print(response)

with open('text.txt', 'w+', encoding='utf-8') as f:
f.writelines(response)

跳转到最佳答案楼层

运运520 · 发表于 2018-7-20 18:15:34

不是没有，只是没有展示，你往下拖就看到了！！！

import urllib.request
import os

url = 'https://www.baidu.com/s?ie=utf-8&f=8&rsv_bp=1&tn=baidu&wd=666&oq=sads&rsv_pq=9c9e6b33000019f2&rsv_t=bcf3S7elqgCeYZMNgx%2BO8GSS%2BTnAZY3qdj%2Bz9yFtDfdOKWjc0DoBlE4WFIU&rqlang=cn&rsv_enter=1&inputT=2806&rsv_sug3=11&rsv_sug1=9&rsv_sug7=100&bs=sads'

req = urllib.request.Request(url)
req.add_header('User-Agent',
'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/66.0.3359.139 Safari/537.36')
data = urllib.request.urlopen(req).read()
response = str(data, encoding='utf-8')
print(response)

with open('text.txt', 'w+', encoding='utf-8') as f:
f.writelines(response)

ba21 · 发表于 2018-7-20 18:24:25

liu306178205 · 发表于 2018-7-22 16:54:06

ba21 发表于 2018-7-20 18:24

谢谢

liu306178205 · 发表于 2018-7-22 16:58:28

运运520 发表于 2018-7-20 18:15
不是没有，只是没有展示，你往下拖就看到了！！！

import urllib.request

谢谢

账号		自动登录	找回密码
密码			立即注册