简介:

uncurl是一个库,允许您将curl请求转换为使用requests 的python代码。由于Chrome网络检查器具有的“copy as cURL”,因此该工具对于用python重新创建浏览器请求很有用。

SRE实战 互联网时代守护先锋,助力企业售后服务体系运筹帷幄!一键直达领取阿里云限量特价优惠。

安装:

(venv) zhangdeMacBook-Pro:pythonClass test$ pip install uncurl

使用步骤:(Google Chrome浏览器) 抓取百度新闻数据

google浏览器选择开发者工具,进入开发者模式

uncurl 接口数据变python代码 Python 第1张

 

 

 uncurl 接口数据变python代码 Python 第2张

 

 

 

 

 

 

 

 

3.打开pycharm,安装过uncurl 

uncurl "复制百度界面的curl格式数据"

(venv) zhangdeMacBook-Pro:pythonClass test$ uncurl "curl 'http://news.baidu.com/passport' -H 'Connection: keep-alive' -H 'Accept: application/json, text/javascript, */*; q=0.01' -H 'X-Requested-With: XMLHttpRequest' -H 'User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.117 Safari/537.36' -H 'Referer: http://news.baidu.com/' -H 'Accept-Encoding: gzip, deflate' -H 'Accept-Language: zh-CN,zh;q=0.9' -H 'Cookie: BIDUPSID=B4118D1EAC1C90F87904BEAF72F66215; PSTM=1578995919; BAIDUID=B4118D1EAC1C90F8DFFC8D1114C47930:FG=1; LOCALGX=%u5317%u4EAC%7C%30%7C%u5317%u4EAC%7C%30; BDORZ=B490B5EBF6F3CD402E515D22BCDA1598; H_PS_PSSID=1423_21119_30492_26350_30499; delPer=0; PSINO=2; Hm_lvt_e9e114d958ea263de46e080563e254c4=1579054369,1579055803,1579139547,1579169647; Hm_lpvt_e9e114d958ea263de46e080563e254c4=1579169647' --compressed --insecure"

requests.get("http://news.baidu.com/passport",
headers={
"Accept": "application/json, text/javascript, */*; q=0.01",
"Accept-Encoding": "gzip, deflate",
"Accept-Language": "zh-CN,zh;q=0.9",
"Connection": "keep-alive",
"Referer": "http://news.baidu.com/",
"User-Agent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_4) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/79.0.3945.117 Safari/537.36",
"X-Requested-With": "XMLHttpRequest"
},
cookies={
"BAIDUID": "B4118D1EAC1C90F8DFFC8D1114C47930:FG=1",
"BDORZ": "B490B5EBF6F3CD402E515D22BCDA1598",
"BIDUPSID": "B4118D1EAC1C90F87904BEAF72F66215",
"H_PS_PSSID": "1423_21119_30492_26350_30499",
"Hm_lpvt_e9e114d958ea263de46e080563e254c4": "1579169647",
"Hm_lvt_e9e114d958ea263de46e080563e254c4": "1579054369,1579055803,1579139547,1579169647",
"LOCALGX": "%u5317%u4EAC%7C%30%7C%u5317%u4EAC%7C%30",
"PSINO": "2",
"PSTM": "1578995919",
"delPer": "0"
},
verify=False
)
(venv) zhangdeMacBook-Pro:pythonClass test$

扫码关注我们
微信号:SRE实战
拒绝背锅 运筹帷幄