Izicelo ze-Python nge-proxy eqinisekisiwe, isinyathelo ngesinyathelo
Ibhalwe yiThimba Lonjiniyela lakwa-ProxyV4 · Updated:
Ukuze usebenzise i-proxy ku-Python requests, dlulisa i-dict ye-proxies lapho izinkinobho zayo ze-'http' kanye ne-'https' zikhomba kokubili ku-http://user:pass@ip:port. Faka leyo dict ku-requests.Session() bese uxhumano olufanayo lwe-proxy luphinde lusetshenziswe kuzo zonke izicelo, okusheshayo kunokuvula okusha esicelweni ngasinye. Ngezansi: i-dict, i-session, amaphutha ongase uhlangabezane nawo, kanye nokuhlola komugqa owodwa kwe-exit IP ye-ProxyV4.
proxies = {'http': 'http://user:pass@ip:port', 'https': 'http://user:pass@ip:port'}- 1 IP$1.85
- 3+ IPs$1.70
- 10+ IPs$1.60
- 25+ IPs$1.50
- 50+ IPs$1.40
- 100+ IPs$1.30
- 200+ IPs$1.20
- 500+ IPs$1.10
- 1 IP$1.85
- 3+ IPs$1.70
- 10+ IPs$1.60
- 25+ IPs$1.50
- 50+ IPs$1.40
- 100+ IPs$1.30
- 200+ IPs$1.20
- 500+ IPs$1.10
I-dict ye-proxies, ichaziwe
| Isilungiselelo | Inani | Isizathu |
|---|---|---|
Inkinobho ye-'http' | 'http://user:pass@ip:port' | Isetshenziselwa ama-URL acacile e-http:// |
Inkinobho ye-'https' | 'http://user:pass@ip:port' | Kusengu-URL we-proxy we-http://: i-urllib3 icela umhubhe we-CONNECT ku-proxy bese isebenzisa i-TLS ngaphakathi kwayo |
timeout | timeout=(5, 15) | Imizuzwana engu-5 yokuxhuma, engu-15 yokufunda, ukuze umgomo ongasasebenzi ungavimbi i-thread |
| Ukushintshanisa | itertools.cycle(proxy_list) | Inikeza ama-IP akho amile ngokulandelana |
Kungani i-Session ingcono kune-requests.get() eyodwa
Isicelo ngasinye sezinga eliphezulu se-requests.get() sakha i-connection pool entsha, ngakho-ke ukuxhumana kwe-TCP ne-proxy kanye nokuxhawula kwe-TLS nesizindalwazi kuphindwa njalo. I-Session igcina lokho kuxhumana kusebenza phakathi kwezicelo. Kuskripthi elanda amakhulukhulu amakhasi nge-IP eyodwa, lowo mehluko uyabonakala esikhathini esiphelele sokusebenza.
Setha i-s.proxies.update(proxies) kanye bese yonke i-s.get() kanye ne-s.post() idlula ku-proxy. Into eyodwa okufanele uyazi: uma i-HTTP_PROXY noma i-HTTPS_PROXY zisethiwe endaweni yesistimu, i-requests ingase izihlanganise nezilungiselelo ze-session; dlulisa i-proxies= esicelweni uqobo uma udinga ukuqiniseka ngokuthi iyiphi esetshenziswayo.
Amaphutha nendlela yokuwafunda
- I-
ProxyErrorene-407 Proxy Authentication Required: i-proxy iyafinyeleleka kodwa imininingwane yokungena ku-URL yakho ayihambisani ne-oda. Buka ikhasi lephutha le-407 - Amaphasiwedi aqukethe u-
@,:, noma u-/aphula i-URL; wa-encode kuqala nge-urllib.parse.quote(password, safe='') - Ukushintshela i-URL ye-proxy ku-
https://kuvame ukunqamula ukuxhumana; gcina u-http://kuzo zombili izinkinobho ngaphandle uma imbobo yakho ye-proxy iyimbobo ye-TLS ngokukhethekile - I-
ConnectTimeoutikhomba i-IP noma imbobo, hhayi imininingwane yokungena; hlola ukufinyeleleka ngesihloli sembobo
Iphethini efanayo ku-httpx naku-aiohttp
Ifomethi ye-URL iyafana. Ku-httpx, yakha i-httpx.Client(proxy='http://user:pass@ip:port'); ku-aiohttp, dlulisa i-proxy= ku-session.get(url, proxy=...). Ukukhasa okukhulu okuhleliwe nokunezilingo kabusha kuvame ukuba lula ku-Scrapy.
Isinyathelo ngesinyathelo
- 1
Yakha i-URL ye-proxy
Bhala kabusha umugqa ngamunye we-ProxyV4 othi
ip:port:user:passnjenge-http://user:pass@ip:port, noma uguqule lonke uhlu nge-siguquli sefomethi ye-proxy. - 2
Dala i-dict
Bhala
proxies = {'http': 'http://user:pass@ip:port', 'https': 'http://user:pass@ip:port'}. - 3
Yinamathisele ku-Session
Dala i-
s = requests.Session()bese ubiza i-s.proxies.update(proxies)ukuze ukuxhumana kugcinwe kusebenza phakathi kwezicelo. - 4
Phrinta i-exit IP
Qalisa
print(s.get('https://proxyv4.com/api/my-ip', timeout=10).json()); i-IP ephumayo kufanele ibe ngeye-proxy.
Imibuzo evame ukubuzwa
Kungani okufakiwe kwe-'https' kuyi-URL ye-http://?
Uhlelo luchaza indlela i-Python ekhuluma ngayo ne-proxy, hhayi newebhusayithi. I-urllib3 ixhuma ku-proxy nge-HTTP evamile, ithumele i-CONNECT, bese yenza i-TLS nesizindalwazi se-https:// ngalowo mhubhe, ngakho ithrafikhi yekhasi isabethelwe ngokuvikelekile.
Ngisakaza kanjani izicelo kuma-proxy amile angama-25?
Faka ama-URL angama-25 ohlwini, dala i-pool = itertools.cycle(PROXIES), bese esicelweni ngasinye uthatha p = next(pool) bese udlulisa proxies={'http': p, 'https': p}. Gcina ukulibaziseka okunengqondo nge-IP ngayinye ukuze kungabikho kheli elilodwa eligxilwa kakhulu kulo.
Ingabe ithrafikhi evela kumaskripthi e-Python iyalinganiswa?
Cha. Izinhlelo ze-IPv4 yangasese kanye ne-ISP emile ye-ProxyV4 ziza nomkhawulokudonsa ongenamkhawulo, ngakho-ke amaskripthi agijima isikhathi eside awahlangani nomkhawulo wedatha.
Imithombo
Iqoqo lama-IP amile lamaskripthi e-Python
I-IPv4 eyimfihlo emazweni ayi-7 kanye ne-ISP emile e-US nase-Vietnam. Thenga i-IP eyodwa noma iqoqo; intengo nge-IP iyancipha ngobuningi.
Hlola izintengo ezibukhoma zase-US