有时候,我们需要用到代理IP,比如在爬虫的时候,但是得到了IP之后,可能不知道怎么验证这些IP是不是有效的,这时候我们可以使用Python携带该IP来模拟访问某一个网站,如果多次未成功访问,则说明这个代理是无效的。 代码如下:
import requests import random import time http_ip = [ '118.163.13.200:8080', '222.223.182.66:8000', '51.158.186.242:8811', '171.37.79.129:9797', '139.255.123.194:4550' ] for i in range(10): try: ip_proxy = random.choice(http_ip) proxy_ip = { 'http': ip_proxy, 'https': ip_proxy, } print('使用代理的IP:', proxy_ip) response = requests.get("http://httpbin.org/ip", proxies=proxy_ip).text print(response) print('当前IP有效') time.sleep(2) except Exception as e: print(e.args[0]) print('当前IP无效') continue
运行结果如下:
使用代理的IP: {'http': '118.163.13.200:8080', 'https': '118.163.13.200:8080'} HTTPConnectionPool(host='118.163.13.200', port=8080): Max retries exceeded with url: http://httpbin.org/ip (Caused by ProxyError('Cannot connect to proxy.', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x00000247674F5F88>: Failed to establish a new connection: [WinError 10060] 由于连接方在一段时间后没有正确答复或连接的主机没有反应,连接尝试失败。'))) 当前IP无效 使用代理的IP: {'http': '51.158.186.242:8811', 'https': '51.158.186.242:8811'} { "origin": "51.158.186.242" } 当前IP有效 使用代理的IP: {'http': '222.223.182.66:8000', 'https': '222.223.182.66:8000'} { "origin": "139.202.62.84, 222.223.182.66" } 当前IP有效 使用代理的IP: {'http': '51.158.186.242:8811', 'https': '51.158.186.242:8811'} { "origin": "51.158.186.242" } 当前IP有效 使用代理的IP: {'http': '51.158.186.242:8811', 'https': '51.158.186.242:8811'} { "origin": "51.158.186.242" } 当前IP有效 使用代理的IP: {'http': '222.223.182.66:8000', 'https': '222.223.182.66:8000'} HTTPConnectionPool(host='222.223.182.66', port=8000): Max retries exceeded with url: http://httpbin.org/ip (Caused by ProxyError('Cannot connect to proxy.', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x00000247675067C8>: Failed to establish a new connection: [WinError 10060] 由于连接方在一段时间后没有正确答复或连接的主机没有反应,连接尝试失败。'))) 当前IP无效 使用代理的IP: {'http': '139.255.123.194:4550', 'https': '139.255.123.194:4550'} HTTPConnectionPool(host='139.255.123.194', port=4550): Max retries exceeded with url: http://httpbin.org/ip (Caused by ProxyError('Cannot connect to proxy.', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x00000247674F55C8>: Failed to establish a new connection: [WinError 10060] 由于连接方在一段时间后没有正确答复或连接的主机没有反应,连接尝试失败。'))) 当前IP无效 使用代理的IP: {'http': '51.158.186.242:8811', 'https': '51.158.186.242:8811'} { "origin": "51.158.186.242" } 当前IP有效 使用代理的IP: {'http': '51.158.186.242:8811', 'https': '51.158.186.242:8811'} { "origin": "51.158.186.242" } 当前IP有效 使用代理的IP: {'http': '222.223.182.66:8000', 'https': '222.223.182.66:8000'} HTTPConnectionPool(host='222.223.182.66', port=8000): Max retries exceeded with url: http://httpbin.org/ip (Caused by ProxyError('Cannot connect to proxy.', NewConnectionError('<urllib3.connection.HTTPConnection object at 0x0000024767514908>: Failed to establish a new connection: [WinError 10060] 由于连接方在一段时间后没有正确答复或连接的主机没有反应,连接尝试失败。'))) 当前IP无效
本文原文首发来自博客专栏Python实战,由本人转发至https://www.helloworld.net/p/GGguV7tALU4J,其他平台均属侵权,可点击https://blog.csdn.net/CUFEECR/article/details/105475019查看原文,也可点击https://blog.csdn.net/CUFEECR浏览更多优质原创内容。
