We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
尝试没成功,结果如下
2023-08-18 19:13:30,844 launcher.py[line:45] INFO ProxyPool Version: 2.4.0 **************************************************************** *** ______ ********************* ______ *********** _ ******** *** | ___ \_ ******************** | ___ \ ********* | | ******** *** | |_/ / \__ __ __ _ __ _ | |_/ /___ * ___ | | ******** *** | __/| _// _ \ \ \/ /| | | || __// _ \ / _ \ | | ******** *** | | | | | (_) | > < \ |_| || | | (_) | (_) || |___ **** *** \_| |_| \___/ /_/\_\ \__ |\_| \___/ \___/ \_____/ **** **** __ / / ***** ************************* /___ / ******************************* ************************* ******************************** **************************************************************** 2023-08-18 19:13:30,846 launcher.py[line:50] INFO ProxyPool configure HOST: 0.0.0.0 2023-08-18 19:13:30,846 launcher.py[line:51] INFO ProxyPool configure PORT: 5010 2023-08-18 19:13:30,847 launcher.py[line:52] INFO ProxyPool configure PROXY_FETCHER: ['freeProxy01', 'freeProxy02', 'freeProxy03', 'freeProxy04', 'freeProxy05', 'freeProxy06', 'freeProxy07', 'freeProxy08', 'freeProxy09', 'freeProxy10', 'freeProxy11'] 2023-08-18 19:13:31,045 launcher.py[line:58] INFO ============ DATABASE CONFIGURE ================ 2023-08-18 19:13:31,045 launcher.py[line:59] INFO DB_TYPE: REDIS 2023-08-18 19:13:31,045 launcher.py[line:60] INFO DB_HOST: 127.0.0.1 2023-08-18 19:13:31,045 launcher.py[line:61] INFO DB_PORT: 6379 2023-08-18 19:13:31,046 launcher.py[line:62] INFO DB_NAME: 0 2023-08-18 19:13:31,046 launcher.py[line:63] INFO DB_USER: 2023-08-18 19:13:31,046 launcher.py[line:64] INFO ================================================= 2023-08-18 19:13:31,304 fetch.py[line:65] INFO ProxyFetch : start 2023-08-18 19:13:31,304 fetch.py[line:68] INFO ProxyFetch - freeProxy01: start 2023-08-18 19:13:31,305 fetch.py[line:68] INFO ProxyFetch - freeProxy02: start 2023-08-18 19:13:31,305 fetch.py[line:68] INFO ProxyFetch - freeProxy03: start 2023-08-18 19:13:31,305 fetch.py[line:68] INFO ProxyFetch - freeProxy04: start 2023-08-18 19:13:31,306 fetch.py[line:68] INFO ProxyFetch - freeProxy05: start 2023-08-18 19:13:31,306 fetch.py[line:68] INFO ProxyFetch - freeProxy06: start 2023-08-18 19:13:31,306 fetch.py[line:68] INFO ProxyFetch - freeProxy07: start 2023-08-18 19:13:31,307 fetch.py[line:68] INFO ProxyFetch - freeProxy08: start 2023-08-18 19:13:31,307 fetch.py[line:68] INFO ProxyFetch - freeProxy09: start 2023-08-18 19:13:31,307 fetch.py[line:68] INFO ProxyFetch - freeProxy10: start 2023-08-18 19:13:31,307 fetch.py[line:68] INFO ProxyFetch - freeProxy11: start 2023-08-18 19:13:31,309 fetch.py[line:36] INFO ProxyFetch - freeProxy01: start 2023-08-18 19:13:31,309 fetch.py[line:36] INFO ProxyFetch - freeProxy02: start 2023-08-18 19:13:31,310 fetch.py[line:36] INFO ProxyFetch - freeProxy03: start 2023-08-18 19:13:31,315 fetch.py[line:36] INFO ProxyFetch - freeProxy04: start 2023-08-18 19:13:31,317 fetch.py[line:36] INFO ProxyFetch - freeProxy05: start 2023-08-18 19:13:31,319 fetch.py[line:36] INFO ProxyFetch - freeProxy06: start 2023-08-18 19:13:31,321 fetch.py[line:36] INFO ProxyFetch - freeProxy07: start 2023-08-18 19:13:31,323 fetch.py[line:36] INFO ProxyFetch - freeProxy08: start 2023-08-18 19:13:31,325 fetch.py[line:36] INFO ProxyFetch - freeProxy09: start 2023-08-18 19:13:31,325 fetch.py[line:36] INFO ProxyFetch - freeProxy10: start 2023-08-18 19:13:31,329 fetch.py[line:36] INFO ProxyFetch - freeProxy11: start 2023-08-18 19:13:31,893 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 211.161.103.139:9091 ok 2023-08-18 19:13:31,894 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 221.231.13.198:1080 ok 2023-08-18 19:13:31,894 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 120.197.219.82:9091 ok 2023-08-18 19:13:31,895 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.27.248.213:8085 ok 2023-08-18 19:13:31,895 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 120.48.109.157:8080 ok 2023-08-18 19:13:31,895 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 223.96.90.216:8085 ok 2023-08-18 19:13:31,896 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.237.47.54:9091 ok 2023-08-18 19:13:31,896 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 119.8.236.97:3128 ok 2023-08-18 19:13:31,896 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 61.53.66.116:9091 ok 2023-08-18 19:13:31,896 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 111.160.204.146:9091 ok 2023-08-18 19:13:31,897 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 124.90.211.64:8085 ok 2023-08-18 19:13:31,897 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 39.185.232.150:9091 ok 2023-08-18 19:13:31,897 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 112.54.41.177:9091 ok 2023-08-18 19:13:31,898 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 182.106.220.252:9091 ok 2023-08-18 19:13:31,899 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 42.228.61.245:9091 ok 2023-08-18 19:13:31,899 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 117.40.176.42:9091 ok 2023-08-18 19:13:31,899 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 113.195.3.249:8085 ok 2023-08-18 19:13:31,900 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 118.212.152.82:9091 ok 2023-08-18 19:13:31,900 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 112.54.47.55:9091 ok 2023-08-18 19:13:31,900 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 171.34.53.2:9091 ok 2023-08-18 19:13:31,901 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 120.234.137.132:9002 ok 2023-08-18 19:13:31,901 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 221.6.215.202:9091 ok 2023-08-18 19:13:31,902 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 121.31.35.98:9091 ok 2023-08-18 19:13:31,902 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 39.105.122.19:60080 ok 2023-08-18 19:13:31,903 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 223.84.240.36:9091 ok 2023-08-18 19:13:31,903 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 112.11.242.201:9091 ok 2023-08-18 19:13:31,903 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 111.21.183.58:9091 ok 2023-08-18 19:13:31,904 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 116.113.68.130:9091 ok 2023-08-18 19:13:31,904 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 124.90.211.233:8085 ok 2023-08-18 19:13:31,905 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 112.6.117.178:8085 ok 2023-08-18 19:13:31,905 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.233.169.226:9091 ok 2023-08-18 19:13:31,905 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 113.195.53.101:8085 ok 2023-08-18 19:13:31,906 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 124.90.210.57:8085 ok 2023-08-18 19:13:31,906 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 36.32.21.45:8085 ok 2023-08-18 19:13:31,906 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.220.6.198:9091 ok 2023-08-18 19:13:31,906 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 110.185.164.20:9091 ok 2023-08-18 19:13:31,907 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 61.132.228.99:8088 ok 2023-08-18 19:13:31,907 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 112.29.170.10:8088 ok 2023-08-18 19:13:31,907 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 120.196.188.21:9091 ok 2023-08-18 19:13:31,908 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.27.249.95:8085 ok 2023-08-18 19:13:31,910 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 118.31.2.38:8999 ok 2023-08-18 19:13:31,910 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 119.8.236.97:3128 ok 2023-08-18 19:13:31,911 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 123.183.160.83:9091 ok 2023-08-18 19:13:31,911 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 116.5.171.115:9002 ok 2023-08-18 19:13:31,911 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 39.105.122.19:60080 ok 2023-08-18 19:13:31,911 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 122.228.136.27:9091 ok 2023-08-18 19:13:31,912 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 123.57.233.117:60080 ok 2023-08-18 19:13:31,912 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 222.179.155.90:9091 ok 2023-08-18 19:13:31,912 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 36.99.165.148:9002 ok 2023-08-18 19:13:31,913 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 58.246.58.150:9002 ok 2023-08-18 19:13:31,913 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.237.177.31:9091 ok 2023-08-18 19:13:31,914 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 182.61.201.201:80 ok 2023-08-18 19:13:31,914 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 183.239.62.59:9091 ok 2023-08-18 19:13:31,914 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 124.225.20.144:9002 ok 2023-08-18 19:13:31,915 fetch.py[line:39] INFO ProxyFetch - freeProxy06: 125.74.28.71:9002 ok 2023-08-18 19:13:32,171 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 47.111.173.88:8888 ok 2023-08-18 19:13:32,171 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 60.12.168.114:9002 ok 2023-08-18 19:13:32,172 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 8.45.176.194:80 ok 2023-08-18 19:13:32,172 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 61.183.234.226:9091 ok 2023-08-18 19:13:32,173 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 39.106.60.216:3128 ok 2023-08-18 19:13:32,173 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 111.178.11.20:8088 ok 2023-08-18 19:13:32,173 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 120.234.203.171:9002 ok 2023-08-18 19:13:32,173 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 222.138.76.6:9002 ok 2023-08-18 19:13:32,174 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 121.194.7.153:80 ok 2023-08-18 19:13:32,174 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 60.188.5.162:80 ok 2023-08-18 19:13:32,174 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 111.20.217.178:9091 ok 2023-08-18 19:13:32,174 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 111.20.217.178:9091 ok 2023-08-18 19:13:32,174 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 210.75.50.242:9002 ok 2023-08-18 19:13:32,175 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 113.195.207.249:9091 ok 2023-08-18 19:13:32,175 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 122.9.151.210:81 ok 2023-08-18 19:13:32,175 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 111.40.124.221:9091 ok 2023-08-18 19:13:32,175 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 183.247.199.51:30001 ok 2023-08-18 19:13:32,175 fetch.py[line:39] INFO ProxyFetch - freeProxy08: 139.196.78.175:7890 ok 2023-08-18 19:13:32,528 webRequest.py[line:80] ERROR requests: http://www.66ip.cn/ error: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) 2023-08-18 19:13:32,528 webRequest.py[line:86] INFO retry 5 second after 2023-08-18 19:13:32,637 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.98:8089 ok 2023-08-18 19:13:32,637 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.144:8089 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.194:8089 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.220:8089 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 114.231.46.233:8888 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.148:8089 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.106:8089 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 223.247.46.96:8089 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.161:8089 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 114.231.8.167:8089 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 121.4.138.93:3128 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.124:8089 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.250:8089 ok 2023-08-18 19:13:32,638 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.119:8089 ok 2023-08-18 19:13:32,639 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.206:8089 ok 2023-08-18 19:13:32,778 fetch.py[line:47] ERROR ProxyFetch - freeProxy01: error 2023-08-18 19:13:32,778 fetch.py[line:48] ERROR list index out of range 2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 114.102.47.174:8089 ok 2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 8.130.39.117:8080 ok 2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 122.9.131.161:3128 ok 2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 117.50.175.254:7890 ok 2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 183.164.242.54:8089 ok 2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 36.138.56.214:3128 ok 2023-08-18 19:13:33,028 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 180.119.93.73:8089 ok 2023-08-18 19:13:33,029 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 139.224.56.162:1234 ok 2023-08-18 19:13:33,029 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 183.164.243.156:8089 ok 2023-08-18 19:13:33,029 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 183.164.243.161:8089 ok 2023-08-18 19:13:33,430 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.57.92.68:8089 ok 2023-08-18 19:13:33,430 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 183.165.227.182:8089 ok 2023-08-18 19:13:33,431 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 111.224.11.146:8089 ok 2023-08-18 19:13:33,431 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.69.237.191:8089 ok 2023-08-18 19:13:33,431 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 125.79.51.242:8089 ok 2023-08-18 19:13:33,432 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 39.100.120.200:7890 ok 2023-08-18 19:13:33,432 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.71.154.168:8089 ok 2023-08-18 19:13:33,432 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 39.165.0.137:9002 ok 2023-08-18 19:13:33,433 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.40.176.42:9091 ok 2023-08-18 19:13:33,433 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.27.186.40:8089 ok 2023-08-18 19:13:33,433 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 60.12.168.114:9002 ok 2023-08-18 19:13:33,434 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 82.156.152.73:7890 ok 2023-08-18 19:13:33,434 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 180.120.212.179:8089 ok 2023-08-18 19:13:33,434 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 114.102.44.112:8089 ok 2023-08-18 19:13:33,434 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.71.149.54:8089 ok 2023-08-18 19:13:33,435 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 49.71.144.162:8089 ok 2023-08-18 19:13:33,435 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.57.92.63:8089 ok 2023-08-18 19:13:33,435 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 36.158.107.38:8085 ok 2023-08-18 19:13:33,435 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 218.28.98.229:9091 ok 2023-08-18 19:13:33,436 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 49.86.181.2:8089 ok 2023-08-18 19:13:33,436 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 114.102.44.43:8089 ok 2023-08-18 19:13:33,437 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 27.158.127.19:8089 ok 2023-08-18 19:13:33,437 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 117.86.12.19:8089 ok 2023-08-18 19:13:33,437 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 180.121.128.137:8089 ok 2023-08-18 19:13:33,437 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 36.6.145.71:8089 ok 2023-08-18 19:13:33,437 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 183.89.109.208:8080 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 162.223.94.163:80 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 178.130.113.251:8080 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.134.211:8080 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.74.127:8080 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 154.236.191.49:1981 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 27.76.11.251:4007 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 104.129.194.104:8800 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.210.47:8080 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.205.123:8080 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 103.167.134.31:80 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 110.238.46.127:8080 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 178.218.43.60:4411 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 193.15.14.198:80 ok 2023-08-18 19:13:33,438 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 27.79.214.140:4002 ok 2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 116.203.28.43:80 ok 2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.3.82:8080 ok 2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 20.115.144.82:80 ok 2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 154.118.228.212:80 ok 2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 185.178.47.135:80 ok 2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 134.35.207.146:8080 ok 2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 46.35.90.27:8080 ok 2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 110.78.114.161:8080 ok 2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 94.26.199.226:8080 ok 2023-08-18 19:13:33,439 fetch.py[line:39] INFO ProxyFetch - freeProxy11: 158.69.53.132:9300 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.98:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.144:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.194:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.220:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 114.231.46.233:8888 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.148:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.106:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 223.247.46.96:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.161:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 114.231.8.167:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 121.4.138.93:3128 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.124:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.144.250:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.119:8089 ok 2023-08-18 19:13:33,644 fetch.py[line:39] INFO ProxyFetch - freeProxy07: 36.6.145.206:8089 ok 2023-08-18 19:13:33,741 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 60.205.132.71:80 ok 2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 61.216.185.88:60808 ok 2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 113.121.44.194:9999 ok 2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 183.247.221.119:30001 ok 2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 112.243.230.6:9000 ok 2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 61.164.39.69:53281 ok 2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 182.34.20.197:9999 ok 2023-08-18 19:13:33,742 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 61.164.39.67:53281 ok 2023-08-18 19:13:33,743 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 60.170.204.30:8060 ok 2023-08-18 19:13:33,743 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 61.216.156.222:60808 ok 2023-08-18 19:13:33,743 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 182.34.26.49:9999 ok 2023-08-18 19:13:33,743 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 183.64.239.19:8060 ok 2023-08-18 19:13:34,037 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 124.202.206.94:9091 ok 2023-08-18 19:13:34,037 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 123.154.237.1:8085 ok 2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 120.202.128.112:9002 ok 2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 112.51.96.118:9091 ok 2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 218.75.102.198:8000 ok 2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 114.113.116.67:9091 ok 2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 112.194.142.135:9091 ok 2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 222.170.15.122:9091 ok 2023-08-18 19:13:34,038 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 47.100.201.85:80 ok 2023-08-18 19:13:34,039 fetch.py[line:39] INFO ProxyFetch - freeProxy03: 39.165.0.137:9002 ok 2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 47.90.[126](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:127).138:9090 ok 2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 114.231.42.64:8888 ok 2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 122.136.212.132:53281 ok 2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 117.26.41.218:8888 ok 2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 118.190.244.234:3128 ok 2023-08-18 19:13:35,990 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 221.122.91.65:80 ok 2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 60.182.197.86:8888 ok 2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 60.182.35.230:8888 ok 2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 117.157.197.18:3128 ok 2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 118.163.13.200:8080 ok 2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 223.70.126.84:3128 ok 2023-08-18 19:13:35,991 fetch.py[line:39] INFO ProxyFetch - freeProxy05: 112.250.107.37:53281 ok 2023-08-18 19:13:38,425 webRequest.py[line:80] ERROR requests: http://www.66ip.cn/ error: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) 2023-08-18 19:13:38,425 webRequest.py[line:86] INFO retry 5 second after 启动webApi服务 **************************************************************** *** ______ ********************* ______ *********** _ ******** *** | ___ \_ ******************** | ___ \ ********* | | ******** *** | |_/ / \__ __ __ _ __ _ | |_/ /___ * ___ | | ******** *** | __/| _// _ \ \ \/ /| | | || __// _ \ / _ \ | | ******** *** | | | | | (_) | > < \ |_| || | | (_) | (_) || |___ **** *** \_| |_| \___/ /_/\_\ \__ |\_| \___/ \___/ \_____/ **** **** __ / / ***** ************************* /___ / ******************************* ************************* ******************************** **************************************************************** 2023-08-18 19:13:40,781 launcher.py[line:45] INFO ProxyPool Version: 2.4.0 2023-08-18 19:13:40,783 launcher.py[line:50] INFO ProxyPool configure HOST: 0.0.0.0 2023-08-18 19:13:40,784 launcher.py[line:51] INFO ProxyPool configure PORT: 5010 2023-08-18 19:13:40,785 launcher.py[line:52] INFO ProxyPool configure PROXY_FETCHER: ['freeProxy01', 'freeProxy02', 'freeProxy03', 'freeProxy04', 'freeProxy05', 'freeProxy06', 'freeProxy07', 'freeProxy08', 'freeProxy09', 'freeProxy10', 'freeProxy11'] 2023-08-18 19:13:40,992 launcher.py[line:58] INFO ============ DATABASE CONFIGURE ================ 2023-08-18 19:13:40,993 launcher.py[line:59] INFO DB_TYPE: REDIS 2023-08-18 19:13:40,994 launcher.py[line:60] INFO DB_HOST: [127](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:128).0.0.1 2023-08-18 19:13:40,994 launcher.py[line:61] INFO DB_PORT: 6379 2023-08-18 19:13:40,994 launcher.py[line:62] INFO DB_NAME: 0 2023-08-18 19:13:40,995 launcher.py[line:63] INFO DB_USER: 2023-08-18 19:13:40,995 launcher.py[line:64] INFO ================================================= [2023-08-18 19:13:41 +0000] [2288] [INFO] Starting gunicorn 19.9.0 [2023-08-18 19:13:41 +0000] [2288] [INFO] Listening at: http://0.0.0.0:5010 (2288) [2023-08-18 19:13:41 +0000] [2288] [INFO] Using worker: sync /opt/hostedtoolcache/Python/3.10.12/x64/lib/python3.10/os.py:1030: RuntimeWarning: line buffering (buffering=1) isn't supported in binary mode, the default buffer size will be used return io.open(fd, mode, buffering, encoding, *args, **kwargs) [2023-08-18 19:13:41 +0000] [2290] [INFO] Booting worker with pid: 2290 [2023-08-18 19:13:41 +0000] [2291] [INFO] Booting worker with pid: 2291 [2023-08-18 19:13:41 +0000] [2292] [INFO] Booting worker with pid: 2292 [2023-08-18 19:13:41 +0000] [2293] [INFO] Booting worker with pid: 2293 2023-08-18 19:13:41,919 webRequest.py[line:80] ERROR requests: https://www.89ip.cn/index_1.html error: HTTPSConnectionPool(host='www.89ip.cn', port=443): Max retries exceeded with url: /index_1.html (Caused by ConnectTimeoutError(<urllib3.connection.VerifiedHTTPSConnection object at 0x7fb1d8f513f0>, 'Connection to www.89ip.cn timed out. (connect timeout=10)')) 2023-08-18 19:13:41,919 webRequest.py[line:86] INFO retry 5 second after [2023-08-18 19:13:43,812][test_proxy.py][DEBUG][36]: 0 [2023-08-18 19:13:43,814][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010 [2023-08-18 19:13:43,820][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /get/ HTTP/1.1" [200](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:201) 28 127.0.0.1 - [18/Aug/[202](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:203)3:19:13:43 +0000] "GET /get/ HTTP/1.1" 200 "python-requests/2.20.0" [2023-08-18 19:13:43,821][test_proxy.py][DEBUG][21]: None [2023-08-18 19:13:43,822][connectionpool.py][DEBUG][[204](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:205)]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,831][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,838][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,846][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,854][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,860][test_proxy.py][DEBUG][31]: 0 [2023-08-18 19:13:43,862][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010 [2023-08-18 19:13:43,868][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /delete/?proxy=None HTTP/1.1" 200 19 127.0.0.1 - [18/Aug/2023:19:13:43 +0000] "GET /delete/?proxy=None HTTP/1.1" 200 "python-requests/2.20.0" [2023-08-18 19:13:43,868][test_proxy.py][DEBUG][38]: None [2023-08-18 19:13:43,868][test_proxy.py][DEBUG][36]: 1 [2023-08-18 19:13:43,869][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010 [2023-08-18 19:13:43,875][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /get/ HTTP/1.1" 200 28 127.0.0.1 - [18/Aug/2023:19:13:43 +0000] "GET /get/ HTTP/1.1" 200 "python-requests/2.20.0" [2023-08-18 19:13:43,876][test_proxy.py][DEBUG][21]: None [2023-08-18 19:13:43,877][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,885][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,904][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,910][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,915][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,920][test_proxy.py][DEBUG][31]: 0 [2023-08-18 19:13:43,921][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010 [2023-08-18 19:13:43,927][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /delete/?proxy=None HTTP/1.1" 200 19 127.0.0.1 - [18/Aug/2023:19:13:43 +0000] "GET /delete/?proxy=None HTTP/1.1" 200 "python-requests/2.20.0" [2023-08-18 19:13:43,928][test_proxy.py][DEBUG][38]: None [2023-08-18 19:13:43,928][test_proxy.py][DEBUG][36]: 2 [2023-08-18 19:13:43,929][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010 [2023-08-18 19:13:43,930][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /get/ HTTP/1.1" 200 28 127.0.0.1 - [18/Aug/2023:19:13:43 +0000] "GET /get/ HTTP/1.1" 200 "python-requests/2.20.0" [2023-08-18 19:13:43,931][test_proxy.py][DEBUG][21]: None [2023-08-18 19:13:43,932][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,946][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,951][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,957][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,962][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): none:80 [2023-08-18 19:13:43,968][test_proxy.py][DEBUG][31]: 0 [2023-08-18 19:13:43,969][connectionpool.py][DEBUG][204]: Starting new HTTP connection (1): 127.0.0.1:5010 [2023-08-18 19:13:43,972][connectionpool.py][DEBUG][391]: http://127.0.0.1:5010 "GET /delete/?proxy=None HTTP/1.1" 200 19 127.0.0.1 - [18/Aug/2023:19:13:43 +0000] "GET /delete/?proxy=None HTTP/1.1" 200 "python-requests/2.20.0" [2023-08-18 19:13:43,972][test_proxy.py][DEBUG][38]: None 2023-08-18 19:13:44,321 webRequest.py[line:80] ERROR requests: http://www.66ip.cn/ error: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) 2023-08-18 19:13:44,[321](https://github.com/Buliet/Relaxed-Moment/actions/runs/5906264937/job/16021933681#step:7:322) fetch.py[line:47] ERROR ProxyFetch - freeProxy02: error 2023-08-18 19:13:44,321 fetch.py[line:48] ERROR can only parse strings
import requests import logging log = logging.getLogger("root") formatter = "[%(asctime)s][%(filename)s][%(levelname)s][%(lineno)d]: %(message)s" # logging.basicConfig(level=logging.WARN, format=formatter) logging.basicConfig(level=logging.DEBUG, format=formatter) def get_proxy(): return requests.get("http://127.0.0.1:5010/get/").json() def delete_proxy(proxy): requests.get("http://127.0.0.1:5010/delete/?proxy={}".format(proxy)) # your spider code def getHtml(): # .... retry_count = 5 proxy = get_proxy().get("proxy") log.debug(proxy) while retry_count > 0: try: html = requests.get('http://www.baidu.com', proxies={"http": "http://{}".format(proxy)}) log.debug(html.status_code) # 使用代理访问 return html except Exception: retry_count -= 1 # 删除代理池中代理 log.debug(retry_count) delete_proxy(proxy) return None for i in range(3): log.debug(i) res = getHtml() log.debug(res) if res: break
The text was updated successfully, but these errors were encountered:
你这样是因为什么,现在云服务器又不贵 甚至又白嫖的
Sorry, something went wrong.
谢谢回复
想实现的功能是定时抓取国内某网站的图片 发现 Github 直连异常,就尝试 本项目的代理功能
其次使用 Github Action,我认为的好处
哈哈 牛 我觉得就算行也不长久 这空子不好钻
No branches or pull requests
尝试没成功,结果如下
test_proxy.py
The text was updated successfully, but these errors were encountered: