Scrape more than 1K HTTP - HTTPS - SOCKS4 - SOCKS5 proxies in less than 2 seconds.
Scraping fresh public proxies from different sources:
- sslproxies.org (HTTP, HTTPS)
- free-proxy-list.net (HTTP, HTTPS)
- us-proxy.org (HTTP, HTTPS)
- socks-proxy.net (Socks4, Socks5)
- proxyscrape.com (HTTP, Socks4, Socks5)
- proxy-list.download (HTTP, HTTPS, Socks4, Socks5)
- geonode.com (HTTP, HTTPS, Socks4, Socks5)
Use this command to install dependencies.
pip3 install -r requirements.txtFor scraping:
python3 proxyScraper.py -p http- With
-por--proxy, You can choose your proxy type. Supported proxy types are: HTTP - HTTPS - Socks (Both 4 and 5) - Socks4 - Socks5 - With
-oor--output, create and write to a .txt file. (Default is output.txt) - With
-vor--verbose, more details. - With
-hor--help, Show help to who did't read this README.
For checking:
python3 proxyChecker.py -p http -t 20 -s https://google.com -l output.txt
python3 proxyChecker.py -p https -t 20 -s https://google.com -l output.txt
python3 proxyChecker.py -p socks4 -t 20 -s https://google.com -l output.txt
python3 proxyChecker.py -p socks5 -t 20 -s https://google.com -l output.txt- With
-tor--timeout, dismiss the proxy after -t seconds (Default is 20) - With
-por--proxy, check HTTPS,HTTP,SOCKS4 or SOCKS5 proxies (Default is HTTP) - With
-lor--list, path to your list.txt. (Default is output.txt) - With
-sor--site, check with specific website like google.com. (Default is google.com) - With
-ror--random_agent, it will use a random user agent per proxy. - With
-vor--verbose, more details. - With
-hor--help, Show help to who did't read this README.
- Dead proxies will be removed and just alive proxies will stay.
- This script is also able to scrape Socks, but proxyChecker only checks HTTP(S) proxies.
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
Feel free to submit issues and enhancement requests or contact me via vida.page/nima.