web-assets

Various Web Assets including 1K+ User Agent, 50+ Referers, 2.7K+ Proxies for Web Scrapping.

Used on Various programming languages for various projects including Web-Scrapping

User-Agent

1200+ Unique user agent string added and updated

• Mozilla

• Chrome
• Opera
• Internet Explorer
• Safari

Referer

100+ referer urls for making request seem to be legit.

Proxy

Proxify your each request

HTTP-Header

Sample HTTP-HEADER for setting in curl or request

Contribute

Please add other User agent and referer strings to make the collection large. Thank you

Credits

User-Agent : @pzb

Proxy list : @TheSpeedX

Check TheSpeedX's Proxy List for Updated List