simple-web-crawler

• A simple web crawler example with Python3, requests2 and BeautifulSoup4
• Data resource: https://www.wantgoo.com/

How to run ?

Pre-Step

• Install Python3, python module requests2 and BeautifulSoup4
  • Python3: brew install python
  • requests2: pip3 install requests2
  • BeautifulSoup4: pip3 install BeautifulSoup4

Run application

• Switch to project root and type python3 main.py in your terminal

Tech

• Python3
• requests2
• BeautifulSoup4

Other docs

• requests2: http://docs.python-requests.org/
• BeautifulSoup4: https://www.crummy.com/software/BeautifulSoup/bs4/doc/

Disclaimer

• This is just a simple experiment. Please don't use it in any illegal way. Otherwise, you will bear legal responsibility by yourself

• 此程式為實驗性質, 任何不當使用請自負法律責任