The code and presentation here were done for this PyLadies event. The scrapers developed are pretty basic and they are not intended to work for any meetup group.
The talk is meant to introduce programmers into the scraping data world using python, processing "static" pages with BeautifulSoup and requests, or dynamic pages using Selenium webdriver.
As the talk is about BeautifulSoup, requests, and selenium, you'll need this packages.
You can either install them globally:
sudo pip install requests selenium beautifulsoup4
Or create a virtual enviroment in your folder for it:
sudo pip install virtualenv
Run the installation script:
./setup_virtualenv
And run your virtual enviroment:
source bin/activate
-
BeautifulSoup [docs] (http://www.crummy.com/software/BeautifulSoup/bs4/doc/)
-
Requests [docs] (http://docs.python-requests.org/en/latest/)
-
Selenium docs
-
XPATH selector resources w3schools reference
-
CSS selectors [w3schools] (http://www.w3schools.com/cssref/css_selectors.asp) reference