A workaway.info paginated crawler for better organizing your search results. Express on the backend and React + Redux + Material UI for the frontend
- Dynamic crawling with regions as a parameter
- Archive, favorite actions
- Display excerpt
- "Load more" when scrolling
$ pip install scrapy pymongo
$ brew update && brew install node mongodb- Start your MongoDB service
$ cd / && mongod- Do your first crawl
$ cd workaway && scrapy crawl works$ npm i && npm run dev