Background

Some random things I'm using to track prices of things I may want to buy.

Local dev prep

• brew install postgresql
• brew services start postgresql@14
• createuser -s postgres
• createdb changedetection
• pip install -r requirements.txt
• bash scripts/test.py

Deployment

• Handled by Github Actions

Notes & Workarounds

• Get the CSS / xpath selectors by highlighting the item in Chrome and "Inspect"
• Can run on Scraping Hub with:
  • shub deploy
  • shub schedule [spider]
• If there are odd errors on Scraping Hub
  • Upgrade the stack in scrapinghub.yml
  • Make sure docker is running
  • Pull the relevant image from https://hub.docker.com/r/scrapinghub/scrapinghub-stack-scrapy/tags