Skip to content

A scrapper made using node.js that scrapes job data from https://news.ycombinator.com/jobs and stores them in a database

Notifications You must be signed in to change notification settings

whatthehanan/JobScrapper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

17 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

JobScrapper

Features

Technologies and packages

  • Node.js
  • Sequelize.js
  • cheerio
  • request

Why Node?

from what i read python and node.js have almost same performance while scraping and i had worked with cheerio (npm package) before so i went ahead with node.js

How to Deploy Code?

- Please make sure you have node and npm installed by running the following commands:
    node --verison
    npm --version
in a terminal run the following commands:
    npm install
    node scrape.js

Improvements:

- Regex expressions could have been more accurate
- Try to use NLP techniques

About

A scrapper made using node.js that scrapes job data from https://news.ycombinator.com/jobs and stores them in a database

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published