Skip to content

cslin82/Mongo-News-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

78 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Mongo-News-Scraper

Task

This full-stack news app uses Express, Handlebars, Node.js, Mongoose/MongoDB, cheerio, jQuery, and Bootstrap to allow users to save/unsave and comment on posts from the Mozilla Blog. It introduces the use of MongoDB and Mongoose.

Concepts and technologies

  • New: Mongoose and MongoDB
  • New: Scraping server-side using cheerio
  • Express.js running on Node.js
  • Handlebars.js and rendering middleware
  • Using APIs and AJAX calls
  • NPM for JS library management
  • Custom Node.js modules and modular design, spreading logic and data across multiple files
  • Deploying full-stack apps to Heroku
  • Front-end technolgies (HTML, CSS, jQuery), HTML forms
  • New: Bootstrap 4.1

Enhancements

  • Use jQuery or other animations for notes appearing and disappearing
  • Add UI for scraping deeper
  • Incorporate data validation
  • Polish frontend
  • Write mocha/chai tests

TODO

  • Write help page
  • Clean up code and logic
  • Consolidate methods
  • Make deletes also delete ref in article model
  • Use return data from API AJAX calls
  • Convert scrape request to axios
  • Move moment calls to handlebars helpers

About

Scraper for Mozilla News using Mongoose/MongoDB on Node.js/Express

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published