Crawl websites for URLs and Images and add it to your database

Config

Replace the database name, username and password with your own credentials in the database connection string in the database.js

Install

npm install to install dependencies

Run

npm start to start the application in dev server

Usage

1. Access the '/' page or '/crawl' page to render the crawl page
2. Input the URL to crawl
3. Click on the crawl button
4. The crawl will start and the crawl status will be displayed
5. The 'Crawl Success' box will appear if the crawl is successful.