Skip to content

Scrapes website content, puts to sqlite3 database, downloads preview picture

License

Notifications You must be signed in to change notification settings

youstinus/car-scrape

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Car Scrape

Using github.com/PuerkitoBio/goquery package to scrape webpages.

Application used to scrape website data, parse and write to database.

All data is written to sqlite3 database and some pictures can be downloaded as well.

Sometimes it does not work because of site restrictions or captchas.

Some basic performance analysis used to measure application using pprof tool.

Project from 2021 archive

About

Scrapes website content, puts to sqlite3 database, downloads preview picture

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published