zparvez2z / Research-field-Scrapper Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

this is a simple multi-threaded web crawler that crawls through DIU faculty profile and extracts research field

0 stars 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 10 Commits
build/main		build/main
dist/main		dist/main
README.md		README.md
createEXE.py		createEXE.py
domain.py		domain.py
general.py		general.py
link_finder.py		link_finder.py
main.py		main.py
main.spec		main.spec
spider.py		spider.py

Repository files navigation

Research-field-Scrapper

This is a simple multi-threaded web crawler that crawls through DIU faculty profiles and extracts research fields

need python 3.4 or later to run.
to extract data just run the main.py.
you can also create executable binary(windows) using createEXE.py.
there is already an executable available in the /dist/main directory.

About

this is a simple multi-threaded web crawler that crawls through DIU faculty profile and extracts research field

python web-crawler web-scraper data-extractor

Report repository

Releases

No releases published

Packages

No packages published

Languages