GitHub - sattyamjjain/WEB-CRAWLER: Multi-threaded Python web crawler with modular architecture — spider engine, link finder, domain parser & URL frontier for systematic website scraping and content extraction.

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
WEB_CRAWLER.py		WEB_CRAWLER.py
domain.py		domain.py
link_finder.py		link_finder.py
main.py		main.py
spider.py		spider.py

About

Multi-threaded Python web crawler with modular architecture — spider engine, link finder, domain parser & URL frontier for systematic website scraping and content extraction.

python scraper automation spider web-crawler web-scraping data-extraction beautifulsoup link-finder

Activity

0 stars

0 watching

0 forks

Report repository

Releases

No releases published

Packages

Contributors

Languages

Python 100.0%

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

About

Uh oh!

Releases

Packages

Uh oh!

Contributors

Uh oh!

Languages

Folders and files

Latest commit

History

About

Topics

Uh oh!

Stars

Watchers

Forks

Releases

Packages 0

Uh oh!

Contributors

Uh oh!

Languages

Packages