Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "web-spider" keyword

spidy-web-crawler 1.6.5
Spidy is the simple, easy to use command line web crawler.
12 versions - Latest release: over 6 years ago - 1 dependent repositories - 327 downloads last month - 323 stars on GitHub - 1 maintainer
talospider 0.0.6
A simple,lightweight scraping micro-framework
6 versions - Latest release: about 6 years ago - 5 dependent repositories - 91 downloads last month - 54 stars on GitHub - 1 maintainer
spidey.py 0.4.5
Web spiders are usually disliked by websites, but useful for recursive API/page downloads for off...
3 versions - Latest release: over 7 years ago - 32 downloads last month - 1 stars on GitHub - 1 maintainer
smoothcrawler 0.2.0
Build crawler humanly as different roles which be combined with different components.
2 versions - Latest release: almost 2 years ago - 1 dependent package - 2 dependent repositories - 140 downloads last month - 2 stars on GitHub - 1 maintainer
Top 9.9% on pypi.org
reequestss 9.9.9 removed
This package is used for security research and demonstrations. It might contain dangerous code sn...
1 version - Latest release: over 1 year ago - 4,800 stars on GitHub
smoothcrawler-cluster 0.2.0
Develop and build web spider cluster humanly.
2 versions - Latest release: over 1 year ago - 19 downloads last month - 1 stars on GitHub - 1 maintainer