gem.coop "web-crawler" keyword
View the packages on the gem.coop package registry that are tagged with the "web-crawler" keyword.
Top 1.5% on gem.coop
29 versions - Latest release: 11 months ago - 437 thousand downloads total - 829 stars on GitHub - 1 maintainer
spidr 0.7.2 💰
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain...29 versions - Latest release: 11 months ago - 437 thousand downloads total - 829 stars on GitHub - 1 maintainer
sengi 0.1.0
A web crawler using Ruby and Redis.1 version - Latest release: over 9 years ago - 3.58 thousand downloads total - 0 stars on GitHub - 1 maintainer
spidr_epg 1.0.0 💰
Spidr is a versatile Ruby web spidering library that can spider a site, multiple domains, certain...1 version - Latest release: over 12 years ago - 3.96 thousand downloads total - 829 stars on GitHub - 1 maintainer
Top 2.5% on gem.coop
50 versions - Latest release: about 3 years ago - 140 thousand downloads total - 39 stars on GitHub - 1 maintainer
validate-website 1.12.0
validate-website is a web crawler for checking the markup validity with XML Schema / DTD and not ...50 versions - Latest release: about 3 years ago - 140 thousand downloads total - 39 stars on GitHub - 1 maintainer
Top 4.1% on gem.coop
40 versions - Latest release: 5 months ago - 67.6 thousand downloads total - 15 stars on GitHub - 1 maintainer
wgit 0.12.1
Wgit was primarily designed to crawl static HTML websites to index and search their content - pro...40 versions - Latest release: 5 months ago - 67.6 thousand downloads total - 15 stars on GitHub - 1 maintainer
spiderman 2.0.0 💰
your friendly neighborhood web crawler1 version - Latest release: almost 6 years ago - 5 thousand downloads total - 18 stars on GitHub - 1 maintainer