Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "webcrawler" keyword
noizze-crawler 12
A web page crawler which returns (title, og:image, og:description).12 versions - Latest release: over 4 years ago - 1 dependent repositories - 86 downloads last month - 0 stars on GitHub - 1 maintainer
yugioh-scraper 0.2.0
Yu-Gi-Oh! Scraper is a project that crawls websites and APIs and extracts Yu-Gi-Oh! related data ...5 versions - Latest release: over 1 year ago - 26 downloads last month - 1 stars on GitHub - 1 maintainer
googlenewsscraper 1.0.1
Scrapes Google News article data9 versions - Latest release: over 2 years ago - 1 dependent repositories - 53 downloads last month - 9 stars on GitHub - 3 maintainers
hydrosensorreader 1.7.6
Tools to read files from probes, sensors, or anything used in hydrogeology.13 versions - Latest release: over 2 years ago - 1 dependent repositories - 51 downloads last month - 7 stars on GitHub - 2 maintainers
testforppshare 0.2.5
PPtest is a utility for crawling historical and Real-time Quotes data of marco data9 versions - Latest release: about 1 year ago - 58 downloads last month - 0 stars on GitHub - 1 maintainer
cnkispider 1.1.0
CnkiSpider是一个高效爬取知网文章信息的包11 versions - Latest release: over 1 year ago - 68 downloads last month - 13 stars on GitHub - 1 maintainer
hanser-py-library 0.3.4
Download a book as PDF from https://www.hanser-elibrary.com/2 versions - Latest release: about 3 years ago - 1 dependent repositories - 9 downloads last month - 6 stars on GitHub - 1 maintainer
socialscraper 1.0.2
Social Scraper is a python tool meant for Detection of Child Predators/Cyber Harassers on Social ...2 versions - Latest release: about 4 years ago - 1 dependent repositories - 24 downloads last month - 52 stars on GitHub - 1 maintainer
webpage-image-downloader 0.1.2
Tool for extracting and saving specific images from websites.2 versions - Latest release: about 2 years ago - 1 dependent repositories - 15 downloads last month - 0 stars on GitHub - 1 maintainer
spydy 0.1.25
light-weight high-level web-crawling framework25 versions - Latest release: about 3 years ago - 1 dependent repositories - 36 downloads last month - 2 stars on GitHub - 1 maintainer
scrapio 0.1.9
Aysncio web crawling framework10 versions - Latest release: about 1 month ago - 1 dependent repositories - 78 downloads last month - 17 stars on GitHub - 1 maintainer
trawler 1.3.6
A data gathering framework to search and get information from web sources16 versions - Latest release: over 5 years ago - 1 dependent repositories - 98 downloads last month - 2 stars on GitHub - 1 maintainer
smith-the-crawler 0.0.12a0
A webscraper with a sofisticated toolkit to scrap the world3 versions - Latest release: almost 3 years ago - 1 dependent repositories - 26 downloads last month - 3 stars on GitHub - 1 maintainer
gskrawler 1.0.0
gskrawler will enter your domain and scan every page of your website, extracting page titles, des...1 version - Latest release: over 6 years ago - 1 dependent repositories - 7 downloads last month - 1 maintainer
scrapyrt-with-params 0.13.2
Put Scrapy spiders behind an HTTP API3 versions - Latest release: about 1 year ago - 1 dependent repositories - 27 downloads last month - 797 stars on GitHub - 1 maintainer
silene 1.0.0 💰
Silene is an open source web crawler framework built upon Pyppeteer.1 version - Latest release: over 3 years ago - 1 dependent repositories - 21 downloads last month - 0 stars on GitHub - 1 maintainer
catch 0.1.0
Web crawler with built in parsers usng latest Python technologies1 version - Latest release: about 6 years ago - 8 dependent repositories - 692 downloads last month - 0 stars on GitHub - 1 maintainer
Top 4.8% on pypi.org
16 versions - Latest release: about 2 months ago - 8 dependent repositories - 5.8 thousand downloads last month - 3,378 stars on GitHub - 1 maintainer
gne 0.3.1
General extractor of news pages.16 versions - Latest release: about 2 months ago - 8 dependent repositories - 5.8 thousand downloads last month - 3,378 stars on GitHub - 1 maintainer
spiders-for-all 0.3.9
A set of useful and scalable spiders to crawl data/videos from bilibili, xiaohongshu, etc.23 versions - Latest release: 4 months ago - 244 downloads last month - 18 stars on GitHub - 1 maintainer
django-easy-scraper 1.0.6
Dango app to scrape web page7 versions - Latest release: over 3 years ago - 1 dependent repositories - 29 downloads last month - 2 stars on GitHub - 1 maintainer
korean-news-crawler 1.0.5
Python Library for Crawling Top 10 Korean News and Providing Synonym Dictionary5 versions - Latest release: 27 days ago - 869 downloads last month - 0 stars on GitHub - 1 maintainer
webants 0.0.1
Async web crawler based on asyncio and aiohttp.1 version - Latest release: 10 months ago - 12 downloads last month - 0 stars on GitHub - 1 maintainer
pptool 0.0.5
PPtool is a Python third-party package that integrates many convenient methods for using the PPda...5 versions - Latest release: about 1 year ago - 37 downloads last month - 0 stars on GitHub - 1 maintainer
ppshare 1.1.6
PPshare is an application platform that focuses on scientific research data for a long time. The ...26 versions - Latest release: about 1 year ago - 1 dependent repositories - 144 downloads last month - 1 stars on GitHub - 1 maintainer
wikilink 0.3.0
A multiprocessing web-scraping application to scrape wiki pages and find minimum number of links ...2 versions - Latest release: about 5 years ago - 1 dependent repositories - 25 downloads last month - 10 stars on GitHub - 1 maintainer
webscraping-tools 0.1.7
Tools to make webscraping easier.8 versions - Latest release: over 4 years ago - 1 dependent repositories - 70 downloads last month - 2 stars on GitHub - 1 maintainer
sslproxies24 1.3.6 💰
Obtenha e valide vários Proxys diariamente com este pacote. (Thread).5 versions - Latest release: over 6 years ago - 1 dependent repositories - 49 downloads last month - 0 stars on GitHub - 1 maintainer
Top 4.2% on pypi.org
8 versions - Latest release: 4 months ago - 75 dependent repositories - 2.1 thousand downloads last month - 815 stars on GitHub - 2 maintainers
scrapyrt 0.16.0
Put Scrapy spiders behind an HTTP API8 versions - Latest release: 4 months ago - 75 dependent repositories - 2.1 thousand downloads last month - 815 stars on GitHub - 2 maintainers
mindfactory-crawling 1.0.4
A crawler for mindfactory.de2 versions - Latest release: over 5 years ago - 1 dependent repositories - 20 downloads last month - 3 stars on GitHub - 1 maintainer
lyric-scraper 1.0.6
A tool to get lyrics for your favourite songs5 versions - Latest release: almost 4 years ago - 1 dependent repositories - 26 downloads last month - 6 stars on GitHub - 1 maintainer
httpserver-mock 2
a simple http-server mockup to test web crawler.1 version - Latest release: over 4 years ago - 1 dependent repositories - 15 downloads last month - 0 stars on GitHub - 1 maintainer
gne-ren 0.3.1
General extractor of news pages.2 versions - Latest release: over 2 years ago - 1 dependent repositories - 12 downloads last month - 3,378 stars on GitHub - 1 maintainer
generalnewsextractor 0.1.3
General extractor of news pages.4 versions - Latest release: over 4 years ago - 1 dependent repositories - 25 downloads last month - 3,378 stars on GitHub - 1 maintainer
cloudfeaster 0.9.59
Cloudfeaster51 versions - Latest release: over 2 years ago - 1 dependent repositories - 149 downloads last month - 3 stars on GitHub - 1 maintainer
cesarvaliente_mswl_webcrawler 1.0
WebCrawler for the Development & Tools subject of the M.Sc. on Free Software1 version - Latest release: over 12 years ago - 9 downloads last month - 0 stars on GitHub - 1 maintainer
newsextractor 1.0
General extractor of news pages.1 version - Latest release: over 4 years ago - 1 dependent repositories - 10 downloads last month - 1 maintainer
cnkispider-zemengchuan 1.0.0 removed
CnkiSpider是一个高效爬取知网文章信息的包1 version - Latest release: over 1 year ago
ezweb 4.4.0 removed
An easy to use web page analyzer (scraper or crawler) with many useful features and properties17 versions - Latest release: over 2 years ago - 89 downloads last month - 3 stars on GitHub
Related Keywords
python
19
python3
9
data
9
scraper
7
webcrawling
7
crawler
7
webscraping
6
scrapy
4
webscraper
4
spider
4
webspider
4
crawling
3
scraping
3
requests
2
macro
2
CNKI
2
lxml
2
asyncio
2
async
2
selenium-python
2
tool
2
bs4
2
noizze
2
twisted
2
hacktoberfest2021
2
hacktoberfest
2
selenium
2
bilibili-download
1
PPdata
1
video-downloader
1
PPshare
1
aiohttp
1
pyppeteer
1
web crawler
1
xiaohongshu
1
beautifulsoup4
1
scraping-websites
1
scraping-python
1
newspaper-crawler
1
newspaper
1
pypp
1
korean
1
django-rest-framework
1
django
1
automation
1
catch
1
www
1
webpage
1
text-mining
1
text-classification
1
text-analysis
1
analyzer
1
selenium-webdriver
1
docker
1
beutifulshoup
1
web
1
site
1
proxy-list
1
24hour
1
anonymous
1
blog
1
feed
1
24
1
ssl
1
proxy
1
webscraping_tools
1
wikipedia
1
webcrawl
1
machine-learning
1
crawlers
1
application
1
Information Analysis
1
Web Extracting
1
Data Science
1
Graph
1
Breadth First Search
1
Artificial Intelligence
1
Web Scraping
1
framework
1
google-api
1
finder
1
facebook
1
detector
1
cybertool
1
cybersecurity
1
cyberharassers
1
cyber-security
1
childpredators
1
research
1
pdf
1
education
1
sensor
1
readers
1
hydrology
1
hydrogeology
1
webdriver
1
web-scraping
1
googlescraper
1
googlenewsscraper
1
googlenews
1