Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "crawler" keyword
yeongnok 0.0.28
Korean National Assembly data analysis tool28 versions - Latest release: almost 2 years ago - 37 downloads last month - 1 maintainer
loldataapi 0.1.0
team data & player data1 version - Latest release: over 3 years ago - 1 dependent repositories - 2 downloads last month - 1 maintainer
scrapy-qiniu 0.1.2
Scrapy pipeline extension for qiniu.com3 versions - Latest release: over 8 years ago - 3 dependent repositories - 27 downloads last month - 24 stars on GitHub - 1 maintainer
search-torrent 1.4.3
Search for torrents using command line15 versions - Latest release: over 3 years ago - 1 dependent repositories - 89 downloads last month - 24 stars on GitHub - 1 maintainer
winzig 0.3.0
A tiny search engine for personal use.27 versions - Latest release: 2 months ago - 282 downloads last month - 3 stars on GitHub - 1 maintainer
naverblogbackup 0.1.3
Python Crawler for Backup Naver blog posts.5 versions - Latest release: over 6 years ago - 1 dependent repositories - 15 downloads last month - 3 stars on GitHub - 1 maintainer
reddrip 1.2.3
Reddrip is Reddit subreddit picture ripper.6 versions - Latest release: almost 9 years ago - 2 dependent repositories - 13 downloads last month - 1 stars on GitHub - 1 maintainer
firecrawl-py 0.0.8
Python SDK for Firecrawl API13 versions - Latest release: about 1 month ago - 1 dependent package - 16.9 thousand downloads last month - 4,092 stars on GitHub - 1 maintainer
jpsecurities 0.1.3
API for jp securities22 versions - Latest release: over 3 years ago - 1 dependent repositories - 41 downloads last month - 2 stars on GitHub - 1 maintainer
arsespyder 0.0.3
Web Spider to retrieve links3 versions - Latest release: over 10 years ago - 2 dependent repositories - 14 downloads last month - 0 stars on GitHub - 1 maintainer
kakakucom 0.2.0
Scriping library for kakaku.com2 versions - Latest release: over 4 years ago - 1 dependent repositories - 16 downloads last month - 1 maintainer
html2data 0.4.3
A simple way to transform a HTML file or URL to structured data.7 versions - Latest release: over 12 years ago - 2 dependent repositories - 19 downloads last month - 8 stars on GitHub - 1 maintainer
mongoct 0.1.2
MongoDB Change Streams tracker3 versions - Latest release: over 5 years ago - 1 dependent repositories - 17 downloads last month - 3 stars on GitHub - 2 maintainers
videofetch 0.1.9
Videodl: A lightweight video downloader written by pure python10 versions - Latest release: almost 2 years ago - 3 dependent repositories - 64 downloads last month - 399 stars on GitHub - 1 maintainer
allanon 0.2
A Web crawler that visit a predictable set of URLs, and automatically download resources you want...2 versions - Latest release: over 10 years ago - 17 downloads last month - 7 stars on GitHub - 1 maintainer
turbocrawler 0.0.1
Scraping and Crawling Micro-Framework5 versions - Latest release: 8 months ago - 16 downloads last month - 1 stars on GitHub - 1 maintainer
django-ajax-crawler 0.2dev
Handle page with dynamic data.2 versions - Latest release: almost 10 years ago - 2 dependent repositories - 9 downloads last month - 1 maintainer
pttlibrary 0.9.1
PTT library88 versions - Latest release: over 4 years ago - 1 dependent repositories - 230 downloads last month - 685 stars on GitHub - 1 maintainer
scrapyer-redis 0.1.4
Redis-based components for Scrapy.4 versions - Latest release: over 1 year ago - 1 dependent repositories - 35 downloads last month - 5,448 stars on GitHub - 1 maintainer
pexels-cli 0.1.0
A Simple CLI To Get Image With Specific Tag From Pexels1 version - Latest release: over 2 years ago - 1 dependent repositories - 3 downloads last month - 7 stars on GitHub - 1 maintainer
mbapy 0.7.4
MyBA in Python37 versions - Latest release: about 1 month ago - 246 downloads last month - 0 stars on GitHub - 1 maintainer
secretscraper 1.3.9
SecretScraper is a web scraper tool that can scrape the content through target websites and extra...28 versions - Latest release: about 1 month ago - 2.61 thousand downloads last month - 18 stars on GitHub - 1 maintainer
polypus 0.0.3a0
Social Media scraping with Python3 versions - Latest release: over 4 years ago - 1 dependent repositories - 4 downloads last month - 43 stars on GitHub - 1 maintainer
maruko 0.1.2
malware crawler3 versions - Latest release: about 8 years ago - 2 dependent repositories - 39 downloads last month - 6 stars on GitHub - 1 maintainer
Top 6.1% on pypi.org
13 versions - Latest release: almost 3 years ago - 87 dependent repositories - 4.52 thousand downloads last month - 180 stars on GitHub - 1 maintainer
metafinder 1.2
MetaFinder - Metadata search through Search Engines13 versions - Latest release: almost 3 years ago - 87 dependent repositories - 4.52 thousand downloads last month - 180 stars on GitHub - 1 maintainer
metacrawler 0.3.3
A lightweight Python crawling framework.20 versions - Latest release: about 8 years ago - 2 dependent repositories - 35 downloads last month - 0 stars on GitHub - 1 maintainer
Top 8.6% on pypi.org
83 versions - Latest release: about 1 month ago - 1 dependent repositories - 1.9 thousand downloads last month - 685 stars on GitHub - 1 maintainer
pyptt 1.2.12
PyPtt83 versions - Latest release: about 1 month ago - 1 dependent repositories - 1.9 thousand downloads last month - 685 stars on GitHub - 1 maintainer
leetcodecrawler 0.1.5
A LeetCode Crawler4 versions - Latest release: over 6 years ago - 1 dependent repositories - 14 downloads last month - 1 stars on GitHub - 1 maintainer
s1acker 0.1.1
Search and download images from stage1st1 version - Latest release: almost 7 years ago - 1 dependent repositories - 14 downloads last month - 0 stars on GitHub - 1 maintainer
scrapy-tor-proxy-rotation 0.0.4
IP Rotator for Scrapy via Tor4 versions - Latest release: over 1 year ago - 1 dependent repositories - 80 downloads last month - 27 stars on GitHub - 1 maintainer
microblogcrawler 1.4.1
A basic microblog/rss feed crawler modeled after the Tweepy StreamListener.6 versions - Latest release: about 9 years ago - 1 dependent repositories - 26 downloads last month - 1 maintainer
oceanmonkey 1.0.0
A High-Level Distributed Web Crawling and Web Scraping framework1 version - Latest release: over 2 years ago - 1 dependent repositories - 10 downloads last month - 7 stars on GitHub - 1 maintainer
swaiter 1.0.4
The loop waits until the selenium element has loaded.4 versions - Latest release: about 1 year ago - 43 downloads last month - 1 stars on GitHub - 1 maintainer
pyaiocrawler 0.5.0
Asynchronous web crawler built on asyncio11 versions - Latest release: almost 5 years ago - 1 dependent repositories - 31 downloads last month - 6 stars on GitHub - 1 maintainer
gallerycrawler 0.1.0
Generic crawling for web galleries1 version - Latest release: over 3 years ago - 1 dependent repositories - 7 downloads last month - 1 stars on GitHub - 1 maintainer
wuhan2019ncov 0.1.5
This tool is used for crawl Wuhan 2019nCov Info15 versions - Latest release: over 4 years ago - 1 dependent repositories - 9 downloads last month - 1 maintainer
journal-crawler 0.0.1
provides thesis entities1 version - Latest release: over 3 years ago - 1 dependent repositories - 7 downloads last month - 1 maintainer
naver-blog-backer 0.1.0
Backup your naver blog and Create backlink text file9 versions - Latest release: over 2 years ago - 1 dependent repositories - 30 downloads last month - 4 stars on GitHub - 1 maintainer
Top 2.8% on pypi.org
126 versions - Latest release: 6 months ago - 2 dependent packages - 64 dependent repositories - 4.84 thousand downloads last month - 1,959 stars on GitHub - 1 maintainer
news-please 1.5.44 💰
news-please is an open source easy-to-use news extractor that just works.126 versions - Latest release: 6 months ago - 2 dependent packages - 64 dependent repositories - 4.84 thousand downloads last month - 1,959 stars on GitHub - 1 maintainer
izen 0.2.3
encapsulation of some useful features16 versions - Latest release: almost 5 years ago - 1 dependent repositories - 78 downloads last month - 2 stars on GitHub - 1 maintainer
Top 5.3% on pypi.org
25 versions - Latest release: about 5 years ago - 17 dependent repositories - 595 downloads last month - 5,783 stars on GitHub - 1 maintainer
wechatsogou 4.5.4 💰
Api for wechat mp with sogou25 versions - Latest release: about 5 years ago - 17 dependent repositories - 595 downloads last month - 5,783 stars on GitHub - 1 maintainer
twitter-video-tools 2023.4.15
Twitter Video Tools is a multi-processing supported video downloader, supports videos from twitte...19 versions - Latest release: about 1 year ago - 159 downloads last month - 10 stars on GitHub - 1 maintainer
pokeycrawl 0.1.1a5
A python webcrawler2 versions - Latest release: almost 8 years ago - 2 dependent repositories - 15 downloads last month - 0 stars on GitHub - 1 maintainer
watchdogs 2.0.1
Watchdogs to keep an eye on the world's change. Read more: https://github.com/ClericPy/watchdogs.90 versions - Latest release: 7 months ago - 3 dependent repositories - 294 downloads last month - 12 stars on GitHub - 1 maintainer
ziim.0.0.2 0.0.2
Let your CLI find available solutions for errors / exceptions online on commands you hit, for you...1 version - Latest release: over 3 years ago - 8 downloads last month - 8 stars on GitHub - 1 maintainer
nacf 1.0.3 💰
Nasy Crawler Framework -- Never had such a pure crawler.7 versions - Latest release: about 5 years ago - 1 dependent repositories - 27 downloads last month - 9 stars on GitHub - 1 maintainer
zcooldl 0.1.4
ZCool picture crawler. Download ZCool (https://www.zcool.com.cn/) Designer's or User's pictures, ...2 versions - Latest release: over 3 years ago - 1 dependent repositories - 22 downloads last month - 5 stars on GitHub - 1 maintainer
zhihu-crawler 1.0.3
知乎关键词搜索、热榜、用户信息、回答、专栏文章、评论等信息的抓取程序6 versions - Latest release: about 2 years ago - 1 dependent repositories - 24 downloads last month - 26 stars on GitHub - 1 maintainer
spriterx 0.1.1
Python 3.6+ web scraping micro-framework based on asyncio coroutine pool.1 version - Latest release: over 4 years ago - 1 dependent repositories - 8 downloads last month - 9 stars on GitHub - 1 maintainer
clip-crawler 0.7.0
A wrapper/crawler meant to fetch information from the Campus Life Integration Platform (clip.fct....11 versions - Latest release: over 4 years ago - 93 downloads last month - 1 stars on GitLab.com - 1 maintainer
async-bowl 0.1.0
An Async Distributed Crawling Framework.2 versions - Latest release: over 4 years ago - 1 dependent repositories - 16 downloads last month - 5 stars on GitHub - 1 maintainer
frisbee 0.0.7
Search tool to find email addresses by abusing search7 versions - Latest release: about 5 years ago - 1 dependent repositories - 62 downloads last month - 29 stars on GitHub - 1 maintainer
naver-articrawler 0.1.4
news crawler from naver5 versions - Latest release: over 3 years ago - 1 dependent repositories - 8 downloads last month - 1 stars on GitHub - 1 maintainer
Top 3.8% on pypi.org
5 versions - Latest release: over 5 years ago - 24 dependent packages - 94 dependent repositories - 150 thousand downloads last month - 92 stars on GitHub - 1 maintainer
random-user-agent 1.0.1
A package to get random user agents based filters provided by user5 versions - Latest release: over 5 years ago - 24 dependent packages - 94 dependent repositories - 150 thousand downloads last month - 92 stars on GitHub - 1 maintainer
cococrawler 0.0.5
A distributed network crawler framework7 versions - Latest release: about 7 years ago - 49 downloads last month - 1 stars on GitHub - 1 maintainer
ziim 0.0.9
Let your CLI find available solutions for errors/exceptions in your code for you, no need open a ...9 versions - Latest release: over 3 years ago - 1 dependent repositories - 24 downloads last month - 8 stars on GitHub - 1 maintainer
geizhals 0.0.9 💰
A parser for the Geizhals.eu website.8 versions - Latest release: over 5 years ago - 253 dependent repositories - 70 downloads last month - 6 stars on GitHub - 1 maintainer
autobr 0.0.4
A bot to control web browser actions16 versions - Latest release: about 1 year ago - 52 downloads last month - 1 maintainer
dacrawler 1.0.29
Python wrapper for crawler26 versions - Latest release: almost 6 years ago - 1 dependent repositories - 46 downloads last month - 1 maintainer
airspider 2.0.4
An Easy-to-use and Fast Python Spider Framework6 versions - Latest release: almost 4 years ago - 42 downloads last month - 8 stars on GitHub - 1 maintainer
filmweb 0.9
Export movie ratings from filmweb.pl8 versions - Latest release: 6 months ago - 1 dependent repositories - 41 downloads last month - 12 stars on GitHub - 1 maintainer
hotelindex 0.17
a crawler to get common hotel's room prices5 versions - Latest release: over 6 years ago - 1 dependent repositories - 16 downloads last month - 0 stars on GitHub - 1 maintainer
loleventdata 0.2.0
team data & player data2 versions - Latest release: over 3 years ago - 1 dependent repositories - 9 downloads last month - 1 stars on GitHub - 1 maintainer
Top 5.4% on pypi.org
28 versions - Latest release: about 1 month ago - 8 dependent packages - 31 dependent repositories - 394 thousand downloads last month - 69 stars on GitHub - 1 maintainer
courlan 1.1.0
Clean, filter and sample URLs to optimize data collection – includes spam, content type and langu...28 versions - Latest release: about 1 month ago - 8 dependent packages - 31 dependent repositories - 394 thousand downloads last month - 69 stars on GitHub - 1 maintainer
ziroom-watcher 0.1.5
Get notification when ziroom's room status changes3 versions - Latest release: about 6 years ago - 1 dependent repositories - 9 downloads last month - 0 stars on GitHub - 1 maintainer
icecola 0.6
A util package for python6 versions - Latest release: about 4 years ago - 7 dependent repositories - 122 downloads last month - 2 stars on GitHub - 1 maintainer
hannibal 0.0.9
A light-weight crawler framework based on asyncio, aiohttp and redis.3 versions - Latest release: over 5 years ago - 1 dependent repositories - 26 downloads last month - 3 stars on GitHub - 1 maintainer
crawlerfriend 1.0.11
A light weight crawler which gives search results in HTML form or in Dictionary form, given urls ...4 versions - Latest release: almost 6 years ago - 20 downloads last month - 1 stars on GitHub - 1 maintainer
magicgoogle 0.2.7
A google search results crawler9 versions - Latest release: over 6 years ago - 1 dependent repositories - 33 downloads last month - 382 stars on GitHub - 1 maintainer
catswalk2 0.1.2
Core library for crawling and web scraping10 versions - Latest release: over 2 years ago - 44 downloads last month - 1 maintainer
pybrainyquote 0.2.2
Get quotes from brainyquote. Make you life positive.8 versions - Latest release: about 5 years ago - 1 dependent repositories - 11 downloads last month - 2 stars on GitHub - 1 maintainer
scrapx 2.4.1
A customized version of Scrapy1 version - Latest release: over 3 years ago - 1 dependent repositories - 11 downloads last month - 4 stars on GitHub - 1 maintainer
scrapysplashwrapper 1.11.0
Scrapy splash wrapper as a standalone library.30 versions - Latest release: about 2 years ago - 2 dependent repositories - 152 downloads last month - 9 stars on GitHub - 1 maintainer
yhb 0.1.12 removed
A package for quick using utils12 versions - Latest release: about 4 years ago - 74 downloads last month - 177 stars on GitHub - 1 maintainer
spoonproxy 0.3.2
A package for building specific Proxy Pool for different Sites.23 versions - Latest release: about 6 years ago - 1 dependent repositories - 89 downloads last month - 173 stars on GitHub - 1 maintainer
Top 4.2% on pypi.org
8 versions - Latest release: 4 months ago - 75 dependent repositories - 2.53 thousand downloads last month - 816 stars on GitHub - 2 maintainers
scrapyrt 0.16.0
Put Scrapy spiders behind an HTTP API8 versions - Latest release: 4 months ago - 75 dependent repositories - 2.53 thousand downloads last month - 816 stars on GitHub - 2 maintainers
pytwgasprices 0.0.1
A simple package to fetch the latest Taiwan gas prices1 version - Latest release: over 5 years ago - 1 dependent repositories - 16 downloads last month - 0 stars on GitHub - 1 maintainer
pycrawler 2.1.0 💰
A simple python crawler7 versions - Latest release: over 6 years ago - 2 dependent repositories - 35 downloads last month - 4 stars on GitHub - 1 maintainer
manga-py.utils 2.0
1 version - Latest release: about 4 years ago - 3 downloads last month - 1 maintaineraistlab_novel_grab 1.2.12
novel grab crawler module using python3 and lxml3 versions - Latest release: about 7 years ago - 39 downloads last month - 0 stars on GitHub - 1 maintainer
discolinks 0.2.0
Command-line tool which checks a website for broken links.2 versions - Latest release: over 1 year ago - 13 downloads last month - 7 stars on GitHub - 1 maintainer
x12306 0.3.0
12306查票助手，一键查询沿途所有站点，先上车后补票，让你的出行更省心。3 versions - Latest release: about 2 months ago - 275 downloads last month - 29 stars on GitHub - 1 maintainer
fintie 0.1.3
a common data obtain tool4 versions - Latest release: over 5 years ago - 1 dependent repositories - 15 downloads last month - 5 stars on GitHub - 1 maintainer
fspider 1.1.0
基于asyncio异步爬虫网络框架，仿scrapy2 versions - Latest release: over 2 years ago - 1 dependent repositories - 8 downloads last month - 2 stars on GitHub - 1 maintainer
dreamstorm 0.4.1
multi-thread tor crawler library5 versions - Latest release: about 7 years ago - 1 dependent repositories - 17 downloads last month - 8 stars on GitHub - 1 maintainer
underline 1.0.8
A human friendly web crawling library7 versions - Latest release: over 3 years ago - 1 dependent repositories - 62 downloads last month - 0 stars on GitHub - 1 maintainer
imchrome 0.2
This module provides easy to use functionalities for using selenium based chrome browser2 versions - Latest release: about 4 years ago - 1 dependent repositories - 5 downloads last month - 0 stars on GitHub - 1 maintainer
copymanga-dl 3.2 removed
Copymanga Downloader7 versions - Latest release: about 1 year ago - 201 downloads last month - 79 stars on GitHub - 1 maintainer
eyes-soatra 0.0.33
Eyes26 versions - Latest release: 11 months ago - 41 downloads last month - 1 maintainer
vlivepy 1.1.2
VLIVE(vlive.tv) parser for python21 versions - Latest release: about 3 years ago - 1 dependent repositories - 52 downloads last month - 6 stars on GitHub - 1 maintainer
solidscraper 0.7.7
This package lets your script scrape web sites. JQuery-Like API.4 versions - Latest release: almost 4 years ago - 1 dependent repositories - 25 downloads last month - 3 stars on GitHub - 1 maintainer
moodle-mobile-py 1.0.3
A Python Wrapper for the Moodle Mobile API3 versions - Latest release: about 2 years ago - 1 dependent repositories - 24 downloads last month - 0 stars on GitHub - 1 maintainer
spyck 0.0.1
Crawler framework2 versions - Latest release: about 8 years ago - 1 dependent repositories - 25 downloads last month - 1 maintainer
spiderboy 1.0.0
A tipical crawler, returns a list of urls1 version - Latest release: over 9 years ago - 1 dependent repositories - 9 downloads last month - 1 maintainer
pug-dj 0.0.18
# pug-dj2 versions - Latest release: about 9 years ago - 4 dependent repositories - 49 downloads last month - 0 stars on GitHub - 1 maintainer
tabelog-robot 0.1.3
Scriping library for tabelog.com4 versions - Latest release: over 4 years ago - 1 dependent repositories - 24 downloads last month - 1 maintainer
webspot 0.1.4
An intelligent web service to automatically detect web content and extract information from it.5 versions - Latest release: about 1 year ago - 32 downloads last month - 77 stars on GitHub - 1 maintainer
xcrawler 1.3.0
A multi-threaded, open source web crawler3 versions - Latest release: over 8 years ago - 2 dependent repositories - 18 downloads last month - 5 stars on GitHub - 1 maintainer
bookerwikitool 2023.5.24.0
iBooker/ApacheCN 知识库抓取工具51 versions - Latest release: about 1 year ago - 1 dependent repositories - 34 downloads last month - 4 stars on GitHub - 1 maintainer
invana-bot 0.1.36
A web spider framework that can transform websites into datasets with Crawl, Transform and Index ...38 versions - Latest release: almost 5 years ago - 1 dependent repositories - 96 downloads last month - 31 stars on GitHub - 1 maintainer
Related Keywords
python
202
scraper
127
spider
112
scraping
87
scrapy
67
crawling
50
python3
49
web
45
web-scraping
33
api
27
requests
25
selenium
24
asyncio
23
proxy
22
data
22
webscraping
21
downloader
21
parser
20
html
19
framework
19
news
18
crawl
16
hacktoberfest
15
twitter
15
distributed
14
web-crawler
14
redis
13
bot
13
aiohttp
12
automation
12
search
12
async
11
cli
11
crawler-python
11
proxies
10
beautifulsoup
10
scrape
10
web-scraping-python
10
http
10
bs4
9
beautifulsoup4
9
pypi
9
website
8
nlp
8
proxypool
8
news-aggregator
8
webscraper
8
lxml
7
osint
7
scrapper
7
search engine
7
mongodb
7
爬虫
7
security
7
webcrawler
7
machine-learning
7
google
7
webcrawling
6
search-engine
6
extractor
6
web-scraper
6
scrapy-redis
6
crawling-framework
6
pdf
6
webdriver
6
data-science
6
pip
6
scraping-framework
5
ptt
5
web-crawling
5
proxy-server
5
image
5
data-mining
5
video
5
wiki
5
document
5
proxy-list
5
sitemap
5
frontier
5
novel
5
asynchronous
5
instagram
5
web-spider
5
html-to-markdown
5
selenium-python
5
elasticsearch
5
zhihu
5
ai
5
news-crawler
5
crawling-python
4
lightnovel
4
httpx
4
manga
4
mail
4
fastapi
4
weibo
4
markdown
4
selenium-webdriver
4
douyin
4
library
4