Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "spider" keyword

logstacker 0.0.1
A colorful and less settings logger, based on built-in package `logging`.
2 versions - Latest release: over 3 years ago - 1 dependent repositories - 16 downloads last month - 0 stars on GitHub - 1 maintainer
pyderweb 0.0.1
PyderWeb "the robot spider of web"
1 version - Latest release: over 16 years ago - 1 dependent repositories - 5 downloads last month - 2 maintainers
scrapqd 1.0.1b0
Scrape query definition intends to eliminate backend process of crawling and focus on xpath neede...
2 versions - Latest release: about 2 years ago - 1 dependent repositories - 18 downloads last month - 1 maintainer
wsltools 0.2.4
Web Scan Lazy Tools
6 versions - Latest release: almost 4 years ago - 1 dependent repositories - 76 downloads last month - 309 stars on GitHub - 2 maintainers
zakshare 1.12.8 removed
AKShare is an elegant and simple financial data interface library for Python, built for human bei...
1 version - Latest release: 4 months ago - 7,757 stars on GitHub - 2 maintainers
random-proxy 0.4
Generate a random proxy and return a tuple containes IP and Port.
2 versions - Latest release: over 5 years ago - 3 dependent repositories - 16 downloads last month - 6 stars on GitHub - 2 maintainers
sickooapi 0.0.1
Test for 魔改
1 version - Latest release: almost 3 years ago - 1 dependent repositories - 7 downloads last month - 1,868 stars on GitHub - 2 maintainers
npm_helper 0.20
npm website search is sooo silly and inconvenience. That's why this plugin born
2 versions - Latest release: almost 8 years ago - 2 dependent repositories - 14 downloads last month - 1 maintainer
nightcrawler 0.1.6
Website crawling bot
6 versions - Latest release: about 5 years ago - 1 dependent repositories - 54 downloads last month - 0 stars on GitHub - 2 maintainers
xhs-spider 1.1.0
Little Red Book notes, home page, detailed page crawler
11 versions - Latest release: 7 months ago - 45 downloads last month - 545 stars on GitHub - 2 maintainers
mocy 0.2.3
A lightweight web crawling framework.
3 versions - Latest release: almost 2 years ago - 1 dependent repositories - 37 downloads last month - 3 stars on GitHub - 2 maintainers
waizao 1.1.2
Simple financial data interface library for Python!
2 versions - Latest release: about 1 month ago - 23 downloads last month - 4 stars on GitHub - 2 maintainers
netcloud 1.0.3
网易云音乐综合爬虫,可以实现: 1.对于网易云音乐评论以及用户信息的爬取,并且可视化展示; 2.支持模拟登录,提供包括音乐,歌手,歌单,dj等全方位的api支持
2 versions - Latest release: over 5 years ago - 1 dependent repositories - 9 downloads last month - 42 stars on GitHub - 2 maintainers
products-crawler 0.1.9
A scrapy project for crawl product pictures and information.
10 versions - Latest release: almost 2 years ago - 1 dependent repositories - 78 downloads last month - 10 stars on GitHub - 1 maintainer
multiprocessingspider 1.1.2
A multiprocessing web crawling and web scraping framework.
4 versions - Latest release: about 4 years ago - 1 dependent repositories - 59 downloads last month - 1 stars on GitHub - 1 maintainer
Top 3.1% on pypi.org
bilibili-api-python 16.2.0
The fork of module bilibili-api. 哔哩哔哩的各种 API 调用便捷整合(视频、动态、直播等),另外附加一些常用的功能。
92 versions - Latest release: 3 months ago - 7 dependent packages - 7 dependent repositories - 9.35 thousand downloads last month - 1,751 stars on GitHub - 1 maintainer
Top 6.3% on pypi.org
magic-google 0.2.9
A google search results crawler
2 versions - Latest release: almost 4 years ago - 1 dependent package - 2 dependent repositories - 344 downloads last month - 374 stars on GitHub - 2 maintainers
Top 7.4% on pypi.org
aktools 0.0.86
AKTools is a tool for AKShare HTTP API!
81 versions - Latest release: 3 months ago - 1 dependent package - 1 dependent repositories - 1.98 thousand downloads last month - 395 stars on GitHub - 1 maintainer
Top 6.9% on pypi.org
crawlerdetect 0.1.7
CrawlerDetect is a Python class for detecting bots/crawlers/spiders via the user agent.
8 versions - Latest release: 9 months ago - 1 dependent package - 5 dependent repositories - 19.6 thousand downloads last month - 38 stars on GitHub - 2 maintainers
Top 2.8% on pypi.org
pyspider 0.3.10
A Powerful Spider System in Python
17 versions - Latest release: about 6 years ago - 1 dependent package - 98 dependent repositories - 1.16 thousand downloads last month - 16,276 stars on GitHub - 1 maintainer
Top 1.4% on pypi.org
akshare 1.12.54
AKShare is an elegant and simple financial data interface library for Python, built for human bei...
2,110 versions - Latest release: 3 months ago - 19 dependent packages - 54 dependent repositories - 69.6 thousand downloads last month - 7,692 stars on GitHub - 1 maintainer
web-walker 3.1.5
your can crawl web pages with litte settings. based on scrapy.
43 versions - Latest release: almost 7 years ago - 1 dependent repositories - 145 downloads last month - 53 stars on GitHub - 2 maintainers
browser-useragent 0.0.1
get a browser user_agent by random
1 version - Latest release: over 5 years ago - 1 dependent repositories - 36 downloads last month - 5 stars on GitHub - 2 maintainers
board-game-scraper 2.22.0 💰
Board games data scraping and processing from BoardGameGeek and more!
58 versions - Latest release: 3 months ago - 5 dependent repositories - 467 downloads last month - 21 stars on GitLab.com - 1 maintainer
scrapy-scraper 1.7 💰
Web crawler and scraper based on Scrapy and Playwright's headless browser.
8 versions - Latest release: 1 day ago - 39 downloads last month - 4 stars on GitHub - 2 maintainers
spider163 2.7.6
简单易用、功能强大的网易云音乐爬虫
20 versions - Latest release: about 6 years ago - 1 dependent repositories - 118 downloads last month - 580 stars on GitHub - 2 maintainers
spidey.py 0.4.5
Web spiders are usually disliked by websites, but useful for recursive API/page downloads for off...
3 versions - Latest release: over 7 years ago - 32 downloads last month - 1 stars on GitHub - 2 maintainers
Top 5.0% on pypi.org
scrapydweb 1.5.0
Web app for Scrapyd cluster management, with support for Scrapy log analysis & visualization.
17 versions - Latest release: 3 months ago - 23 dependent repositories - 1.74 thousand downloads last month - 2,987 stars on GitHub - 2 maintainers
scrapyd_ui 0.9.9
Full-featured web UI for Scrapyd cluster management, Scrapy log analysis & visualization
1 version - Latest release: over 5 years ago - 13 downloads last month - 2,987 stars on GitHub - 2 maintainers
Top 8.8% on pypi.org
scrapeops-scrapy 0.5.4
Scrapeops Scrapy SDK, is a monitoring tool for your Scrapy spiders.
16 versions - Latest release: 6 months ago - 15 dependent repositories - 1.66 thousand downloads last month - 36 stars on GitHub - 1 maintainer
easy-twitter-crawler 1.0.4
简易、强大的推特(Twitter)采集程序,支持元搜索,用户,粉丝,关注,发文,回复,评论等采集
5 versions - Latest release: 8 months ago - 82 downloads last month - 16 stars on GitHub - 2 maintainers
Top 4.8% on pypi.org
gerapy 0.9.13
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, D...
47 versions - Latest release: 10 months ago - 34 dependent repositories - 547 downloads last month - 3,206 stars on GitHub - 1 maintainer
spidertool 19.4.24
The package for Spider
15 versions - Latest release: about 5 years ago - 1 dependent repositories - 42 downloads last month - 0 stars on GitHub - 2 maintainers
ant-nest 1.0.1
A simple and clear Web Crawler framework build on python3.6+
59 versions - Latest release: over 3 years ago - 1 dependent package - 268 downloads last month - 96 stars on GitHub - 1 maintainer
gain 0.1.4
Web crawling framework for everyone.
5 versions - Latest release: almost 7 years ago - 4 dependent repositories - 70 downloads last month - 2,027 stars on GitHub - 4 maintainers
hiquant 0.4.17
Out-of-box python tool and framework for quantitative trading and study
14 versions - Latest release: about 2 years ago - 1 dependent repositories - 131 downloads last month - 13 stars on GitHub - 2 maintainers
crawler4py 0.5
A distributed crawler framework based on Python
5 versions - Latest release: over 3 years ago - 1 dependent repositories - 42 downloads last month - 6 stars on GitHub - 2 maintainers
spiderbot 0.3.3
a spider bot (scrawler) by python, using selenium and chrome driver
11 versions - Latest release: over 1 year ago - 107 downloads last month - 1 stars on GitHub - 1 maintainer
yy-spider 1.0.0
一个增量式爬虫系统
1 version - Latest release: over 6 years ago - 1 dependent repositories - 20 downloads last month - 0 stars on GitHub - 2 maintainers
socialregexes 0.1
Identify social network user account from url
1 version - Latest release: about 7 years ago - 1 dependent repositories - 54 downloads last month - 4 stars on GitHub - 2 maintainers
aranha 0.1.1
simple gevent based web spider and tools
2 versions - Latest release: almost 13 years ago - 2 dependent repositories - 20 downloads last month - 23 stars on GitHub - 1 maintainer
funnelweb 1.1.1
Crawl and parse static sites and import to Plone
9 versions - Latest release: almost 12 years ago - 3 dependent repositories - 52 downloads last month - 14 stars on GitHub - 2 maintainers
Top 8.1% on pypi.org
dumpall 0.3.2
一款信息泄漏利用工具,适用于.git/.svn/.DS_Store泄漏和目录列出漏洞利用
7 versions - Latest release: about 2 years ago - 2 dependent repositories - 475 downloads last month - 1,242 stars on GitHub - 2 maintainers
mr.migrator 1.0.1
Drive-by transmogrifiction made easy!
15 versions - Latest release: over 11 years ago - 5 dependent repositories - 75 downloads last month - 12 stars on GitHub - 8 maintainers
django-covid19 0.4rc1
A django app of covid-19 API in countries around the world, provinces and cities in China, and st...
8 versions - Latest release: almost 4 years ago - 1 dependent repositories - 87 downloads last month - 153 stars on GitHub - 1 maintainer
wauo 0.5
爬虫者的贴心助手
5 versions - Latest release: 4 days ago - 286 downloads last month - 1 stars on GitHub - 2 maintainers
easy-spider-tool 1.0.16
简易、好用的爬虫工具,减少重复代码与文件冗余
16 versions - Latest release: 5 months ago - 3 dependent packages - 187 downloads last month - 2 stars on GitHub - 2 maintainers
Top 3.6% on pypi.org
ruia 0.8.5
Async Python 3.6+ web scraping micro-framework based on asyncio.
55 versions - Latest release: over 1 year ago - 2 dependent packages - 21 dependent repositories - 690 downloads last month - 1,732 stars on GitHub - 2 maintainers
scrapyproxyport 1.1.1
Proxy Port Scrapy middleware
5 versions - Latest release: about 1 year ago - 1 dependent repositories - 40 downloads last month - 3 stars on GitHub - 2 maintainers
kkba 0.8.16
A Library to Convert Curl to Python Requests File
3 versions - Latest release: about 2 years ago - 1 dependent repositories - 25 downloads last month - 8 stars on GitHub - 2 maintainers
scrapy-count-filter 0.2.0
Scrapy Middleware for limiting requests based on a counter.
2 versions - Latest release: over 4 years ago - 2 dependent repositories - 34 downloads last month - 7 stars on GitHub - 2 maintainers
pyspider-mark 0.3.10
兼容Python3.7的pyspider
1 version - Latest release: almost 5 years ago - 1 dependent repositories - 31 downloads last month - 2 maintainers
ioweb 0.0.29
Web Scraping Framework
26 versions - Latest release: over 3 years ago - 1 dependent repositories - 97 downloads last month - 34 stars on GitHub - 2 maintainers
nudecrawler 0.3.19
Crawl telegra.ph for nude pictures and videos
38 versions - Latest release: about 1 year ago - 312 downloads last month - 260 stars on GitHub - 2 maintainers
zaoxg 0.0.1
new a id
1 version - Latest release: almost 2 years ago - 13 downloads last month - 1 stars on GitHub - 1 maintainer
cloudmusic 0.1.1
网易云爬虫解决方案
2 versions - Latest release: almost 4 years ago - 1 dependent repositories - 62 downloads last month - 95 stars on GitHub - 2 maintainers
driver-stealth 0.0.1
An Util for python packaging.
1 version - Latest release: over 2 years ago - 1 dependent repositories - 9 downloads last month - 2 maintainers
dt-scraper 2.0.2
Douyin/TikTok crawler and no watermark video download.
7 versions - Latest release: over 1 year ago - 32 downloads last month - 6,995 stars on GitHub - 1 maintainer
Top 9.9% on pypi.org
douyin-tiktok-scraper 1.2.9
Douyin/TikTok async data scraper.
21 versions - Latest release: 8 months ago - 1.16 thousand downloads last month - 6,995 stars on GitHub - 1 maintainer
proxyyourspider 1.0.2
Proxy your spider and crawl the galaxy.
2 versions - Latest release: about 7 years ago - 1 dependent repositories - 16 downloads last month - 5 stars on GitHub - 1 maintainer
dimtown-spider 0.1.1
A spider for https://dimtown.com
8 versions - Latest release: 8 months ago - 67 downloads last month - 2 stars on GitHub - 2 maintainers
crawl-requests 2.2.8
crawl_requests(like requests) can update ua and proxy automatically.
17 versions - Latest release: over 6 years ago - 100 downloads last month - 0 stars on GitHub - 1 maintainer
movie-searcher 0.1.1
Search movies for You
1 version - Latest release: about 6 years ago - 2 dependent repositories - 16 downloads last month - 3 stars on GitHub - 2 maintainers
xpaw 0.12.0
Async web scraping framework
21 versions - Latest release: almost 5 years ago - 1 dependent repositories - 94 downloads last month - 6 stars on GitHub - 2 maintainers
leto 0.1.3
A crawler framework.
15 versions - Latest release: almost 3 years ago - 1 dependent repositories - 121 downloads last month - 2 maintainers
fetcher 0.9.2.6
simple python fetcher, support head, get, post action, file upload, etc
11 versions - Latest release: over 12 years ago - 8 dependent repositories - 114 downloads last month - 2 maintainers
spider-admin-pro 2.0.13
a spider admin based vue, scrapyd api and APScheduler
29 versions - Latest release: about 1 month ago - 1 dependent repositories - 301 downloads last month - 492 stars on GitHub - 1 maintainer
aiocrawler 1.22
The aiocrawler is a asynchronous/distributed web crawler/spider
8 versions - Latest release: about 5 years ago - 37 downloads last month - 1 maintainer
x12306 0.3.0
12306查票助手,一键查询沿途所有站点,先上车后补票,让你的出行更省心。
2 versions - Latest release: 17 days ago - 139 downloads last month - 26 stars on GitHub - 2 maintainers
fk12306 0.1.1
12306查票助手,一键查询沿途所有站点,先上车后补票,暂不支持抢票
2 versions - Latest release: about 5 years ago - 1 dependent repositories - 23 downloads last month - 23 stars on GitHub - 2 maintainers
spider-toolkit 23.0.8
爬虫辅助模块
8 versions - Latest release: 8 months ago - 54 downloads last month - 2 maintainers
scrapy-qiniu 0.1.2
Scrapy pipeline extension for qiniu.com
3 versions - Latest release: over 8 years ago - 3 dependent repositories - 27 downloads last month - 24 stars on GitHub - 2 maintainers
spkcspider 0.29.4
A secure, decentral platform for maintaining your online identity
78 versions - Latest release: over 4 years ago - 1 dependent repositories - 494 downloads last month - 6 stars on GitHub - 4 maintainers
oceanmonkey 1.0.0
A High-Level Distributed Web Crawling and Web Scraping framework
1 version - Latest release: over 2 years ago - 1 dependent repositories - 10 downloads last month - 7 stars on GitHub - 2 maintainers
freeproxy 1.0.2
Get http proxies from some free proxy sites
3 versions - Latest release: about 7 years ago - 3 dependent repositories - 307 downloads last month - 19 stars on GitHub - 2 maintainers
acrawler 0.1.6
A simple web-crawling framework, based on aiohttp.
16 versions - Latest release: over 4 years ago - 2 dependent repositories - 71 downloads last month - 15 stars on GitHub - 1 maintainer
lazyspider 0.0.3
Powerful spider tools
2 versions - Latest release: over 6 years ago - 9 dependent repositories - 13 downloads last month - 67 stars on GitHub - 2 maintainers
Top 2.7% on pypi.org
icrawler 0.6.7
A multi-thread crawler framework with many builtin image crawlers provided.
42 versions - Latest release: 11 months ago - 2 dependent packages - 86 dependent repositories - 6.19 thousand downloads last month - 805 stars on GitHub - 4 maintainers
cquauth 0.0.3
重庆大学统一认证
1 version - Latest release: almost 6 years ago - 1 dependent repositories - 10 downloads last month - 6 stars on GitHub - 2 maintainers
spiderkeeper-deploy 0.1.3
Deploy to SpiderKeeper
2 versions - Latest release: over 5 years ago - 1 dependent repositories - 18 downloads last month - 2 stars on GitHub - 2 maintainers
zhihu-crawler 1.0.3
知乎关键词搜索、热榜、用户信息、回答、专栏文章、评论等信息的抓取程序
6 versions - Latest release: about 2 years ago - 1 dependent repositories - 24 downloads last month - 26 stars on GitHub - 2 maintainers
Top 8.8% on pypi.org
baiduspider 1.0.0
BaiduSpider,一个爬取百度的利器
34 versions - Latest release: almost 3 years ago - 1 dependent package - 1 dependent repositories - 403 downloads last month - 923 stars on GitHub - 2 maintainers
Top 8.1% on pypi.org
spiderkeeper 1.2.0
Admin ui for spider service
6 versions - Latest release: over 6 years ago - 5 dependent repositories - 110 downloads last month - 2,703 stars on GitHub - 1 maintainer
animecrawler 0.2.1
一个可免费下载动漫的爬虫
6 versions - Latest release: 12 months ago - 54 downloads last month - 1 stars on GitHub - 2 maintainers
cumtbscore 0.4.0
Student score interface for CUMTB
19 versions - Latest release: about 7 years ago - 1 dependent repositories - 48 downloads last month - 105 stars on GitHub - 2 maintainers
basic-web-scraper 0.13.7
Basic Web Scraper made with selenium and bs4
5 versions - Latest release: over 3 years ago - 1 dependent repositories - 13 downloads last month - 0 stars on GitHub - 2 maintainers
spideradmin 0.0.32
a spider admin based scrapyd api and APScheduler
19 versions - Latest release: about 4 years ago - 1 dependent repositories - 138 downloads last month - 88 stars on GitHub - 2 maintainers
scrapyd-api 0.0.1
scrapyd api
1 version - Latest release: over 3 years ago - 1 dependent package - 3 dependent repositories - 613 downloads last month - 2 stars on GitHub - 2 maintainers
py2crawl 1.0.7
A python framework to scrape/crawl the web in an async way
8 versions - Latest release: over 3 years ago - 1 dependent repositories - 69 downloads last month - 0 stars on GitHub - 2 maintainers
underline 1.0.8
A human friendly web crawling library
7 versions - Latest release: over 3 years ago - 1 dependent repositories - 43 downloads last month - 0 stars on GitHub - 2 maintainers
cococrawler 0.0.5
A distributed network crawler framework
7 versions - Latest release: about 7 years ago - 49 downloads last month - 1 stars on GitHub - 2 maintainers
spiderlab 0.0.1
An Util for python spider packaging.
1 version - Latest release: over 2 years ago - 1 dependent repositories - 15 downloads last month - 2 maintainers
cloudfeaster 0.9.59
Cloudfeaster
51 versions - Latest release: over 2 years ago - 1 dependent repositories - 149 downloads last month - 3 stars on GitHub - 2 maintainers
pokeycrawl 0.1.1a5
A python webcrawler
2 versions - Latest release: almost 8 years ago - 2 dependent repositories - 23 downloads last month - 0 stars on GitHub - 2 maintainers
airspider 2.0.4
An Easy-to-use and Fast Python Spider Framework
6 versions - Latest release: over 3 years ago - 68 downloads last month - 8 stars on GitHub - 2 maintainers
zcooldl 0.1.4
ZCool picture crawler. Download ZCool (https://www.zcool.com.cn/) Designer's or User's pictures, ...
2 versions - Latest release: over 3 years ago - 1 dependent repositories - 22 downloads last month - 5 stars on GitHub - 2 maintainers
pianyuan 1.4.0
a spider from pianyuan.la
33 versions - Latest release: over 4 years ago - 1 dependent repositories - 98 downloads last month - 8 stars on GitHub - 2 maintainers
fspider 1.1.0
基于asyncio异步爬虫网络框架,仿scrapy
2 versions - Latest release: over 2 years ago - 1 dependent repositories - 12 downloads last month - 2 stars on GitHub - 1 maintainer
scrapy-nimbus 0.5.3
scrapy extend
18 versions - Latest release: about 7 years ago - 1 dependent repositories - 17 downloads last month - 2 maintainers
scrapx 2.4.1
A customized version of Scrapy
1 version - Latest release: about 3 years ago - 1 dependent repositories - 11 downloads last month - 4 stars on GitHub - 2 maintainers