Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "spider" keyword
fast-requests 1.0.0
无与伦比的简单且强大的requests1 version - Latest release: about 4 years ago - 1 dependent repositories - 98 downloads last month - 1 maintainer
simple-spider-tool 0.0.19
一些简易、好用的爬虫工具，减少代码与文件冗余，提升工作的效率和代码整洁度7 versions - Latest release: about 1 year ago - 1 dependent repositories - 18 downloads last month - 4 stars on GitHub - 1 maintainer
Top 4.4% on pypi.org
175 versions - Latest release: 3 months ago - 4 dependent repositories - 84.1 thousand downloads last month - 2,596 stars on GitHub - 1 maintainer
feapder 1.9.0
feapder是一款支持分布式、批次采集、数据防丢、报警丰富的python爬虫框架175 versions - Latest release: 3 months ago - 4 dependent repositories - 84.1 thousand downloads last month - 2,596 stars on GitHub - 1 maintainer
spider-task-ip-zy 1.1.0
spider IP service11 versions - Latest release: almost 3 years ago - 1 dependent repositories - 36 downloads last month - 1 maintainer
tenon 0.1.7
A package to solve captcha17 versions - Latest release: 4 months ago - 96 downloads last month - 66 stars on GitHub - 1 maintainer
weblocust 1.0.3
A more Powerful Spider System in Python based on pyspider4 versions - Latest release: over 7 years ago - 1 dependent repositories - 52 downloads last month - 6 stars on GitHub - 1 maintainer
bi-get 0.1.1
关于B站的一个爬虫，可以获取视频的信息，下载视频等1 version - Latest release: about 4 years ago - 10 downloads last month - 1 stars on GitHub - 1 maintainer
fastrequest789 1.0.0
fast requests1 version - Latest release: about 5 years ago - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 1 maintainer
Top 2.8% on pypi.org
17 versions - Latest release: about 6 years ago - 1 dependent package - 98 dependent repositories - 1.04 thousand downloads last month - 16,371 stars on GitHub - 1 maintainer
pyspider 0.3.10
A Powerful Spider System in Python17 versions - Latest release: about 6 years ago - 1 dependent package - 98 dependent repositories - 1.04 thousand downloads last month - 16,371 stars on GitHub - 1 maintainer
pyspider3 0.0.2
由于pyspider模块年久失修，pyspider3基于原作者github源码制作而成1 version - Latest release: over 2 years ago - 1 dependent repositories - 24 downloads last month - 16,371 stars on GitHub - 1 maintainer
scrapyd-api 0.0.1
scrapyd api2 versions - Latest release: over 3 years ago - 1 dependent package - 3 dependent repositories - 583 downloads last month - 3 stars on GitHub - 1 maintainer
pageflow 0.1
Simple, powerful and pythonic web page search results crawler.1 version - Latest release: about 5 years ago - 1 dependent repositories - 12 downloads last month - 1 stars on GitHub - 1 maintainer
vgis-spider 1.1.3
A libary for spider data11 versions - Latest release: 3 months ago - 56 downloads last month - 1 maintainer
alfred_npm_helper 0.1
npm website search is sooo silly and inconvenience. That's why this plugin born1 version - Latest release: almost 8 years ago - 2 dependent repositories - 21 downloads last month - 1 maintainer
spider80s 0.0.4
80s电影爬虫 输出给定电影/电视剧的迅雷下载地址4 versions - Latest release: about 6 years ago - 1 dependent repositories - 21 downloads last month - 2 stars on GitHub - 1 maintainer
spider-client 0.0.20
Python SDK for Spider Cloud API14 versions - Latest release: 24 days ago - 1 dependent package - 12.9 thousand downloads last month - 0 stars on GitHub - 1 maintainer
ze-the-scraper 0.0.17.dev1
Scaper to lager portal of news in Brazil.2 versions - Latest release: about 7 years ago - 1 dependent repositories - 23 downloads last month - 5 stars on GitHub - 1 maintainer
marketwatchdata 0.0.16
retrieve data from MarketWatch.com12 versions - Latest release: 11 months ago - 32 downloads last month - 0 stars on GitHub - 1 maintainer
ze 0.0.17.dev1
Scaper to lager portal of news in Brazil.2 versions - Latest release: about 7 years ago - 1 dependent repositories - 27 downloads last month - 5 stars on GitHub - 1 maintainer
h-music 0.1.4
howard music4 versions - Latest release: about 3 years ago - 1 dependent repositories - 31 downloads last month - 29 stars on GitHub - 1 maintainer
spydy 0.1.25
light-weight high-level web-crawling framework25 versions - Latest release: about 3 years ago - 1 dependent repositories - 36 downloads last month - 2 stars on GitHub - 1 maintainer
password-stretcher 1.0.6
A deadly password mangler7 versions - Latest release: over 2 years ago - 1 dependent package - 1 dependent repositories - 86 downloads last month - 30 stars on GitHub - 1 maintainer
img-lurker 1.0.3
Web gallery downloader3 versions - Latest release: 5 months ago - 1 dependent repositories - 18 downloads last month - 0 stars on GitLab.com - 1 maintainer
taobao-spider 1.0.2
A spider of taobaogoods2 versions - Latest release: over 5 years ago - 1 dependent repositories - 20 downloads last month - 0 stars on GitHub - 1 maintainer
rankcomp 0.0.2
high fided extraction of differential expression genes without considering the batch effects1 version - Latest release: about 4 years ago - 1 dependent repositories - 12 downloads last month - 5,392 stars on GitHub - 1 maintainer
bocfx 0.8.1
Easy API to get foreign exchange rate from Bank of China.17 versions - Latest release: 12 months ago - 1 dependent repositories - 3.06 thousand downloads last month - 52 stars on GitHub - 1 maintainer
graper 0.1.6
A Spider FrameWork7 versions - Latest release: over 2 years ago - 1 dependent repositories - 49 downloads last month - 1 stars on GitHub - 1 maintainer
simper-spider 0.1.0
This is a simper spider framework1 version - Latest release: about 5 years ago - 1 dependent repositories - 7 downloads last month - 2 stars on GitHub - 1 maintainer
haipproxy2 0.1.4
High aviariable proxy pool client for crawlers.5 versions - Latest release: over 3 years ago - 1 dependent repositories - 26 downloads last month - 5,392 stars on GitHub - 1 maintainer
xjtlu 0.1.0 💰
This is how to get all the network resources of XJTLU1 version - Latest release: 8 months ago - 14 downloads last month - 4 stars on GitHub - 1 maintainer
haipproxy 0.11.6
High aviariable proxy pool client for crawlers.6 versions - Latest release: almost 6 years ago - 1 dependent repositories - 21 downloads last month - 5,392 stars on GitHub - 1 maintainer
rule-spider 0.0.1
常用工具类1 version - Latest release: about 6 years ago - 1 dependent repositories - 10 downloads last month - 1 maintainer
zhihuapi 0.6.0
Unofficial API for zhihu.7 versions - Latest release: over 7 years ago - 1 dependent repositories - 25 downloads last month - 41 stars on GitHub - 1 maintainer
Top 6.7% on pypi.org
65 versions - Latest release: almost 3 years ago - 34 dependent repositories - 192 downloads last month - 1,138 stars on GitHub - 1 maintainer
django-dynamic-scraper 0.13.3
Creating Scrapy scrapers via the Django admin interface65 versions - Latest release: almost 3 years ago - 34 dependent repositories - 192 downloads last month - 1,138 stars on GitHub - 1 maintainer
lxmlhtml 0.0.2
a html parser based lxml2 versions - Latest release: about 4 years ago - 1 dependent repositories - 245 downloads last month - 0 stars on GitHub - 1 maintainer
Top 4.1% on pypi.org
81 versions - Latest release: over 2 years ago - 21 dependent repositories - 6.56 thousand downloads last month - 1,873 stars on GitHub - 1 maintainer
bilibili-api 9.1.0
哔哩哔哩的各种 API 调用便捷整合（视频、动态、直播等），另外附加一些常用的功能。81 versions - Latest release: over 2 years ago - 21 dependent repositories - 6.56 thousand downloads last month - 1,873 stars on GitHub - 1 maintainer
Top 3.6% on pypi.org
55 versions - Latest release: over 1 year ago - 2 dependent packages - 21 dependent repositories - 476 downloads last month - 1,732 stars on GitHub - 1 maintainer
ruia 0.8.5
Async Python 3.6+ web scraping micro-framework based on asyncio.55 versions - Latest release: over 1 year ago - 2 dependent packages - 21 dependent repositories - 476 downloads last month - 1,732 stars on GitHub - 1 maintainer
pynoveldl 0.1.1 💰
NovelDL: Search and download novels from some specific websites2 versions - Latest release: about 2 years ago - 1 dependent repositories - 19 downloads last month - 7 stars on GitHub - 1 maintainer
loler-spider 1.0.1
A spider to download lol-hero image1 version - Latest release: over 3 years ago - 1 dependent repositories - 8 downloads last month - 1 maintainer
airwater 1.0.3
Better Tools Library For Write Spider With Python3 versions - Latest release: over 4 years ago - 1 dependent repositories - 27 downloads last month - 1 maintainer
gooder 0.3.2
Simple Google parser6 versions - Latest release: about 2 years ago - 1 dependent repositories - 54 downloads last month - 4 stars on GitHub - 1 maintainer
bdindex 0.1.1
A spider on baidu and toutiao1 version - Latest release: over 2 years ago - 1 dependent repositories - 23 downloads last month - 0 stars on GitHub - 1 maintainer
smartscraper 1.2
A Smart, Automatic, Fast and Lightweight Web Scraper for Python3 versions - Latest release: over 2 years ago - 1 dependent repositories - 32 downloads last month - 11 stars on GitHub - 1 maintainer
deadlinks 0.3.5 💰
Health checks for your documentation links.10 versions - Latest release: 5 months ago - 1 dependent package - 2 dependent repositories - 221 downloads last month - 93 stars on GitHub - 1 maintainer
openget 0.3.1
A Spider FrameWork6 versions - Latest release: about 2 months ago - 59 downloads last month - 1 stars on GitHub - 1 maintainer
toapi 2.1.3
Every web site provides APIs.40 versions - Latest release: almost 3 years ago - 4 dependent repositories - 208 downloads last month - 3,463 stars on GitHub - 1 maintainer
smd 1.6.1
Simple Manga Downloader, a tool to search and download manga for offline reading5 versions - Latest release: almost 6 years ago - 1 dependent repositories - 49 downloads last month - 11 stars on GitHub - 1 maintainer
favorites-crawler 0.2.0
Crawl your personal favorite images, photo albums, comics from website. Support pixiv, yande.re f...26 versions - Latest release: 5 months ago - 1 dependent repositories - 144 downloads last month - 16 stars on GitHub - 1 maintainer
cewler 1.2.0
Custom Word List generator Redefined11 versions - Latest release: 3 months ago - 237 downloads last month - 68 stars on GitHub - 1 maintainer
chromeremote 0.2.7
Chrome Remote Dev Tools7 versions - Latest release: about 6 years ago - 1 dependent repositories - 383 downloads last month - 5 stars on GitHub - 1 maintainer
dblp-spider 0.0.5
A spider tool for downloading the DBLP search results into local BibTeX files5 versions - Latest release: about 3 years ago - 1 dependent repositories - 39 downloads last month - 5 stars on GitHub - 1 maintainer
shub-cli 2.0.1
A CLI at your hands to deal with the features of ScrapingHub.5 versions - Latest release: over 7 years ago - 1 dependent repositories - 38 downloads last month - 16 stars on GitHub - 1 maintainer
crawlspider 2.0.8
Python Common Spider for Humans.24 versions - Latest release: over 1 year ago - 182 downloads last month - 1 maintainer
yz-test 0.0
It is a html parser.Given a html document,It can get the content from the document. 给定一个网页提取网页中的正...1 version - Latest release: about 3 years ago - 1 dependent repositories - 10 downloads last month - 5 stars on GitHub - 1 maintainer
dcard-spider 0.3.0
A spider for Dcard through its newest API.12 versions - Latest release: about 7 years ago - 3 dependent repositories - 55 downloads last month - 95 stars on GitHub - 1 maintainer
Top 8.8% on pypi.org
46 versions - Latest release: almost 2 years ago - 1 dependent repositories - 628 downloads last month - 2,780 stars on GitHub - 1 maintainer
decryptlogin 0.3.9 💰
DecryptLogin: APIs for loginning some websites by using requests.46 versions - Latest release: almost 2 years ago - 1 dependent repositories - 628 downloads last month - 2,780 stars on GitHub - 1 maintainer
zakshare 1.12.8 removed
AKShare is an elegant and simple financial data interface library for Python, built for human bei...1 version - Latest release: 5 months ago - 7,757 stars on GitHub - 1 maintainer
easy-spider-tool-document 1.0.13
easy-spider-tool 可选xpath/jsonpath聚合解析扩展包5 versions - Latest release: 9 months ago - 1 dependent package - 41 downloads last month - 0 stars on GitHub - 1 maintainer
decryptloginexamples 0.1.1 💰
DecryptLogin-examples: Some crawler examples for DecryptLogin.2 versions - Latest release: about 2 years ago - 1 dependent repositories - 29 downloads last month - 2,780 stars on GitHub - 1 maintainer
printlistmcy 1.0.0
print the list1 version - Latest release: over 6 years ago - 1 dependent repositories - 7 downloads last month - 5 stars on GitHub - 1 maintainer
webcrawler 0.3
Web Crawler1 version - Latest release: over 10 years ago - 3 dependent repositories - 276 downloads last month - 0 stars on GitHub - 1 maintainer
mspider 0.2.5
Make your spider multi-threaded.4 versions - Latest release: about 5 years ago - 1 dependent package - 2 dependent repositories - 48 downloads last month - 1 stars on GitHub - 1 maintainer
threads_creator 1.5
A tool to help you build multiply spider1 version - Latest release: almost 8 years ago - 2 dependent repositories - 13 downloads last month - 2 stars on GitHub - 1 maintainer
tidy-page 0.1.1
html text parser,get the content form html page2 versions - Latest release: over 7 years ago - 1 dependent repositories - 17 downloads last month - 5 stars on GitHub - 1 maintainer
silene 1.0.0 💰
Silene is an open source web crawler framework built upon Pyppeteer.1 version - Latest release: over 3 years ago - 1 dependent repositories - 21 downloads last month - 0 stars on GitHub - 1 maintainer
trip 0.0.10
Async HTTP for humans, coroutine Requests.11 versions - Latest release: about 6 years ago - 1 dependent repositories - 239 downloads last month - 207 stars on GitHub - 1 maintainer
extend-library 1.0.0
Extend library for EMP.1 version - Latest release: over 6 years ago - 1 dependent repositories - 12 downloads last month - 5 stars on GitHub - 1 maintainer
convert2txt 0.1.1
convert html,PDF,DOC file to txt1 version - Latest release: over 6 years ago - 14 downloads last month - 5 stars on GitHub - 1 maintainer
nester_jl 1.0.0
a sample printer of nested lists1 version - Latest release: over 5 years ago - 8 downloads last month - 5 stars on GitHub - 1 maintainer
domo 0.52
Domo is a web crawler & archiver1 version - Latest release: 10 months ago - 1 dependent repositories - 1 maintainer
zsq_test 0.1.0
test1 version - Latest release: about 6 years ago - 12 downloads last month - 5 stars on GitHub - 1 maintainer
spiderbone 1.1.1
Differently Spider frame1 version - Latest release: over 6 years ago - 1 dependent repositories - 9 downloads last month - 1 stars on GitHub - 1 maintainer
harvestman 2.0.4betadev-r169
HarvestMan is a web crawler application and framework.2 versions - Latest release: 10 months ago - 1 dependent repositories - 1 maintainer
ilms-nthu 0.2.8
iLms-NTHU API. An iLMS client for students, assistants and developers.12 versions - Latest release: almost 6 years ago - 1 dependent repositories - 39 downloads last month - 20 stars on GitHub - 1 maintainer
scrapy-helper 1.5.3
scrapy helper2 versions - Latest release: 11 months ago - 1 dependent repositories - 25 downloads last month - 1 maintainer
structure-spider 1.3.5
multi requests to combine a structure item.49 versions - Latest release: over 4 years ago - 1 dependent repositories - 283 downloads last month - 29 stars on GitHub - 1 maintainer
scrapy-kit 0.1.12
A library for scrapy tools, including but not limited to the usual pipelines, middlewares, etc.9 versions - Latest release: 8 months ago - 71 downloads last month - 0 stars on GitHub - 1 maintainer
show-time 0.0.5
A tool based on network spider technology to crawl information for numerous shows such as dramas ...6 versions - Latest release: over 4 years ago - 1 dependent repositories - 37 downloads last month - 3 stars on GitHub - 1 maintainer
true-encoding 1.0.2
true_encoding is the method of solving the problem of 'ISO-8859-1' about parsing html.3 versions - Latest release: over 6 years ago - 6 dependent repositories - 183 downloads last month - 0 stars on GitHub - 1 maintainer
abu-quant 0.0.1
股票量化1 version - Latest release: about 7 years ago - 1 dependent repositories - 34 downloads last month - 1 maintainer
page-parser 0.0.4
web crawler or spider parse page4 versions - Latest release: about 5 years ago - 1 dependent repositories - 62 downloads last month - 45 stars on GitHub - 1 maintainer
spider-brew-kit 0.1.6
A library for scrapy tools, including but not limited to the usual pipelines, middlewares, etc.6 versions - Latest release: 4 months ago - 42 downloads last month - 0 stars on GitHub - 1 maintainer
spider.py 0.5
FTP and Web spiders and mirroring utilities2 versions - Latest release: 10 months ago - 2 dependent repositories - 1 maintainer
spidy-web-crawler 1.6.5
Spidy is the simple, easy to use command line web crawler.12 versions - Latest release: over 6 years ago - 1 dependent repositories - 327 downloads last month - 323 stars on GitHub - 1 maintainer
waizao 1.1.3
Simple financial data interface library for Python!3 versions - Latest release: 21 days ago - 86 downloads last month - 4 stars on GitHub - 1 maintainer
seleniumlogin 0.0.4
Login some website using selenium.2 versions - Latest release: almost 4 years ago - 1 dependent repositories - 483 downloads last month - 39 stars on GitHub - 1 maintainer
digslash 1.0.0
A site mapping and enumeration tool for Web applications analysis10 versions - Latest release: over 1 year ago - 1 dependent repositories - 4 downloads last month - 1 stars on GitHub - 1 maintainer
simpyder 0.1.12 💰
Distributed multithreading universal crawler30 versions - Latest release: over 3 years ago - 1 dependent repositories - 131 downloads last month - 76 stars on GitHub - 1 maintainer
scrapy-puppeteer-client 0.1.5
A library to use Puppeteer-managed browser in Scrapy spiders11 versions - Latest release: 5 months ago - 1 dependent package - 1 dependent repositories - 205 downloads last month - 48 stars on GitHub - 2 maintainers
aio-scrapy 2.1.0
A high-level Web Crawling and Web Scraping framework based on Asyncio39 versions - Latest release: about 2 months ago - 1 dependent repositories - 304 downloads last month - 51 stars on GitHub - 1 maintainer
lwd-utils 1.0.0
rename-version of PaperCrawlerUtil1 version - Latest release: over 1 year ago - 16 downloads last month - 14 stars on GitHub - 1 maintainer
linear-spider 0.2.1
Linear spider checks website, searching error pages (e.g. http 500) and reports slow loading pages.3 versions - Latest release: over 3 years ago - 1 dependent repositories - 18 downloads last month - 0 stars on GitHub - 1 maintainer
papercrawlerutil 0.1.39
a collection of utils135 versions - Latest release: 4 months ago - 1 dependent repositories - 429 downloads last month - 14 stars on GitHub - 1 maintainer
spiders-for-all 0.3.9
A set of useful and scalable spiders to crawl data/videos from bilibili, xiaohongshu, etc.23 versions - Latest release: 4 months ago - 244 downloads last month - 18 stars on GitHub - 1 maintainer
twitton 1.0.0
A simple Data Scraping library for Twitter API1 version - Latest release: about 6 years ago - 1 dependent repositories - 17 downloads last month - 0 stars on GitHub - 1 maintainer
url2 1.1.0
Crawler series tool set.2 versions - Latest release: over 3 years ago - 1 dependent repositories - 35 downloads last month - 0 stars on GitHub - 1 maintainer
spider-admin-pro 2.0.16
a spider admin based vue, scrapyd api and APScheduler32 versions - Latest release: 21 days ago - 1 dependent repositories - 530 downloads last month - 498 stars on GitHub - 1 maintainer
i-need-an-image 0.3.4
Download only one image from web9 versions - Latest release: over 2 years ago - 1 dependent repositories - 68 downloads last month - 1 stars on GitHub - 1 maintainer
Top 8.4% on pypi.org
5 versions - Latest release: over 4 years ago - 1 dependent repositories - 709 downloads last month - 915 stars on GitHub - 1 maintainer
xsrfprobe 2.3.1
The Prime Cross Site Request Forgery (CSRF) Audit & Exploitation Toolkit5 versions - Latest release: over 4 years ago - 1 dependent repositories - 709 downloads last month - 915 stars on GitHub - 1 maintainer
Top 6.9% on pypi.org
8 versions - Latest release: 10 months ago - 2 dependent packages - 5 dependent repositories - 20.4 thousand downloads last month - 38 stars on GitHub - 1 maintainer
crawlerdetect 0.1.7
CrawlerDetect is a Python class for detecting bots/crawlers/spiders via the user agent.8 versions - Latest release: 10 months ago - 2 dependent packages - 5 dependent repositories - 20.4 thousand downloads last month - 38 stars on GitHub - 1 maintainer
Related Keywords
crawler
110
python
87
scrapy
51
scraper
23
web
19
python3
18
api
18
requests
18
scraping
16
data
15
bilibili
14
asyncio
13
parser
12
downloader
11
distributed
11
pip
10
crawling
10
quant
10
html
9
stock
9
trading
9
finance
8
quantitative
8
investment
8
redis
8
aiohttp
8
scrapyd
8
python2
8
proxy
8
search
7
crawl
7
algotrading
7
futures
7
bond
7
index
7
fund
7
async
6
django
6
download
6
web-scraping
6
air
6
option
6
robot
5
web-crawler
5
framework
5
bilibili-api
5
webscraping
5
dashboard
5
data-science
5
selenium
5
security
5
zhihu
5
helper
4
12306
4
scrapyd-ui
4
scheduler
4
webcrawler
4
admin
4
baidu
4
library
4
webui
4
bot
4
tool
4
cli
4
httpx
4
website
4
twitter
4
tools
3
github
3
weibo
3
ip
3
development
3
proxypool
3
docker
3
bug-bounty
3
user-agent
3
proxies
3
data-analysis
3
爬虫
3
web-spider
3
middleware
3
web-scraper
3
taobao
3
pypi
3
easy
3
pipeline
3
music
3
high-availability
3
fastapi
3
video
3
ipproxy
3
scrapy-log-analysis
3
google
3
pyspider
3
douyin
3
spider-framework
3
client
3
web crawler
3
scrapy-visualization
3
crawling-framework
3