An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "spider" keyword

spiderwebai-py 0.1.4
Python SDK for SpiderWebAI API
10 versions - Latest release: over 2 years ago - 18 downloads last month - 26 stars on GitHub - 1 maintainer
Top 3.6% on pypi.org
ruia 0.8.5
Async Python 3.6+ web scraping micro-framework based on asyncio.
55 versions - Latest release: almost 4 years ago - 2 dependent packages - 21 dependent repositories - 285 downloads last month - 1,745 stars on GitHub - 1 maintainer
cquauth 0.0.3
重庆大学统一认证
1 version - Latest release: about 8 years ago - 1 dependent repositories - 14 downloads last month - 6 stars on GitHub - 1 maintainer
scrapqd 1.0.1b0
Scrape query definition intends to eliminate backend process of crawling and focus on xpath neede...
2 versions - Latest release: over 4 years ago - 1 dependent repositories - 16 downloads last month - 1 maintainer
spider-brew-kit 0.1.6
A library for scrapy tools, including but not limited to the usual pipelines, middlewares, etc.
6 versions - Latest release: over 2 years ago - 25 downloads last month - 0 stars on GitHub - 1 maintainer
akshare-proxy 1.17.88
AKShare is an elegant and simple financial data interface library for Python, built for human bei...
5 versions - Latest release: 9 months ago - 94 downloads last month - 21,742 stars on GitHub - 1 maintainer
aksharepro 1.18.68
AKShare is an elegant and simple financial data interface library for Python, built for human bei...
2 versions - Latest release: 2 months ago - 77 downloads last month - 21,742 stars on GitHub - 1 maintainer
zakshare 1.12.8
AKShare is an elegant and simple financial data interface library for Python, built for human bei...
1 version - Latest release: over 2 years ago - 21,742 stars on GitHub - 1 maintainer
simple-spider-tool 0.0.19
一些简易、好用的爬虫工具,减少代码与文件冗余,提升工作的效率和代码整洁度
7 versions - Latest release: over 3 years ago - 1 dependent repositories - 22 downloads last month - 4 stars on GitHub - 1 maintainer
shopify-spy 0.2.1
Simple CLI to scrape product data, images, and collections from Shopify and WooCommerce stores
4 versions - Latest release: 4 months ago - 170 downloads last month - 1 maintainer
crawlix 0.3.0
One API. Any backend. Full browser automation to lightweight scraping.
6 versions - Latest release: 3 months ago - 35 downloads last month - 1 stars on GitHub - 1 maintainer
digslash 1.0.0
A site mapping and enumeration tool for Web applications analysis
10 versions - Latest release: over 3 years ago - 1 dependent repositories - 11 downloads last month - 1 stars on GitHub - 1 maintainer
oceanmonkey 1.0.0
A High-Level Distributed Web Crawling and Web Scraping framework
1 version - Latest release: over 4 years ago - 1 dependent repositories - 18 downloads last month - 7 stars on GitHub - 1 maintainer
page-parser 0.0.4
web crawler or spider parse page
4 versions - Latest release: over 7 years ago - 1 dependent repositories - 37 downloads last month - 52 stars on GitHub - 1 maintainer
Top 2.8% on pypi.org
pyspider 0.3.10
A Powerful Spider System in Python
17 versions - Latest release: over 8 years ago - 1 dependent package - 98 dependent repositories - 266 downloads last month - 16,793 stars on GitHub - 1 maintainer
scrapy-kit 0.1.12
A library for scrapy tools, including but not limited to the usual pipelines, middlewares, etc.
9 versions - Latest release: almost 3 years ago - 28 downloads last month - 0 stars on GitHub - 1 maintainer
cloudfeaster 0.9.59
Cloudfeaster
51 versions - Latest release: over 4 years ago - 1 dependent repositories - 45 downloads last month - 3 stars on GitHub - 1 maintainer
Top 7.4% on pypi.org
bilili 1.4.15 💰
🍻 bilibili video and danmaku downloader | B站视频、弹幕下载器
67 versions - Latest release: almost 3 years ago - 2 dependent repositories - 326 downloads last month - 1,183 stars on GitHub - 1 maintainer
smartscraper 1.2
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
3 versions - Latest release: almost 5 years ago - 1 dependent repositories - 14 downloads last month - 11 stars on GitHub - 1 maintainer
twitton 1.0.0
A simple Data Scraping library for Twitter API
1 version - Latest release: over 8 years ago - 1 dependent repositories - 10 downloads last month - 0 stars on GitHub - 1 maintainer
waifuboard 2.0.0
Asynchronous API for downloading images, tags, and metadata from image board sites (e.g., Danboor...
33 versions - Latest release: 1 day ago - 194 downloads last month - 2 stars on GitHub - 1 maintainer
gbv 0.1.2
A package to get videos from Bilibili
3 versions - Latest release: about 2 years ago - 22 downloads last month - 0 stars on GitHub - 1 maintainer
gerapy-team 0.1.3
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, D...
1 version - Latest release: about 4 years ago - 33 downloads last month - 3,506 stars on GitHub - 1 maintainer
Top 4.8% on pypi.org
gerapy 0.9.13
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, D...
47 versions - Latest release: about 3 years ago - 34 dependent repositories - 754 downloads last month - 3,506 stars on GitHub - 1 maintainer
mdbq 4.4.6
世界上最庄严的问题:我能做什么好事?
372 versions - Latest release: about 2 months ago - 53 downloads last month - 1 maintainer
leon-mediacrawler 0.1.4
A social media crawler project, support Xiaohongshu, Weibo, Zhihu, Bilibili, Douyin, BaiduTieBa etc.
2 versions - Latest release: about 1 year ago - 30 downloads last month - 0 stars on GitHub - 1 maintainer
scrapit 1.0.3
FastAPI wrapper for Scrapy that lets you to test Scrapy spiders via the API.
6 versions - Latest release: 8 months ago - 29 downloads last month - 0 stars on GitHub - 1 maintainer
cococrawler 0.0.5
A distributed network crawler framework
7 versions - Latest release: over 9 years ago - 838 downloads last month - 1 stars on GitHub - 1 maintainer
amazon-monitor 0.1.4
Amazon 商品监控系统 - 支持多站点商品状态检测和钉钉通知
5 versions - Latest release: 5 months ago - 30 downloads last month - 1 maintainer
douban-movie 0.0.4 💰
Get movie info from Douban (豆瓣) and display in your terminal
4 versions - Latest release: about 6 years ago - 1 dependent repositories - 36 downloads last month - 17 stars on GitHub - 1 maintainer
sickooapi 0.0.1
Test for 魔改
1 version - Latest release: about 5 years ago - 1 dependent repositories - 7 downloads last month - 1,868 stars on GitHub - 1 maintainer
Top 2.7% on pypi.org
icrawler 0.6.10
A multi-thread crawler framework with many builtin image crawlers provided.
45 versions - Latest release: over 1 year ago - 2 dependent packages - 86 dependent repositories - 103 thousand downloads last month - 930 stars on GitHub - 2 maintainers
spidey.py 0.4.5
Web spiders are usually disliked by websites, but useful for recursive API/page downloads for off...
3 versions - Latest release: over 9 years ago - 21 downloads last month - 1 stars on GitHub - 1 maintainer
fast-requests 1.0.0
无与伦比的简单且强大的requests
1 version - Latest release: over 6 years ago - 1 dependent repositories - 24 downloads last month - 1 maintainer
gain 1.0.1
Async web crawling framework for everyone.
7 versions - Latest release: 3 months ago - 4 dependent repositories - 90 downloads last month - 2,019 stars on GitHub - 2 maintainers
allanon 0.2
A Web crawler that visit a predictable set of URLs, and automatically download resources you want...
2 versions - Latest release: over 12 years ago - 16 downloads last month - 7 stars on GitHub - 1 maintainer
spider-mcp-client 0.1.8
Official Python client for Spider MCP web scraping API
9 versions - Latest release: 11 months ago - 19 downloads last month - 1 maintainer
graper 0.1.6
A Spider FrameWork
7 versions - Latest release: over 4 years ago - 1 dependent repositories - 29 downloads last month - 3 stars on GitHub - 1 maintainer
extend-library 1.0.0
Extend library for EMP.
1 version - Latest release: almost 9 years ago - 1 dependent repositories - 12 downloads last month - 5 stars on GitHub - 1 maintainer
acmtrans 0.3
This is a net spider program by Python to collect a list of ACM transaction papers.
2 versions - Latest release: over 6 years ago - 24 downloads last month - 0 stars on GitHub - 1 maintainer
animecrawler 0.2.1
一个可免费下载动漫的爬虫
6 versions - Latest release: about 3 years ago - 35 downloads last month - 1 stars on GitHub - 1 maintainer
pyfreeproxy 0.5.1 💰
FreeProxy: Collecting free proxies from internet.
31 versions - Latest release: 8 days ago - 2 dependent repositories - 5.36 thousand downloads last month - 505 stars on GitHub - 1 maintainer
trace-scraper 1.0.0
High-performance async web scraper with Playwright and httpx. Scrape JavaScript-rendered pages, c...
1 version - Latest release: 8 months ago - 42 downloads last month - 1 maintainer
crawlberg 1.1.4
High-performance web crawling engine
20 versions - Latest release: 5 days ago - 3.16 thousand downloads last month - 152 stars on GitHub - 1 maintainer
douyin-tiktok-scraper250605 0.0.4 💰
A fast and asynchronous Douyin/TikTok data scraper and API
4 versions - Latest release: about 1 year ago - 31 downloads last month - 19,215 stars on GitHub - 1 maintainer
dt-scraper 2.0.2 💰
Douyin/TikTok crawler and no watermark video download.
7 versions - Latest release: over 3 years ago - 102 downloads last month - 19,215 stars on GitHub - 1 maintainer
Top 9.9% on pypi.org
douyin-tiktok-scraper 1.2.9 💰
Douyin/TikTok async data scraper.
21 versions - Latest release: almost 3 years ago - 3.24 thousand downloads last month - 19,215 stars on GitHub - 1 maintainer
browser-useragent 0.0.1
get a browser user_agent by random
1 version - Latest release: almost 8 years ago - 1 dependent repositories - 33 downloads last month - 5 stars on GitHub - 1 maintainer
bi-get 0.1.1
关于B站的一个爬虫,可以获取视频的信息,下载视频等
1 version - Latest release: over 6 years ago - 10 downloads last month - 1 stars on GitHub - 1 maintainer
biu 0.3.0
tiny web crawler
13 versions - Latest release: almost 2 years ago - 1 dependent repositories - 89 downloads last month - 6 stars on GitHub - 1 maintainer
show-time 0.0.5
A tool based on network spider technology to crawl information for numerous shows such as dramas ...
6 versions - Latest release: over 6 years ago - 1 dependent repositories - 60 downloads last month - 3 stars on GitHub - 1 maintainer
Top 8.1% on pypi.org
dumpall 0.3.2
一款信息泄漏利用工具,适用于.git/.svn/.DS_Store泄漏和目录列出漏洞利用
7 versions - Latest release: over 4 years ago - 2 dependent repositories - 276 downloads last month - 1,380 stars on GitHub - 1 maintainer
fzutils 0.4.1.3
A Python utils for spider
240 versions - Latest release: over 6 years ago - 1 dependent repositories - 938 downloads last month - 11 stars on GitHub - 1 maintainer
spiders-for-all 0.3.9
A set of useful and scalable spiders to crawl data/videos from bilibili, xiaohongshu, etc.
23 versions - Latest release: over 2 years ago - 90 downloads last month - 32 stars on GitHub - 1 maintainer
xhs-post-capture-sdk 1.0.0
小红书数据采集 & 运营 SDK - 支持笔记采集、用户画像、创作者中心、蒲公英、千帆平台
1 version - Latest release: 2 months ago - 9 downloads last month - 7,186 stars on GitHub - 1 maintainer
pyspider3 0.0.2
由于pyspider模块年久失修,pyspider3基于原作者github源码制作而成
1 version - Latest release: almost 5 years ago - 1 dependent repositories - 18 downloads last month - 16,793 stars on GitHub - 1 maintainer
scrapyd_ui 0.9.9
Full-featured web UI for Scrapyd cluster management, Scrapy log analysis & visualization
1 version - Latest release: almost 8 years ago - 19 downloads last month - 3,334 stars on GitHub - 1 maintainer
tenon 0.1.7
A package to solve captcha
17 versions - Latest release: over 2 years ago - 82 downloads last month - 174 stars on GitHub - 1 maintainer
Top 8.4% on pypi.org
xsrfprobe 3.0.0
The Prime Cross Site Request Forgery (CSRF) Audit & Exploitation Toolkit
6 versions - Latest release: 30 days ago - 1 dependent repositories - 680 downloads last month - 1,301 stars on GitHub - 1 maintainer
fusion-crawler 0.1.0
FusionCrawler - 统一的 AI 驱动全栈爬虫平台
1 version - Latest release: 3 months ago - 21 downloads last month - 1 maintainer
Top 3.1% on pypi.org
bilibili-api-python 17.4.2
The fork of module bilibili-api. 哔哩哔哩的各种 API 调用便捷整合(视频、动态、直播等),另外附加一些常用的功能。
105 versions - Latest release: about 2 months ago - 9 dependent packages - 7 dependent repositories - 85.2 thousand downloads last month - 4,193 stars on GitHub - 1 maintainer
bilibili-api-dev 0.0.8
The fork of module bilibili-api. 哔哩哔哩的各种 API 调用便捷整合(视频、动态、直播等),另外附加一些常用的功能。
11 versions - Latest release: almost 3 years ago - 1.79 thousand downloads last month - 4,193 stars on GitHub - 1 maintainer
tongliao 0.0.1
通辽转换器!
1 version - Latest release: almost 4 years ago - 8 downloads last month - 4,193 stars on GitHub - 1 maintainer
get-user-headers 0.1.2
Helper for retrieving identifying headers from the user'sdefault browser
2 versions - Latest release: over 9 years ago - 1 dependent repositories - 36 downloads last month - 1 stars on GitHub - 1 maintainer
spoonproxy 0.3.2
A package for building specific Proxy Pool for different Sites.
23 versions - Latest release: about 8 years ago - 1 dependent repositories - 78 downloads last month - 173 stars on GitHub - 1 maintainer
byteapp-akt 0.0.87
AKTools is a tool for AKShare HTTP API!
2 versions - Latest release: almost 2 years ago - 27 downloads last month - 1 maintainer
pyder 0.0.1
A static website generator written in Python!
1 version - Latest release: about 10 years ago - 2 dependent repositories - 30 downloads last month - 2 stars on GitHub - 1 maintainer
istockphoto 0.1.2
Gracefully download dataset from istockphoto
6 versions - Latest release: almost 3 years ago - 1 dependent package - 3 dependent repositories - 180 downloads last month - 13 stars on GitHub - 1 maintainer
zsq_test 0.1.0
test
1 version - Latest release: over 8 years ago - 21 downloads last month - 5 stars on GitHub - 1 maintainer
graph-crawler 4.1.48
Sync-First бібліотека для побудови графу веб-сайтів - просто як requests!
110 versions - Latest release: 10 days ago - 1.85 thousand downloads last month - 1 maintainer
Top 7.4% on pypi.org
aktools 0.0.91
AKTools is a tool for AKShare HTTP API!
86 versions - Latest release: 10 months ago - 1 dependent package - 1 dependent repositories - 2.75 thousand downloads last month - 1,452 stars on GitHub - 1 maintainer
Top 7.2% on pypi.org
zhihu-py3 0.3.23
Zhihu UNOFFICIAL API library in python3, with help of bs4, lxml, requests and html2text.
40 versions - Latest release: almost 10 years ago - 4 dependent repositories - 244 downloads last month - 1,035 stars on GitHub - 1 maintainer
scrapy-util 1.0.3
scrapy util
12 versions - Latest release: over 2 years ago - 1 dependent repositories - 41 downloads last month - 6 stars on GitHub - 1 maintainer
gooder 0.3.2
Simple Google parser
6 versions - Latest release: over 4 years ago - 1 dependent repositories - 21 downloads last month - 4 stars on GitHub - 1 maintainer
movie-searcher 0.1.1
Search movies for You
1 version - Latest release: over 8 years ago - 2 dependent repositories - 39 downloads last month - 2 stars on GitHub - 1 maintainer
kkba 0.8.16
A Library to Convert Curl to Python Requests File
3 versions - Latest release: over 4 years ago - 1 dependent repositories - 27 downloads last month - 8 stars on GitHub - 1 maintainer
wechatarticles 0.7.0
wechat articles scrapy
25 versions - Latest release: over 4 years ago - 1 dependent repositories - 605 downloads last month - 3,255 stars on GitHub - 1 maintainer
ze-the-scraper 0.0.17.dev1
Scaper to lager portal of news in Brazil.
2 versions - Latest release: over 9 years ago - 1 dependent repositories - 5 downloads last month - 5 stars on GitHub - 1 maintainer
spidy-web-crawler 1.6.5
Spidy is the simple, easy to use command line web crawler.
12 versions - Latest release: over 8 years ago - 1 dependent repositories - 334 downloads last month - 352 stars on GitHub - 1 maintainer
Top 8.8% on pypi.org
decryptlogin 0.3.9 💰
DecryptLogin: APIs for loginning some websites by using requests.
46 versions - Latest release: almost 4 years ago - 1 dependent repositories - 3.08 thousand downloads last month - 2,868 stars on GitHub - 1 maintainer
nsfc-spider 0.1.6
国自然大数据平台智能爬虫 - AI驱动的基金项目数据采集工具
7 versions - Latest release: 6 months ago - 68 downloads last month - 1 maintainer
spiderwei-manager 1.0.0
Python爬虫脚本管理器 - Web界面 + 命令行
1 version - Latest release: about 2 months ago - 26 downloads last month - 1 maintainer
airspider 2.0.4
An Easy-to-use and Fast Python Spider Framework
6 versions - Latest release: almost 6 years ago - 116 downloads last month - 8 stars on GitHub - 1 maintainer
fintie 0.1.3
a common data obtain tool
4 versions - Latest release: over 7 years ago - 1 dependent repositories - 21 downloads last month - 5 stars on GitHub - 1 maintainer
comicguispider 2.11.1 💰
GUI Comic Downloader
49 versions - Latest release: 25 days ago - 984 downloads last month - 612 stars on GitHub - 1 maintainer
requests5 1.0.0
无与伦比的简单且强大的requests
1 version - Latest release: over 6 years ago - 2 dependent repositories - 297 downloads last month - 1 maintainer
Top 6.9% on pypi.org
crawlerdetect 0.4.2
CrawlerDetect is a Python library designed to identify bots, crawlers, and spiders by analyzing t...
20 versions - Latest release: 12 days ago - 2 dependent packages - 5 dependent repositories - 157 thousand downloads last month - 41 stars on GitHub - 1 maintainer
spider-rs 0.0.56
The fastest web crawler and indexer.
53 versions - Latest release: over 1 year ago - 2.33 thousand downloads last month - 87 stars on GitHub - 1 maintainer
easy-spider-tool-document 1.0.13
easy-spider-tool 可选xpath/jsonpath聚合解析扩展包
5 versions - Latest release: almost 3 years ago - 1 dependent package - 74 downloads last month - 1 stars on GitHub - 1 maintainer
scrapy-distributed 2023.4.23
A series distributed components for Scrapy framework
6 versions - Latest release: over 3 years ago - 1 dependent repositories - 17 downloads last month - 53 stars on GitHub - 1 maintainer
autospider 1.1.11
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
2 versions - Latest release: over 2 years ago - 24 downloads last month - 0 stars on GitHub - 1 maintainer
scrapy-qiniu 0.1.2
Scrapy pipeline extension for qiniu.com
3 versions - Latest release: over 10 years ago - 3 dependent repositories - 45 downloads last month - 24 stars on GitHub - 1 maintainer
rankcomp 0.0.2
high fided extraction of differential expression genes without considering the batch effects
1 version - Latest release: over 6 years ago - 1 dependent repositories - 6 downloads last month - 5,576 stars on GitHub - 1 maintainer
acrawler 0.1.6
A simple web-crawling framework, based on aiohttp.
16 versions - Latest release: over 6 years ago - 2 dependent repositories - 200 downloads last month - 15 stars on GitHub - 1 maintainer
yz-test 0.0
It is a html parser.Given a html document,It can get the content from the document. 给定一个网页提取网页中的正...
1 version - Latest release: about 5 years ago - 1 dependent repositories - 2 downloads last month - 5 stars on GitHub - 1 maintainer
scrava 0.1.1
The Definitive Web Scraping Framework for Python
2 versions - Latest release: 10 months ago - 18 downloads last month - 0 stars on GitHub - 1 maintainer
yhb 0.1.12
A package for quick using utils
12 versions - Latest release: over 6 years ago - 74 downloads last month - 177 stars on GitHub - 1 maintainer
curl-reap 0.2.2
Reap the web: browser-grade TLS impersonation, self-healing selectors, structured extraction, and...
6 versions - Latest release: 26 days ago - 0 stars on GitHub - 1 maintainer
xhs-spider 1.1.0
Little Red Book notes, home page, detailed page crawler
11 versions - Latest release: almost 3 years ago - 68 downloads last month - 761 stars on GitHub - 1 maintainer
py3spider 1.0.7
仿Scrapy实现,基于py3.4+的多线程异步网络爬虫,实例请访问https://github.com/ChenL1994/py3spider/tree/master/examples
6 versions - Latest release: almost 9 years ago - 1 dependent repositories - 5 downloads last month - 1 maintainer