An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "scraping" keyword

proxyproviders 0.2.2 💰
A unified interface for different proxy providers
5 versions - Latest release: 6 months ago - 98 thousand downloads last month - 9 stars on GitHub - 1 maintainer
Top 9.8% on pypi.org
fastbots 0.2.7
A simple library designed for rapid bot and scraper development using Selenium and the POM (Page ...
18 versions - Latest release: over 2 years ago - 2 dependent repositories - 590 downloads last month - 6 stars on GitHub - 1 maintainer
Top 1.0% on pypi.org
cfscrape 2.1.1
A simple Python module to bypass Cloudflare's anti-bot page. See https://github.com/Anorov/cloudf...
35 versions - Latest release: over 6 years ago - 19 dependent packages - 1,675 dependent repositories - 31.9 thousand downloads last month - 3,304 stars on GitHub - 1 maintainer
cloakbrowser 0.5.10 💰
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source...
73 versions - Latest release: 13 days ago - 1.18 million downloads last month - 30,925 stars on GitHub - 1 maintainer
crawlee 1.10.0
Crawlee for Python
816 versions - Latest release: 12 days ago - 969 thousand downloads last month - 9,472 stars on GitHub - 1 maintainer
Top 0.4% on pypi.org
scrapy 2.19.0
A high-level Web Crawling and Web Scraping framework
115 versions - Latest release: 2 days ago - 136 dependent packages - 2,753 dependent repositories - 4.47 million downloads last month - 52,897 stars on GitHub - 4 maintainers
soccer-sdk-utils 0.1.14
A python module housing Soccer SDK utilities
16 versions - Latest release: over 3 years ago - 1 dependent package - 2 dependent repositories - 52 downloads last month - 0 stars on GitHub - 1 maintainer
bf-scrapy-base 0.0.6
基于scrapy的二次开发
6 versions - Latest release: about 1 year ago - 14 downloads last month - 64,203 stars on GitHub - 1 maintainer
tjsp 0.0.7
Série Temporal das Taxas do Tribunal de Justiça do Estado de São Paulo e métodos para recuperar i...
7 versions - Latest release: almost 4 years ago - 80 downloads last month - 5 stars on GitHub - 1 maintainer
robox 0.2.3
Robox is a simple library for exploring/scraping the web or testing a website you’re developing.
5 versions - Latest release: over 4 years ago - 1 dependent repositories - 101 downloads last month - 127 stars on GitHub - 1 maintainer
clearcote-mcp 0.1.0
MCP server for Clearcote — drive the open-source stealth Chromium from Claude Desktop, Cursor, Cl...
1 version - Latest release: 2 months ago - 29 downloads last month - 142 stars on GitHub - 1 maintainer
restraint 0.1.0
Composable rate limiting, quota protection, and polite-client restraints
3 versions - Latest release: 19 days ago - 2 dependent repositories - 131 downloads last month - 0 stars on GitHub - 1 maintainer
anyapi-haystack 0.2.0
Haystack components and tools for AnyAPI: one key, hundreds of data and scraping APIs, billed per...
2 versions - Latest release: 7 days ago - 211 downloads last month - 0 stars on GitHub - 1 maintainer
Top 0.8% on pypi.org
undetected-chromedriver 3.5.5
('Selenium.webdriver.Chrome replacement with compatiblity for Brave, and other Chromium based bro...
54 versions - Latest release: over 2 years ago - 104 dependent packages - 908 dependent repositories - 2.05 million downloads last month - 12,822 stars on GitHub - 1 maintainer
undetected-chromedriver2 3.5.1
('Selenium.webdriver.Chrome replacement with compatiblity for Brave, and other Chromium based bro...
2 versions - Latest release: about 3 years ago - 40 downloads last month - 12,822 stars on GitHub - 1 maintainer
udc-gyt 3.5.5
('Selenium.webdriver.Chrome replacement with compatiblity for Brave, and other Chromium based bro...
1 version - Latest release: almost 2 years ago - 12 downloads last month - 11,758 stars on GitHub - 1 maintainer
httpsmovements
Stop live in Ukraine
1 version - 12,668 stars on GitHub - 1 maintainer
rd-undetected-chromedriver 3.5.6
Selenium.webdriver.Chrome replacement with compatiblity for Brave, and other Chromium based brows...
2 versions - Latest release: almost 3 years ago - 9 downloads last month - 12,805 stars on GitHub - 1 maintainer
new-undetected-chromedriver 3.5.5
('Selenium.webdriver.Chrome replacement with compatiblity for Brave, and other Chromium based bro...
1 version - Latest release: over 2 years ago - 15 downloads last month - 12,822 stars on GitHub - 1 maintainer
qddate 1.0.10
Quick and dirty date parsing Python library to parse HTML dates really fast
7 versions - Latest release: 2 months ago - 4 dependent repositories - 2.1 thousand downloads last month - 22 stars on GitHub - 1 maintainer
webskrap 2.1.1
A Playwright-based Python scraping framework with coherent browser profiles and session controls.
42 versions - Latest release: 1 day ago - 1 maintainer
cloudscraper-enhanced 3.0.0 💰
Enhanced Python module to bypass Cloudflare's anti-bot page with support for v2 challenges, proxy...
1 version - Latest release: 11 months ago - 2.28 thousand downloads last month - 6,718 stars on GitHub - 1 maintainer
Top 0.9% on pypi.org
cloudscraper 1.2.71 💰
A Python module to bypass Cloudflare's anti-bot page.
78 versions - Latest release: over 3 years ago - 98 dependent packages - 3,120 dependent repositories - 4.35 million downloads last month - 6,718 stars on GitHub - 1 maintainer
cloudscrapersafe 3.0.0 💰
Enhanced Python module to bypass Cloudflare's anti-bot page with support for v2 challenges, proxy...
1 version - Latest release: about 1 year ago - 6,718 stars on GitHub
Top 0.7% on pypi.org
fake-useragent 2.2.0 💰
Up-to-date simple useragent faker with real world database
40 versions - Latest release: over 1 year ago - 211 dependent packages - 3,517 dependent repositories - 8.53 million downloads last month - 4,050 stars on GitHub - 2 maintainers
fake-usragent 💰
Up-to-date simple useragent faker with real world database
13 versions - 382 downloads last month - 4,050 stars on GitHub - 1 maintainer
liteium 1.0.6
Add Documentation
6 versions - Latest release: over 2 years ago - 12 downloads last month - 3 stars on GitHub - 1 maintainer
Top 2.1% on pypi.org
requests-html 0.10.0
HTML Parsing for Humans.
36 versions - Latest release: over 7 years ago - 96 dependent packages - 2,389 dependent repositories - 420 thousand downloads last month - 326 stars on GitHub - 3 maintainers
reposcraping 1.1.7
Scraping GitHub repository
20 versions - Latest release: over 3 years ago - 76 downloads last month - 5 stars on GitHub - 1 maintainer
viu-media 3.5.0 💰
A browser anime site experience from the terminal
11 versions - Latest release: 4 months ago - 513 downloads last month - 951 stars on GitHub - 1 maintainer
Top 1.8% on pypi.org
clean-text 0.7.1
Functions to preprocess and normalize text.
9 versions - Latest release: 8 months ago - 15 dependent packages - 97 dependent repositories - 267 thousand downloads last month - 1,027 stars on GitHub - 1 maintainer
clienthello-probe 0.1.0
See what your HTTP client actually sends: TLS ClientHello, extension order, JA3, and header order.
1 version - Latest release: 6 days ago - 95 downloads last month - 1 maintainer
shardx 2.0.1
Self-contained Python SDK for the ShardX anti-detect browser — downloads the engine + Widevine + ...
14 versions - Latest release: 11 days ago - 820 downloads last month - 717 stars on GitHub - 1 maintainer
bytecrawl 1.2.0
Focused crawling for LLM data collection: Shark-Search and OPIC crawlers plus a single scraping A...
2 versions - Latest release: 3 days ago - 12 stars on GitHub - 1 maintainer
cfts-solver 0.0.0 💰
Cloudflare Turnstile Solver
1 version - Latest release: 12 days ago - 0 stars on GitHub - 1 maintainer
Top 1.9% on pypi.org
google-search-results 2.4.2
Scrape and search localized results from Google, Bing, Baidu, Yahoo, Yandex, Ebay, Homedepot, you...
41 versions - Latest release: over 3 years ago - 113 dependent packages - 2,025 dependent repositories - 1.6 million downloads last month - 755 stars on GitHub - 3 maintainers
scrapy-hls 0.1
scrapy integration for m3u8 files
1 version - Latest release: over 5 years ago - 1 dependent repositories - 11 downloads last month - 64,203 stars on GitHub - 1 maintainer
Top 9.5% on pypi.org
pylab-utils 0.5
python utility tools
2 versions - Latest release: about 5 years ago - 1 dependent repositories - 13 downloads last month - 64,203 stars on GitHub - 1 maintainer
iflow-mcp_scrapegraph-mcp 1.0.0 💰
MCP server for ScapeGraph API integration
1 version - Latest release: 10 months ago - 8 downloads last month - 108 stars on GitHub - 1 maintainer
scrapegraph-mcp 1.0.1 💰
MCP server for ScapeGraph API integration
2 versions - Latest release: 10 months ago - 841 downloads last month - 108 stars on GitHub - 1 maintainer
clearcote 0.28.0
Playwright drop-in for the Clearcote anti-fingerprint Chromium build. launch() returns a standard...
52 versions - Latest release: 6 days ago - 4.4 thousand downloads last month - 142 stars on GitHub - 1 maintainer
Top 1.7% on pypi.org
trafilatura 2.2.0 💰
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction...
52 versions - Latest release: about 1 month ago - 71 dependent packages - 63 dependent repositories - 12.8 million downloads last month - 6,799 stars on GitHub - 1 maintainer
scraperai 0.0.2
ScraperAI is an open-source, AI-powered tool designed to simplify web scraping for users of all s...
2 versions - Latest release: over 2 years ago - 112 downloads last month - 477 stars on GitHub - 1 maintainer
rebrowser-playwright 1.52.0
A high-level API to automate web browsers
6 versions - Latest release: over 1 year ago - 90.8 thousand downloads last month - 102 stars on GitHub - 1 maintainer
scrapy-qfm 2.11.2
A high-level Web Crawling and Web Scraping framework
2 versions - Latest release: almost 2 years ago - 17 downloads last month - 64,203 stars on GitHub - 1 maintainer
aminer-scrapy 2.11.1
A high-level Web Crawling and Web Scraping framework
6 versions - Latest release: over 2 years ago - 46 downloads last month - 64,082 stars on GitHub - 1 maintainer
Top 6.0% on pypi.org
scrapeasy-jkhjasdsad 0.12
Scraping in python made easy - receive the content you like in just one line of code!
1 version - Latest release: almost 4 years ago - 105 stars on GitHub
flarebreak 0.2.1
Python wrapper for cloudflare-solver — bypass Turnstile & IUAM with ease
3 versions - Latest release: 7 days ago - 14 stars on GitHub - 1 maintainer
firecrawl-py 4.42.0
Python SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature s...
196 versions - Latest release: 4 days ago - 1 dependent package - 6.28 million downloads last month - 178,802 stars on GitHub - 1 maintainer
asyncio_hn 0.4.0
Simple asyncio wrapper to download hackernews
9 versions - Latest release: over 9 years ago - 15 downloads last month - 28 stars on GitHub - 1 maintainer
Top 5.2% on pypi.org
online-judge-api-client 10.10.1
API client to develop tools for competitive programming
32 versions - Latest release: about 4 years ago - 2 dependent packages - 22 dependent repositories - 10.4 thousand downloads last month - 82 stars on GitHub - 1 maintainer
Top 1.0% on pypi.org
pyquery 2.1.0
A jquery-like library for python
39 versions - Latest release: about 2 months ago - 123 dependent packages - 4,771 dependent repositories - 2.36 million downloads last month - 2,377 stars on GitHub - 2 maintainers
baskref 1.0.0
baskRef is a tool to scrape basketball Data from the web.
10 versions - Latest release: almost 2 years ago - 47 downloads last month - 2 stars on GitHub - 1 maintainer
anti-bot-detector 0.1.0
Framework-agnostic anti-bot detection for web crawlers: HTTP header fingerprints, JS challenge id...
1 version - Latest release: 2 days ago - 1 maintainer
scrapling 0.4.15 💰
Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web ...
53 versions - Latest release: 20 days ago - 959 thousand downloads last month - 79,692 stars on GitHub - 1 maintainer
topdrawersoccer-sdk 0.1.1
A python module for scraping TopDrawerSoccer.
2 versions - Latest release: over 3 years ago - 1 dependent repositories - 39 downloads last month - 0 stars on GitHub - 1 maintainer
water-law-dataset 0.2.1
Scrapers and jurimetric coding engine for 83,596 comparative water law judicial decisions across ...
3 versions - Latest release: 4 months ago - 20 downloads last month - 1 maintainer
Top 1.3% on pypi.org
parsel 1.11.0
Parsel is a library to extract data from HTML and XML using XPath and CSS selectors
26 versions - Latest release: 8 months ago - 85 dependent packages - 6,330 dependent repositories - 4.42 million downloads last month - 1,353 stars on GitHub - 3 maintainers
scrapling-zhng 0.2.99 💰
Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web ...
1 version - Latest release: about 1 year ago - 11 downloads last month - 79,692 stars on GitHub - 1 maintainer
getanyapi 0.40.0
Official typed Python SDK for AnyAPI: any API, one wallet, USD, no subscriptions.
76 versions - Latest release: 1 day ago - 5.13 thousand downloads last month - 0 stars on GitHub - 1 maintainer
crawlerflow 0.2.0
Declarative YAML workflow engine for browser automation and web scraping
2 versions - Latest release: 25 days ago - 185 downloads last month - 0 stars on GitHub - 1 maintainer
idt 0.0.6
A cli tool that quickly generates ready-to-use image datasets
3 versions - Latest release: almost 6 years ago - 1 dependent repositories - 27 downloads last month - 231 stars on GitHub - 1 maintainer
Top 7.3% on pypi.org
memorious 2.6.5
A minimalistic, recursive web crawling library for Python.
108 versions - Latest release: over 2 years ago - 4 dependent repositories - 222 downloads last month - 316 stars on GitHub - 3 maintainers
Top 6.0% on pypi.org
scrapeasy-juhsdgfjs 0.12
Scraping in python made easy - receive the content you like in just one line of code!
1 version - Latest release: almost 4 years ago - 105 stars on GitHub - 1 maintainer
scrap11888 4.5
A simple data scraping utility, used to extract data from 11888.gr
2 versions - Latest release: almost 5 years ago - 1 dependent repositories - 14 downloads last month - 2 stars on GitHub - 1 maintainer
selenium-remote 0.1.5
A package for handling and using a selenium grid server.
5 versions - Latest release: about 3 years ago - 62 downloads last month - 0 stars on GitHub - 1 maintainer
scraperfc 4.5.0
Package for scraping soccer data from a variety of sources.
104 versions - Latest release: 5 months ago - 1 dependent repositories - 4.49 thousand downloads last month - 409 stars on GitHub - 1 maintainer
edu-md 0.1.1
Python toolkit for parsing and downloading CTICE and ANCE educational materials from Moldova.
2 versions - Latest release: 10 days ago - 0 stars on GitHub - 1 maintainer
botasaurus 4.0.97 💰
The All in One Web Scraping Framework
118 versions - Latest release: 8 months ago - 1 dependent package - 1 dependent repositories - 23.7 thousand downloads last month - 5,705 stars on GitHub - 1 maintainer
transistor 0.2.4
A web scraping framework for intelligent use cases.
7 versions - Latest release: about 6 years ago - 1 dependent repositories - 26 downloads last month - 210 stars on GitHub - 1 maintainer
scratchtrend 0.2.1
ScratchTrend: Get Popular Projects from scratch
3 versions - Latest release: almost 4 years ago - 27 downloads last month - 0 stars on GitHub - 1 maintainer
katatachi 1.1.2
A Python framework to build web scraping applications.
12 versions - Latest release: over 3 years ago - 46 downloads last month - 7 stars on GitHub - 1 maintainer
easyscrapper 1.0.2
easyscrapper is a fast, lightweight Python package and CLI tool that lets developers, data scient...
3 versions - Latest release: about 1 year ago - 147 downloads last month - 2 stars on GitHub - 1 maintainer
scrapontology 💰
Library for extracting schemas and building ontologies from documents using LLM
4 versions - 222 downloads last month - 12,938 stars on GitHub - 1 maintainer
Top 3.4% on pypi.org
pykrx 1.2.8 💰
KRX data scraping
114 versions - Latest release: 4 months ago - 1 dependent package - 26 dependent repositories - 402 thousand downloads last month - 1,081 stars on GitHub - 1 maintainer
iflow-mcp_d4vinci-scrapling 0.3.14 💰
Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web ...
1 version - Latest release: 7 months ago - 13 downloads last month - 79,692 stars on GitHub - 1 maintainer
turbohtml 1.8.0 💰
A fast, fully typed HTML toolkit for Python, powered by a C-accelerated core.
18 versions - Latest release: 4 days ago - 6 downloads last month - 20 stars on GitHub - 1 maintainer
happyendpoint 0.0.1
Structured data from platforms that matter — official Happy Endpoint package (placeholder, more c...
1 version - Latest release: 2 months ago - 1 maintainer
browserforge 1.2.4 💰
Intelligent browser header & fingerprint generator
8 versions - Latest release: 7 months ago - 2 dependent packages - 2.13 million downloads last month - 1,239 stars on GitHub - 1 maintainer
hrequests 0.9.2 💰
Hrequests (human requests) is a simple, configurable, feature-rich, replacement for the Python re...
22 versions - Latest release: almost 2 years ago - 1 dependent repositories - 27.7 thousand downloads last month - 1,022 stars on GitHub - 1 maintainer
primr 1.39.14
Turn any company or organization URL into a strategic intelligence brief. Adaptive scraping + AI-...
104 versions - Latest release: 3 days ago - 1.17 thousand downloads last month - 3 stars on GitHub - 1 maintainer
mepcheck 0.2.0
Retrieve voting data for all MEPs and return them in a structured way
3 versions - Latest release: over 7 years ago - 1 dependent repositories - 42 downloads last month - 7 stars on GitHub - 1 maintainer
serpcheap 0.2.2
Official Python client for the serp.cheap Google SERP API.
3 versions - Latest release: 3 months ago - 1 maintainer
cloverlabs-camoufox 0.6.0
Wrapper around Playwright to help launch Camoufox
7 versions - Latest release: 4 months ago - 37.3 thousand downloads last month - 234 stars on GitHub - 1 maintainer
safe-web-access 0.1.2
Safe, budget-aware web access for crawlers, AI agents, backend services, and ingestion pipelines.
3 versions - Latest release: about 1 month ago - 1 stars on GitHub - 1 maintainer
pithytools 0.0.1
Pithytools is a collection of command line utilities.
1 version - Latest release: over 6 years ago - 1 dependent repositories - 8 downloads last month - 6 stars on GitHub - 1 maintainer
pydude-pyto 0.22.0 💰
dude uncomplicated data extraction (For Pyto on iOS)
13 versions - Latest release: about 4 years ago - 1 dependent repositories - 17 downloads last month - 1 stars on GitHub - 1 maintainer
mineru-html 1.1.2
MinerU-HTML is a main content extraction tool based on Small Language Models.
4 versions - Latest release: 6 months ago - 278 downloads last month - 284 stars on GitHub - 1 maintainer
contaix 0.0.19
Tools to make contexts for AI
18 versions - Latest release: 3 months ago - 608 downloads last month - 0 stars on GitHub - 1 maintainer
openjobs 0.1.0
AI-powered job scraper - extract job listings from any careers page using Firecrawl + Gemini AI. ...
1 version - Latest release: 8 months ago - 38 downloads last month - 0 stars on GitHub - 1 maintainer
httpcloak 1.7.2
Browser fingerprint emulation HTTP client with HTTP/1.1, HTTP/2, and HTTP/3 support
53 versions - Latest release: 10 days ago - 52.5 thousand downloads last month - 1,207 stars on GitHub - 1 maintainer
fast-scrape 0.2.12
High-performance HTML parsing library for Python
20 versions - Latest release: 10 days ago - 3.75 thousand downloads last month - 10 stars on GitHub - 1 maintainer
doctoralia-scrapper 2.5.3 💰
Sistema profissional de monitoramento e resposta a avaliações médicas. Inclui web scraping resili...
16 versions - Latest release: 12 days ago - 336 downloads last month - 1 stars on GitHub - 1 maintainer
mseep-scrapegraph-mcp 1.0.4 💰
MCP server for ScapeGraph API integration
5 versions - Latest release: about 1 year ago - 17 downloads last month - 101 stars on GitHub - 1 maintainer
scrapegraph-py 2.3.1 💰
Official Python SDK for ScrapeGraph AI API
83 versions - Latest release: about 1 month ago - 210 thousand downloads last month - 84 stars on GitHub - 1 maintainer
langchain-scrapegraph 1.6.0 💰
Library for extracting structured data from websites using ScrapeGraphAI
13 versions - Latest release: about 1 year ago - 3.2 thousand downloads last month - 17 stars on GitHub - 1 maintainer
Top 4.2% on pypi.org
socid-extractor 0.1.1 💰
Extract accounts' identifiers and metadata from personal pages on various platforms.
29 versions - Latest release: 2 months ago - 25 dependent repositories - 86 thousand downloads last month - 1,077 stars on GitHub - 1 maintainer
bot-safe-agents 1.2 💰
A library for fetching a list of bot-safe user agents.
3 versions - Latest release: 6 months ago - 427 downloads last month - 5 stars on GitHub - 1 maintainer
firecrawl 4.42.0
Python SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature s...
173 versions - Latest release: 4 days ago - 1.04 million downloads last month - 174,840 stars on GitHub - 1 maintainer
google-images-hunter 1.0.1
Selenium-based web scraper to perform massive image downloads from Google Images search engine.
2 versions - Latest release: about 4 years ago - 114 downloads last month - 0 stars on GitHub - 1 maintainer