Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "web-scraping" keyword
aminer-scrapy 2.11.1
A high-level Web Crawling and Web Scraping framework3 versions - Latest release: 4 months ago - 59 downloads last month - 51,278 stars on GitHub - 1 maintainer
Top 9.5% on pypi.org
2 versions - Latest release: over 2 years ago - 1 dependent repositories - 162 downloads last month - 51,278 stars on GitHub - 1 maintainer
pylab-utils 0.5
python utility tools2 versions - Latest release: over 2 years ago - 1 dependent repositories - 162 downloads last month - 51,278 stars on GitHub - 1 maintainer
scrapy-hls 0.1
scrapy integration for m3u8 files1 version - Latest release: about 3 years ago - 1 dependent repositories - 15 downloads last month - 51,278 stars on GitHub - 1 maintainer
cyberplant-scrapy 1.2.0.dev2
A high-level Web Crawling and Web Scraping framework1 version - Latest release: almost 8 years ago - 1 dependent repositories - 23 downloads last month - 51,278 stars on GitHub - 1 maintainer
Top 0.4% on pypi.org
99 versions - Latest release: 19 days ago - 136 dependent packages - 2,753 dependent repositories - 1.59 million downloads last month - 51,278 stars on GitHub - 4 maintainers
scrapy 2.11.2
A high-level Web Crawling and Web Scraping framework99 versions - Latest release: 19 days ago - 136 dependent packages - 2,753 dependent repositories - 1.59 million downloads last month - 51,278 stars on GitHub - 4 maintainers
extractnet 2.0.7
Extract the main article content (and optionally comments) from a web page9 versions - Latest release: over 1 year ago - 1 dependent repositories - 378 downloads last month - 181 stars on GitHub - 1 maintainer
Top 9.9% on pypi.org
21 versions - Latest release: 8 months ago - 1.09 thousand downloads last month - 7,347 stars on GitHub - 1 maintainer
douyin-tiktok-scraper 1.2.9
Douyin/TikTok async data scraper.21 versions - Latest release: 8 months ago - 1.09 thousand downloads last month - 7,347 stars on GitHub - 1 maintainer
dt-scraper 2.0.2
Douyin/TikTok crawler and no watermark video download.7 versions - Latest release: over 1 year ago - 19 downloads last month - 7,165 stars on GitHub - 1 maintainer
minigun 0.1.8 💰
Web scraping API to outsource tons of GET & xpath to cloud computing17 versions - Latest release: over 5 years ago - 1 dependent repositories - 73 downloads last month - 8 stars on GitHub - 1 maintainer
scrappeycom 0.3.8
An API wrapper for Scrappey.com written in Python (cloudflare bypass & solver)11 versions - Latest release: 12 months ago - 42 downloads last month - 10 stars on GitHub - 1 maintainer
metacritic 0.2.8
A Python API for Metacritic.11 versions - Latest release: over 9 years ago - 3 dependent repositories - 38 downloads last month - 17 stars on GitHub - 1 maintainer
pnu-libgh 0.9.0
GitHub scraping library and tool5 versions - Latest release: 25 days ago - 494 downloads last month - 0 stars on GitHub - 1 maintainer
newshound 0.0.1 💰
A future news extractor package for Python 31 version - Latest release: over 2 years ago - 1 dependent repositories - 25 downloads last month - 29 stars on GitHub - 1 maintainer
proxyport2 1.1.0
Proxy Port SDK3 versions - Latest release: about 1 year ago - 2 dependent packages - 32 downloads last month - 2 stars on GitHub - 1 maintainer
wrighter-plugins 0.0.2
Plugins for Wrighter2 versions - Latest release: about 1 year ago - 18 downloads last month - 1 stars on GitHub - 1 maintainer
py-easy-scrap 0.1.3
A useful package for web scraping with Selenium4 versions - Latest release: 12 months ago - 20 downloads last month - 1 stars on GitHub - 1 maintainer
simple-useragent 0.1.5 💰
Seamlessly fetch authentic and current user agents with ease6 versions - Latest release: about 1 month ago - 1 dependent package - 56 downloads last month - 2 stars on GitHub - 1 maintainer
pachong 0.0.80
python webscraping framework76 versions - Latest release: almost 6 years ago - 1 dependent repositories - 187 downloads last month - 1 maintainer
pydude-pyto 0.22.0 💰
dude uncomplicated data extraction (For Pyto on iOS)13 versions - Latest release: over 1 year ago - 1 dependent repositories - 39 downloads last month - 413 stars on GitHub - 1 maintainer
web-scraping-bot-template 1.2.0
Tools that are useful for building web-scraping automated bots.3 versions - Latest release: over 2 years ago - 1 dependent repositories - 32 downloads last month - 1 maintainer
pdf12step 1.4.0 💰
Generates PDFs meeting guides from sites using the 12 Step Meeting List WordPress plugin6 versions - Latest release: about 2 years ago - 1 dependent repositories - 19 downloads last month - 4 stars on GitHub - 2 maintainers
pyleapcard 0.1.9
Python Leap Card API (Unofficial). Access your card balance and journey history for Ireland's pub...10 versions - Latest release: over 3 years ago - 2 dependent repositories - 31 downloads last month - 6 stars on GitHub - 1 maintainer
microwler 0.1.8
A micro-framework for asynchronous deep crawls and web scraping written in Python10 versions - Latest release: over 3 years ago - 1 dependent repositories - 100 downloads last month - 13 stars on GitHub - 1 maintainer
datatotable 0.3.1
Create SQLite database tables automatically from data4 versions - Latest release: over 4 years ago - 1 dependent repositories - 19 downloads last month - 0 stars on GitHub - 1 maintainer
Top 1.3% on pypi.org
44 versions - Latest release: 19 days ago - 56 dependent packages - 155 dependent repositories - 352 thousand downloads last month - 1,287 stars on GitHub - 1 maintainer
curl-cffi 0.6.4
libcurl ffi bindings for Python, with impersonation support.44 versions - Latest release: 19 days ago - 56 dependent packages - 155 dependent repositories - 352 thousand downloads last month - 1,287 stars on GitHub - 1 maintainer
py-easy-scrape 0.1.6
A useful package for web scraping with Selenium4 versions - Latest release: 8 months ago - 27 downloads last month - 1 stars on GitHub - 1 maintainer
botasaurus-driver 4.0.7 💰
Super Fast, Super Anti-Detect, and Super Intuitive Web Driver19 versions - Latest release: 18 days ago - 2.92 thousand downloads last month - 3 stars on GitHub - 1 maintainer
Top 1.7% on pypi.org
45 versions - Latest release: about 1 month ago - 71 dependent packages - 63 dependent repositories - 366 thousand downloads last month - 2,965 stars on GitHub - 1 maintainer
trafilatura 1.9.0 💰
Python package and command-line tool designed to gather text on the Web, includes all necessary d...45 versions - Latest release: about 1 month ago - 71 dependent packages - 63 dependent repositories - 366 thousand downloads last month - 2,965 stars on GitHub - 1 maintainer
pyreqwest-impersonate 0.4.5
HTTP client that can impersonate web browsers, mimicking their headers and `TLS/JA3/JA4/HTTP2` fi...19 versions - Latest release: 19 days ago - 70.1 thousand downloads last month - 4 stars on GitHub - 1 maintainer
botasaurus 4.0.20 💰
The All in One Web Scraping Framework79 versions - Latest release: 17 days ago - 1 dependent package - 1 dependent repositories - 4.69 thousand downloads last month - 976 stars on GitHub - 1 maintainer
googlenewsscraper 1.0.1
Scrapes Google News article data9 versions - Latest release: about 2 years ago - 1 dependent repositories - 53 downloads last month - 9 stars on GitHub - 3 maintainers
scrapyish 0.1.0
A high-level dynamic web content crawling and web scraping framework3 versions - Latest release: over 1 year ago - 26 downloads last month - 1 maintainer
thisisapogreq 21.3.3 💰
Faster & simpler requests replacement for Python1 version - Latest release: over 2 years ago - 1 dependent repositories - 19 downloads last month - 1,084 stars on GitHub - 1 maintainer
requestsplus 0.0.6
RequestsPlus is based on requests package, adding default retries, timeout, and auto-sleeping whe...6 versions - Latest release: over 6 years ago - 1 dependent package - 2 dependent repositories - 18 downloads last month - 0 stars on GitHub - 1 maintainer
twitter-scraper-selenium 6.1.2
Python package to scrap twitter's front-end easily with selenium27 versions - Latest release: 4 months ago - 1 dependent repositories - 611 downloads last month - 284 stars on GitHub - 1 maintainer
web-data-extraction 0.0.3
A unified collection of web data premises eg Apartment for sale, apartment for rent, house for sa...3 versions - Latest release: about 1 year ago - 11 downloads last month - 0 stars on GitHub - 1 maintainer
ytvs 0.0.28
The Python Code Tutorials28 versions - Latest release: 3 months ago - 129 downloads last month - 2,031 stars on GitHub - 1 maintainer
pcs-scraper 0.2.0
A python-based api to access procyclingstats data2 versions - Latest release: about 1 year ago - 1 dependent repositories - 18 downloads last month - 3 stars on GitHub - 1 maintainer
chrome-cookiejar 0.1.0
Python library for retrieving cookies from the Chrome browser1 version - Latest release: about 3 years ago - 53 downloads last month - 18 stars on GitHub - 1 maintainer
audiobooker 0.4.0
audio book scrapper10 versions - Latest release: over 2 years ago - 4 dependent repositories - 41 downloads last month - 22 stars on GitHub - 2 maintainers
tengri 1.1
Weather scraping command-line tool2 versions - Latest release: over 3 years ago - 1 dependent repositories - 14 downloads last month - 0 stars on GitHub - 1 maintainer
bisque 0.3.0
Web scraping into structured Pydantic data models.3 versions - Latest release: 9 months ago - 18 downloads last month - 1 stars on GitHub - 1 maintainer
campbells 0.3.0
A condensed web scraping library.8 versions - Latest release: 9 months ago - 1 dependent repositories - 29 downloads last month - 0 stars on GitHub - 1 maintainer
cached-historical-data-fetcher 0.2.20 💰
Python utility for fetching any historical data using caching.22 versions - Latest release: 28 days ago - 403 downloads last month - 2 stars on GitHub - 1 maintainer
filesignaturecollectors 0.1.7
Collects, processes and stores information on 'magic numbers'.8 versions - Latest release: 3 months ago - 1 dependent package - 72 downloads last month - 0 stars on GitHub - 1 maintainer
gotchatwitter 0.1.26
Crawling twitter in Python56 versions - Latest release: over 7 years ago - 1 dependent repositories - 62 downloads last month - 0 stars on GitHub - 1 maintainer
soupsavvy 0.1.4
Python package for advanced web scraping7 versions - Latest release: about 2 months ago - 84 downloads last month - 9 stars on GitHub - 1 maintainer
pinscrape 3.0.5
Pinterest | a simple data scraper for pinterest15 versions - Latest release: 19 days ago - 1 dependent repositories - 837 downloads last month - 62 stars on GitHub - 1 maintainer
gesp 0.1
convenient scraping of german court decisions1 version - Latest release: 11 months ago - 13 downloads last month - 14 stars on GitHub - 1 maintainer
spider-client 0.0.20
Python SDK for Spider Cloud API14 versions - Latest release: 19 days ago - 1 dependent package - 12.9 thousand downloads last month - 0 stars on GitHub - 1 maintainer
fantasy-rankings-scraper 0.0.4
A Python package for scraping fantasy football players rankings across multiple sites.4 versions - Latest release: 9 months ago - 30 downloads last month - 0 stars on GitHub - 1 maintainer
ragoon 💰
Improve large language models (LLM) retrieval using dynamic web-search based on blazingly fast qu...1 version - 0 stars on GitHub
pastebin-bisque 1.0.0
Scrape all public Pastebin pastes from a user.1 version - Latest release: 9 months ago - 12 downloads last month - 23 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
48 versions - Latest release: over 1 year ago - 8 dependent repositories - 6.32 thousand downloads last month - 78 stars on GitHub - 1 maintainer
requests-random-user-agent 2023.2.15
Automatically generate a random User Agent for the requests library48 versions - Latest release: over 1 year ago - 8 dependent repositories - 6.32 thousand downloads last month - 78 stars on GitHub - 1 maintainer
zineb-scrapper 6.0.4
Advanced web scrapper16 versions - Latest release: about 2 years ago - 1 dependent repositories - 74 downloads last month - 3 stars on GitHub - 1 maintainer
Top 8.5% on pypi.org
28 versions - Latest release: about 2 months ago - 2 dependent repositories - 1.38 thousand downloads last month - 198 stars on GitHub - 1 maintainer
facebook-page-scraper 5.0.4
Python package to scrap facebook's pages front end with no limitations28 versions - Latest release: about 2 months ago - 2 dependent repositories - 1.38 thousand downloads last month - 198 stars on GitHub - 1 maintainer
cambridge 3.9.4
cambridge is a terminal version of Cambridge Dictionary.99 versions - Latest release: 2 months ago - 2 dependent repositories - 756 downloads last month - 47 stars on GitHub - 1 maintainer
Top 1.9% on pypi.org
41 versions - Latest release: about 1 year ago - 113 dependent packages - 2,025 dependent repositories - 369 thousand downloads last month - 459 stars on GitHub - 3 maintainers
google-search-results 2.4.2
Scrape and search localized results from Google, Bing, Baidu, Yahoo, Yandex, Ebay, Homedepot, you...41 versions - Latest release: about 1 year ago - 113 dependent packages - 2,025 dependent repositories - 369 thousand downloads last month - 459 stars on GitHub - 3 maintainers
mymusic-dl 0.0.1b1
Download your music playlists using web-scraping and youtube-dl no API keys involved6 versions - Latest release: over 3 years ago - 1 dependent repositories - 32 downloads last month - 2 stars on GitHub - 1 maintainer
scrapfly-sdk 0.8.16
Scrapfly SDK for Scrapfly38 versions - Latest release: about 1 month ago - 2 dependent repositories - 13.1 thousand downloads last month - 18 stars on GitHub - 1 maintainer
zineb 1.0.0
Advanced web scrapper for machine learning and data science buit around BeautifulSoup and Pandas1 version - Latest release: about 3 years ago - 1 dependent repositories - 9 downloads last month - 3 stars on GitHub - 1 maintainer
pywebber 5.0
Common tools employed in web development3 versions - Latest release: about 6 years ago - 1 dependent repositories - 28 downloads last month - 1 stars on GitHub - 1 maintainer
scsapi 0.1.1
A third-party API to connect to, browse, and interact with SpeedCubeShop.3 versions - Latest release: over 4 years ago - 1 dependent repositories - 21 downloads last month - 0 stars on GitHub - 1 maintainer
linkparser 1.0
A Simple Python Package to Extract All Links from a Target Domain or URL.1 version - Latest release: almost 3 years ago - 1 dependent repositories - 13 downloads last month - 0 stars on GitHub - 1 maintainer
synonymscrawler 1.0.0
Python Synonyms Crawler Implementation1 version - Latest release: over 7 years ago - 1 dependent repositories - 24 downloads last month - 4 stars on GitHub - 1 maintainer
xil 0.3.0
A Python library for fetching Israeli banks' ILS exchange rates3 versions - Latest release: 3 months ago - 30 downloads last month - 0 stars on GitHub - 1 maintainer
onefactorauth 0.1.1
A tool to bypass 2 factor authentication.2 versions - Latest release: over 1 year ago - 27 downloads last month - 8 stars on GitHub - 1 maintainer
rtv-downloader 2.0.8
Command-line program to download videos from various sites.5 versions - Latest release: almost 5 years ago - 1 dependent repositories - 28 downloads last month - 4 stars on GitHub - 1 maintainer
arachnio 0.0.0
Client library for interacting with Arachnio API1 version - Latest release: about 1 year ago - 21 downloads last month - 0 stars on GitHub - 1 maintainer
flamingtext 0.0.7
Unofficial API of flamingtext.com7 versions - Latest release: about 1 year ago - 48 downloads last month - 1 stars on GitHub - 1 maintainer
pyenhance 0.1.3
A collection of essential scripts for any python project.10 versions - Latest release: 3 months ago - 55 downloads last month - 0 stars on GitHub - 1 maintainer
vigorish 0.7.0
Hybrid Python/Node.js web scraper for Major League Baseball (MLB) data.48 versions - Latest release: almost 2 years ago - 1 dependent repositories - 223 downloads last month - 2 stars on GitHub - 1 maintainer
manga-down 0.1.2
Python package to download manga available on mangareader and mangapanda3 versions - Latest release: about 3 years ago - 1 dependent repositories - 21 downloads last month - 4 stars on GitHub - 1 maintainer
fala-parlamentar 0.1.1
Módulo para obtenção dos discursos dos parlamentares via webscraping mantendo a url para a public...2 versions - Latest release: 6 months ago - 19 downloads last month - 5 stars on GitHub - 1 maintainer
reddit-multimodal-crawler 1.3.2
A scraper which will scrape out multimedia data from reddit.4 versions - Latest release: over 1 year ago - 19 downloads last month - 10 stars on GitHub - 1 maintainer
changedetection.io 0.45.22 💰
Website change detection and monitoring service, detect changes to web pages and send alerts/noti...83 versions - Latest release: about 1 month ago - 4.45 thousand downloads last month - 13,961 stars on GitHub - 1 maintainer
amazon-scraper-api 0.1.0
Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question an...1 version - Latest release: 7 months ago - 40 downloads last month - 488 stars on GitHub - 1 maintainer
elements-manager 1.0.2
Selenium Element Finder Library2 versions - Latest release: 3 months ago - 240 downloads last month - 1 maintainer
queryoem 1.0.4
Query OEM for product informations5 versions - Latest release: over 6 years ago - 1 dependent repositories - 23 downloads last month - 0 stars on GitHub - 1 maintainer
chefpy 0.321
Unofficial Codechef Api for user's status,rank,solutions etc.7 versions - Latest release: over 7 years ago - 1 dependent repositories - 25 downloads last month - 2 stars on GitHub - 1 maintainer
tripadvisor-scraper 0.1.0
The basics of forming an input code for scraping travel industry pages with Tripadvisor Scraper A...1 version - Latest release: 6 months ago - 32 downloads last month - 194 stars on GitHub - 1 maintainer
pubproxpy 2.0.2 💰
An easy to use Python wrapper for pubproxy.com12 versions - Latest release: over 3 years ago - 1 dependent repositories - 59 downloads last month - 6 stars on GitHub - 1 maintainer
questionsparser 1.0.1
A Python package for parsing questions from pdf files.8 versions - Latest release: over 1 year ago - 31 downloads last month - 1 stars on GitHub - 1 maintainer
python-web-scraping-tutorial-step-by-step 0.1.0
In this Python Web Scraping Tutorial, we will outline everything needed to get started with web s...1 version - Latest release: 7 months ago - 9 downloads last month - 257 stars on GitHub - 1 maintainer
pa-scraper 0.2.4
Python wrapper for Prompt API's Scraper API9 versions - Latest release: over 3 years ago - 1 dependent repositories - 66 downloads last month - 5 stars on GitHub - 1 maintainer
Top 3.8% on pypi.org
54 versions - Latest release: about 2 months ago - 5 dependent packages - 50 dependent repositories - 910 thousand downloads last month - 110 stars on GitHub - 1 maintainer
htmldate 1.8.1
Fast and robust extraction of original and updated publication dates from URLs and web pages.54 versions - Latest release: about 2 months ago - 5 dependent packages - 50 dependent repositories - 910 thousand downloads last month - 110 stars on GitHub - 1 maintainer
comic-scraper 0.9.0
Scraps comics,mangas and creates cbz (/pdf) files for offline reading5 versions - Latest release: about 6 years ago - 27 downloads last month - 20 stars on GitHub - 1 maintainer
steimatzky 1.0.4
steimatzky.co.il Web Scraping library5 versions - Latest release: almost 5 years ago - 1 dependent repositories - 37 downloads last month - 0 stars on GitHub - 1 maintainer
Top 9.3% on pypi.org
54 versions - Latest release: about 1 month ago - 2 dependent repositories - 460 downloads last month - 134 stars on GitHub - 1 maintainer
hockey-scraper 1.40.3
Python Package for scraping NHL Play-by-Play and Shift data.54 versions - Latest release: about 1 month ago - 2 dependent repositories - 460 downloads last month - 134 stars on GitHub - 1 maintainer
scraperlamp 0.0.1
1 version - Latest release: over 1 year ago - 12 downloads last month - 1 maintainerscralenium 0.1.3
Middleware for scrapy using selenium webdriver.2 versions - Latest release: almost 2 years ago - 20 downloads last month - 2 stars on GitHub - 1 maintainer
cbbpy 2.0.2
A Python-based web scraper for NCAA basketball.12 versions - Latest release: 5 months ago - 328 downloads last month - 10 stars on GitHub - 1 maintainer
whosyouragent 2.0.0
Self updating package for generating random user agent strings.21 versions - Latest release: 4 months ago - 6 dependent packages - 1 dependent repositories - 177 downloads last month - 1 stars on GitHub - 1 maintainer
jobs-scraper 0.0.11
A simple job postings scraper for Indeed based on requests and BeautifulSoup.11 versions - Latest release: over 2 years ago - 1 dependent repositories - 32 downloads last month - 14 stars on GitHub - 1 maintainer
play-store 1.0
Scrapes data from Google Play Store1 version - Latest release: about 5 years ago - 1 dependent repositories - 32 downloads last month - 2 stars on GitHub - 1 maintainer
scrawler 0.3.1
Tool for General Purpose Web Scraping and Crawling6 versions - Latest release: almost 3 years ago - 1 dependent repositories - 90 downloads last month - 0 stars on GitHub - 1 maintainer
simple-header 0.1.1 💰
Seamlessly get authentic and ready-to-use browser headers with ease2 versions - Latest release: 4 months ago - 22 downloads last month - 1 stars on GitHub - 1 maintainer
scrapedict 0.3.0
Scrape HTML to dictionaries4 versions - Latest release: 7 months ago - 1 dependent repositories - 34 downloads last month - 2 stars on GitHub - 1 maintainer
scrapy-dynamic-spiders 1.0.0a1
Dynamically generate spider subclasses. Run crawls sequentially with crochet. Do both.1 version - Latest release: almost 4 years ago - 1 dependent repositories - 16 downloads last month - 0 stars on GitHub - 1 maintainer
reversetwitterscraper 0.0.2
A Python package for scraping Twitter data without API. With proxy and account-cookie support10 versions - Latest release: about 1 year ago - 75 downloads last month - 27 stars on GitHub - 1 maintainer
Related Keywords
python
171
scraper
104
bot_studio
57
scraping
49
data
48
python3
34
search
33
crawler
31
search-results
27
selenium
27
webscraping
27
keyword
21
product
21
web-scraper
18
requests
17
beautifulsoup
17
crawling
16
scrapy
15
youtube
15
api
14
info
14
framework
14
linkedin
13
web
13
web-scraping-python
13
beautifulsoup4
12
proxy
12
automation
12
hacktoberfest
11
scrape
10
webscraper
9
twitter
9
webdriver
9
asyncio
8
html
8
lxml
7
web-crawling
7
cli
6
web scraping
6
json
6
nlp
6
video
6
scraping-python
6
scraping-framework
6
xpath
6
browser
6
web-crawler
6
machine-learning
6
spider
6
login
5
data-extraction
5
cloud
5
bs4
5
css
5
http
5
cloudflare-bypass
5
pypi
5
parsel
4
ebay
4
post
4
python-web-scraper
4
library
4
text-extraction
4
text-mining
4
api-wrapper
4
async
4
parser
4
playwright
4
datascience
4
profile
4
parsing
4
soup
4
pandas
4
download
4
amazon
4
reddit
4
crawling-python
4
http-client
4
google
4
anti-detection
4
user-agent
4
news
4
web-automation
4
curl
4
bot-detection
4
anti-bot
4
tls-fingerprint
4
web scrapping
3
naver
3
multithreading
3
curl-impersonate
3
python-library
3
selenium-python
3
aiohttp
3
btstudio
3
useragent
3
ai
3
wayback-machine
3
asynchronous
3
html-parsing
3