Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org "web-scraping" keyword

proxyrotation 0.3.0
automatic free proxy rotation
3 versions - Latest release: 1 day ago - 295 downloads last month - 0 stars on GitHub - 2 maintainers
Top 1.7% on pypi.org
trafilatura 1.9.0 πŸ’°
Python package and command-line tool designed to gather text on the Web, includes all necessary d...
44 versions - Latest release: 9 days ago - 62 dependent packages - 63 dependent repositories - 476 thousand downloads last month - 2,688 stars on GitHub - 1 maintainer
scrapy-hls 0.1
scrapy integration for m3u8 files
1 version - Latest release: about 3 years ago - 1 dependent repositories - 18 downloads last month - 51,036 stars on GitHub - 1 maintainer
Top 9.5% on pypi.org
pylab-utils 0.5
python utility tools
2 versions - Latest release: over 2 years ago - 1 dependent repositories - 156 downloads last month - 51,036 stars on GitHub - 1 maintainer
aminer-scrapy 2.11.1
A high-level Web Crawling and Web Scraping framework
3 versions - Latest release: 3 months ago - 47 downloads last month - 51,036 stars on GitHub - 1 maintainer
Top 0.4% on pypi.org
scrapy 2.11.1
A high-level Web Crawling and Web Scraping framework
98 versions - Latest release: 3 months ago - 111 dependent packages - 2,753 dependent repositories - 1.42 million downloads last month - 51,036 stars on GitHub - 4 maintainers
cyberplant-scrapy 1.2.0.dev2
A high-level Web Crawling and Web Scraping framework
1 version - Latest release: almost 8 years ago - 1 dependent repositories - 29 downloads last month - 51,015 stars on GitHub - 2 maintainers
city-scrapers-core 0.10.1
Core functionality for City Scrapers projects
36 versions - Latest release: about 3 years ago - 16 dependent repositories - 505 downloads last month - 8 stars on GitHub - 2 maintainers
pydude-pyto 0.22.0 πŸ’°
dude uncomplicated data extraction (For Pyto on iOS)
13 versions - Latest release: over 1 year ago - 1 dependent repositories - 64 downloads last month - 413 stars on GitHub - 1 maintainer
random-proxies 0.0.2
Get a proxy server IP on the fly!
1 version - Latest release: about 4 years ago - 1 dependent package - 1 dependent repositories - 49 downloads last month - 18 stars on GitHub - 2 maintainers
naverscrap 1.0.6
A Naver News Scraping tool
7 versions - Latest release: almost 3 years ago - 1 dependent repositories - 23 downloads last month - 0 stars on GitHub - 2 maintainers
Top 2.5% on pypi.org
scrapy-fake-useragent 1.4.4
Use a random User-Agent provided by fake-useragent for every request
12 versions - Latest release: over 3 years ago - 4 dependent packages - 121 dependent repositories - 41 thousand downloads last month - 678 stars on GitHub - 1 maintainer
scrape-schema 0.6.3
A library for converting any text (xml, html, plain text, stdout, etc) to python datatypes
37 versions - Latest release: 7 months ago - 2 dependent packages - 337 downloads last month - 3 stars on GitHub - 2 maintainers
py-hacker-news 1.0.4
Command Line tool for browsing HackerNews articles
5 versions - Latest release: almost 5 years ago - 1 dependent repositories - 57 downloads last month - 1 stars on GitHub - 2 maintainers
eriparse 0.0.2
HTML Parser of Economic Research Institute Cost of Living HTML.
3 versions - Latest release: 10 months ago - 32 downloads last month - 1 stars on GitHub - 1 maintainer
xil 0.3.0
A Python library for fetching Israeli banks' ILS exchange rates
3 versions - Latest release: 2 months ago - 47 downloads last month - 0 stars on GitHub - 2 maintainers
crawler-toolz 0.2.2
Proxy rotation with PostgreSQL
6 versions - Latest release: over 3 years ago - 1 dependent repositories - 24 downloads last month - 0 stars on GitHub - 2 maintainers
parse-utils-yogen48 0.0.5
Page Parser Utils For scraping
3 versions - Latest release: over 4 years ago - 1 dependent repositories - 20 downloads last month - 2 stars on GitHub - 2 maintainers
parse-utils 1.3.6
Page Parser Utils For scraping, List index update
16 versions - Latest release: over 2 years ago - 1 dependent repositories - 84 downloads last month - 2 stars on GitHub - 2 maintainers
udemyscraper 0.8.2
A Udemy Course Scraper built with beautiful soup, that fetches udemy course information. Get udem...
3 versions - Latest release: over 2 years ago - 1 dependent repositories - 53 downloads last month - 18 stars on GitHub - 1 maintainer
selgym 0.1.6
Selenium scripting utility library for building scrapers with geckodriver and Firefox
7 versions - Latest release: 3 months ago - 1 dependent package - 105 downloads last month - 2 stars on GitHub - 2 maintainers
ytvs 0.0.28
The Python Code Tutorials
28 versions - Latest release: 3 months ago - 212 downloads last month - 2,008 stars on GitHub - 2 maintainers
ucsdasiga 1.0.0a7
A simple API wrapper and web scraper for the UCSD Associated Students (AS) instructor grade archive.
4 versions - Latest release: 10 months ago - 32 downloads last month - 1 stars on GitHub - 2 maintainers
pyreqwest-impersonate 0.4.3
HTTP client that can impersonate web browsers, mimicking their headers and `TLS/JA3/JA4/HTTP2` fi...
15 versions - Latest release: 4 days ago - 7.53 thousand downloads last month - 4 stars on GitHub - 2 maintainers
scrapyproxyport 1.1.1
Proxy Port Scrapy middleware
5 versions - Latest release: about 1 year ago - 1 dependent repositories - 40 downloads last month - 3 stars on GitHub - 2 maintainers
cached-historical-data-fetcher 0.2.20 πŸ’°
Python utility for fetching any historical data using caching.
22 versions - Latest release: 7 days ago - 408 downloads last month - 2 stars on GitHub - 2 maintainers
scrappeycom 0.3.8
An API wrapper for Scrappey.com written in Python (cloudflare bypass & solver)
11 versions - Latest release: 11 months ago - 64 downloads last month - 10 stars on GitHub - 2 maintainers
booking-scraper 1.0.1
A scraper for the booking.com website
1 version - Latest release: about 4 years ago - 1 dependent repositories - 69 downloads last month - 31 stars on GitHub - 2 maintainers
apis-scraper 1.0.1 πŸ’°
Python web scraper for getting Polish political parties support percentage
2 versions - Latest release: over 3 years ago - 1 dependent repositories - 38 downloads last month - 4 stars on GitHub - 2 maintainers
Top 8.5% on pypi.org
facebook-page-scraper 5.0.4
Python package to scrap facebook's pages front end with no limitations
27 versions - Latest release: about 1 month ago - 2 dependent repositories - 1.51 thousand downloads last month - 191 stars on GitHub - 1 maintainer
ai-demos 0.1.2
unofficial api to machine learning demos
3 versions - Latest release: about 5 years ago - 12 downloads last month - 4 stars on GitHub - 2 maintainers
ioweb 0.0.29
Web Scraping Framework
26 versions - Latest release: over 3 years ago - 1 dependent repositories - 97 downloads last month - 34 stars on GitHub - 2 maintainers
pyvigate 0.0.3 πŸ’°
A brief description of what your package does
4 versions - Latest release: 2 months ago - 28 downloads last month - 22 stars on GitHub - 2 maintainers
omkar-account-generator 1.1.1
Generate user accounts
4 versions - Latest release: 11 months ago - 17 downloads last month - 5 stars on GitHub - 2 maintainers
nudecrawler 0.3.19
Crawl telegra.ph for nude pictures and videos
38 versions - Latest release: about 1 year ago - 312 downloads last month - 260 stars on GitHub - 2 maintainers
omkar-temp-mail 1.1.0
Use Omkar Temporary for receiving temporary emails
8 versions - Latest release: 11 months ago - 419 downloads last month - 10 stars on GitHub - 2 maintainers
Top 2.8% on pypi.org
finvizfinance 0.14.7 πŸ’°
Finviz Finance. Information downloader.
57 versions - Latest release: 6 months ago - 4 dependent packages - 86 dependent repositories - 8.67 thousand downloads last month - 413 stars on GitHub - 2 maintainers
milwaukee-dpw-parser 0.1.1
Milwaukee Wisconsin Department of Public Works Parser
2 versions - Latest release: over 2 years ago - 1 dependent repositories - 14 downloads last month - 0 stars on GitHub - 2 maintainers
ucsdasone 0.1.0
A web scraper for the UCSD AS One grade archive
5 versions - Latest release: about 1 year ago - 44 downloads last month - 1 stars on GitHub - 2 maintainers
thisisapogreq 21.3.3 πŸ’°
Faster & simpler requests replacement for Python
1 version - Latest release: about 2 years ago - 1 dependent repositories - 14 downloads last month - 1,076 stars on GitHub - 2 maintainers
dt-scraper 2.0.2
Douyin/TikTok crawler and no watermark video download.
7 versions - Latest release: over 1 year ago - 32 downloads last month - 6,995 stars on GitHub - 1 maintainer
Top 9.9% on pypi.org
douyin-tiktok-scraper 1.2.9
Douyin/TikTok async data scraper.
21 versions - Latest release: 8 months ago - 1.16 thousand downloads last month - 6,995 stars on GitHub - 1 maintainer
vasvscrapper 0.0.2a9
A python package for the-vasv-deets project to extract information from vce.ac.in.
8 versions - Latest release: over 2 years ago - 1 dependent repositories - 72 downloads last month - 1 stars on GitHub - 2 maintainers
botasaurus 4.0.14 πŸ’°
The All in One Web Scraping Framework
74 versions - Latest release: about 1 month ago - 1 dependent repositories - 3.42 thousand downloads last month - 915 stars on GitHub - 2 maintainers
cbse-results-scraper 1.2.9
CBSE-Results-Scraper is a command-line Python application that scrapes and downloads student repo...
9 versions - Latest release: over 4 years ago - 79 downloads last month - 1 stars on GitHub - 2 maintainers
Top 5.5% on pypi.org
web-poet 0.17.0
Zyte's Page Object pattern for web scraping
25 versions - Latest release: 2 months ago - 3 dependent packages - 6 dependent repositories - 12.4 thousand downloads last month - 88 stars on GitHub - 3 maintainers
ayugespidertools 3.9.7
scrapy ζ‰©ε±•εΊ“οΌšη”¨δΊŽζ‰©ε±• Scrapy εŠŸθƒ½ζ₯θ§£ζ”ΎεŒζ‰‹γ€‚
88 versions - Latest release: 2 months ago - 1 dependent repositories - 431 downloads last month - 58 stars on GitHub - 1 maintainer
multi-webbing 0.3.0
A multi-threaded libary for web scraping in python, built upon the python threading. Supports sel...
3 versions - Latest release: about 3 years ago - 1 dependent repositories - 24 downloads last month - 3 stars on GitHub - 1 maintainer
outlook-calendar-sync 0.0.5
CLI interface to scrape outlook calendar events from the webapp and insert them to a google calen...
5 versions - Latest release: over 1 year ago - 43 downloads last month - 2 stars on GitHub - 1 maintainer
fb-friend-list-scraper 0.3.6
Tool to scrape names and usernames from large friend lists on Facebook, without being rate limited.
8 versions - Latest release: almost 2 years ago - 1 dependent repositories - 150 downloads last month - 225 stars on GitHub - 2 maintainers
scrapy-beautifulsoup 0.0.2
Simple Scrapy middleware to process non-well-formed HTML with BeautifulSoup
2 versions - Latest release: over 7 years ago - 1 dependent repositories - 811 downloads last month - 20 stars on GitHub - 2 maintainers
gli99 1.1.8
Web scraper for gifcities.org
36 versions - Latest release: 10 months ago - 184 downloads last month - 2 stars on GitHub - 2 maintainers
turbocrawler 0.0.1
Scraping and Crawling Micro-Framework
5 versions - Latest release: 7 months ago - 47 downloads last month - 1 stars on GitHub - 2 maintainers
vodscrepe 2.1.0
https://vods.co/ vod scraper
24 versions - Latest release: about 3 years ago - 1 dependent repositories - 14 downloads last month - 2 stars on GitHub - 1 maintainer
bcitflex 3.11.0
Browse BCIT Flex course offerings.
20 versions - Latest release: 4 months ago - 213 downloads last month - 9 stars on GitHub - 2 maintainers
wrighter 0.1.2
eb scraping/browser automation framework built on Playwright
3 versions - Latest release: 12 months ago - 1 dependent package - 1 dependent repositories - 49 downloads last month - 3 stars on GitHub - 2 maintainers
digidownload 1.0.5
API to download books from digi4school.at.
8 versions - Latest release: about 1 year ago - 41 downloads last month - 0 stars on GitHub - 1 maintainer
get-wayback-machine 0.1.2
Fetch a URL via the latest Wayback Machine Snapshot
3 versions - Latest release: over 5 years ago - 3 dependent repositories - 17 downloads last month - 4 stars on GitHub - 2 maintainers
imdb-rating-classifier 0.1.6
An application that scrapes data from IMDB and adjusts rating based on some rulesets.
7 versions - Latest release: over 1 year ago - 52 downloads last month - 0 stars on GitHub - 2 maintainers
siiau-consultas-api 0.0.2
Consulta informaciΓ³n del SIIAU de la UDG
3 versions - Latest release: almost 2 years ago - 1 dependent repositories - 24 downloads last month - 1 stars on GitHub - 2 maintainers
Top 7.7% on pypi.org
wayback-machine-scraper 1.0.8
A command-line utility for scraping Wayback Machine snapshots from archive.org.
6 versions - Latest release: about 3 years ago - 4 dependent repositories - 232 downloads last month - 400 stars on GitHub - 4 maintainers
pymultidictionary 1.2.4 πŸ’°
PyMultiDictionary is a Dictionary Module for Python 2 to get meanings, translations, synonyms and...
14 versions - Latest release: 4 months ago - 2 dependent repositories - 1.08 thousand downloads last month - 41 stars on GitHub - 2 maintainers
yirabot 1.0.9
YiraBot: Simplifying Web Scraping for All. A user-friendly tool for developers and enthusiasts, o...
20 versions - Latest release: 2 months ago - 172 downloads last month - 11 stars on GitHub - 2 maintainers
trh 2.1
TypeRacer and MonkeyType Hack using Selenium Chromium Webdriver and BeatifulSoup Web Scraping.
6 versions - Latest release: about 3 years ago - 1 dependent repositories - 45 downloads last month - 2 maintainers
mashup-102117021 0.0.1
Mashup of audio files from youtube videos.
1 version - Latest release: 2 months ago - 12 downloads last month - 1 maintainer
biobeee 0.0.5
Bioinformatics tool for performing web scrapping on biological database and pre-processing
3 versions - Latest release: 6 months ago - 27 downloads last month - 0 stars on GitLab.com - 2 maintainers
instiz 0.2.1
A Python3-only library for iChart K-Pop chart scores.
4 versions - Latest release: over 5 years ago - 2 dependent repositories - 30 downloads last month - 0 stars on GitHub - 2 maintainers
uwtools 1.6.1
Easy data parsing for courses at the University of Washington
6 versions - Latest release: almost 3 years ago - 1 dependent repositories - 68 downloads last month - 6 stars on GitHub - 2 maintainers
Top 1.9% on pypi.org
google-search-results 2.4.2
Scrape and search localized results from Google, Bing, Baidu, Yahoo, Yandex, Ebay, Homedepot, you...
41 versions - Latest release: about 1 year ago - 69 dependent packages - 2,025 dependent repositories - 318 thousand downloads last month - 459 stars on GitHub - 3 maintainers
Top 1.3% on pypi.org
curl-cffi 0.6.3
libcurl ffi bindings for Python, with impersonation support.
43 versions - Latest release: 19 days ago - 25 dependent packages - 155 dependent repositories - 396 thousand downloads last month - 1,287 stars on GitHub - 1 maintainer
scrapy-fake-useragent-fix 0.1.1
Use a random User-Agent provided by fake-useragent for every request
2 versions - Latest release: over 5 years ago - 1 dependent repositories - 49 downloads last month - 1 stars on GitHub - 2 maintainers
price-tracker 0.6.1
a python application to track prices on some online shopping applications
6 versions - Latest release: over 3 years ago - 1 dependent repositories - 47 downloads last month - 22 stars on GitHub - 2 maintainers
ucsd-ece-courses 0.0.1
UCSD ECE Department's course catalog
1 version - Latest release: about 1 year ago - 13 downloads last month - 2 maintainers
curlquest 0.1.1
A user-friendly wrapper for pycurl that simplifies HTTP requests (fork of request_curl with a few...
3 versions - Latest release: about 1 month ago - 708 downloads last month - 36 stars on GitHub - 2 maintainers
request-curl 0.0.3
A user-friendly wrapper for pycurl that simplifies HTTP requests
3 versions - Latest release: over 1 year ago - 82 downloads last month - 36 stars on GitHub - 1 maintainer
urbandictapi 0.3
Unofficial API for the popular website-Urban Dictionary.
3 versions - Latest release: almost 3 years ago - 1 dependent repositories - 6 downloads last month - 0 stars on GitHub - 2 maintainers
selenium-docker 0.5.0
Additional selenium drivers that utilize docker containers for their UI.
1 version - Latest release: over 6 years ago - 1 dependent repositories - 17 downloads last month - 6 stars on GitHub - 2 maintainers
webscraperapi 1.0.4
A web scraping API that allows users to easily extract data from any website by simply providing ...
5 versions - Latest release: over 1 year ago - 40 downloads last month - 2 stars on GitHub - 2 maintainers
webscrapex 0.0.8
A unified collection of web data premises eg Apartment for sale, apartment for rent, house for sa...
7 versions - Latest release: 11 months ago - 60 downloads last month - 2 maintainers
pandasbasketball 0.0.1
A Python module to scrape data from basketbal-reference.com and convert it to pandas data structu...
1 version - Latest release: over 4 years ago - 2 dependent repositories - 26 downloads last month - 18 stars on GitHub - 2 maintainers
foot-fixtures 1.0.3
Utility to find schedule for a football club
4 versions - Latest release: almost 10 years ago - 2 dependent repositories - 22 downloads last month - 1 stars on GitHub - 2 maintainers
changedetection.io 0.45.22 πŸ’°
Website change detection and monitoring service, detect changes to web pages and send alerts/noti...
82 versions - Latest release: 9 days ago - 4.06 thousand downloads last month - 13,961 stars on GitHub - 1 maintainer
Top 7.0% on pypi.org
tableauscraper 0.1.29
Python library to scrape data from Tableau viz
39 versions - Latest release: over 2 years ago - 8 dependent repositories - 15 thousand downloads last month - 121 stars on GitHub - 2 maintainers
bibscrap 0.0.4
Semi-automated tools for systematic literature reviews.
13 versions - Latest release: over 2 years ago - 1 dependent repositories - 109 downloads last month - 2 stars on GitHub - 2 maintainers
proxy-randomizer 1.3.5
proxy randomizer
7 versions - Latest release: over 1 year ago - 2 dependent repositories - 463 downloads last month - 7 stars on GitHub - 2 maintainers
solidscraper 0.7.7
This package lets your script scrape web sites. JQuery-Like API.
4 versions - Latest release: almost 4 years ago - 1 dependent repositories - 36 downloads last month - 3 stars on GitHub - 1 maintainer
manga-scraper 0.12
Download Manga into chapterwise PDF files
1 version - Latest release: over 2 years ago - 1 dependent repositories - 20 downloads last month - 2 stars on GitHub - 2 maintainers
Top 8.4% on pypi.org
scrapy-wayback-machine 1.0.3
A Scrapy middleware for scraping Wayback Machine snapshots from archive.org.
4 versions - Latest release: about 3 years ago - 8 dependent repositories - 227 downloads last month - 107 stars on GitHub - 4 maintainers
graphscraper 0.5.0
Graph implementation that loads graph data (nodes and edges) from external sources and caches the...
5 versions - Latest release: about 4 years ago - 1 dependent package - 2 dependent repositories - 27 downloads last month - 6 stars on GitHub - 2 maintainers
gg-scrape 0.1.8
A little Python CLI app that provides a summary of League champion build information.
7 versions - Latest release: about 3 years ago - 1 dependent repositories - 61 downloads last month - 4 stars on GitHub - 2 maintainers
geniusdotpy 1.1.1
Python wrapper for Genius API
24 versions - Latest release: 4 months ago - 119 downloads last month - 6 stars on GitHub - 1 maintainer
torvend 0.0.1
A framework for public torrent vendor scrapers
2 versions - Latest release: over 6 years ago - 1 dependent repositories - 7 downloads last month - 1 stars on GitHub - 1 maintainer
top-github-scraper 0.1.1 πŸ’°
Scrape top GitHub repositories and users based on keyword
15 versions - Latest release: about 3 years ago - 1 dependent repositories - 155 downloads last month - 77 stars on GitHub - 1 maintainer
Top 3.8% on pypi.org
autoscraper 1.1.14 πŸ’°
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
16 versions - Latest release: almost 2 years ago - 36 dependent repositories - 3.5 thousand downloads last month - 5,947 stars on GitHub - 1 maintainer
hdistill 1.0.0
CLI tool for parsing HTML
9 versions - Latest release: almost 3 years ago - 1 dependent repositories - 67 downloads last month - 0 stars on GitHub - 2 maintainers
siscad 0.0.5
Module for siscad.ufms.br
5 versions - Latest release: over 3 years ago - 1 dependent repositories - 19 downloads last month - 1 stars on GitHub - 2 maintainers
procyclingstats 0.1.10
A Python API wrapper for procyclingstats.com
9 versions - Latest release: about 1 month ago - 1 dependent repositories - 147 downloads last month - 43 stars on GitHub - 2 maintainers
saveddit 2.2.1
Bulk Downloader for Reddit
15 versions - Latest release: about 3 years ago - 1 dependent repositories - 98 downloads last month - 161 stars on GitHub - 1 maintainer
bluemoss 1.0.0
bluemoss enables you to easily scrape websites.
18 versions - Latest release: 6 months ago - 136 downloads last month - 4 stars on GitHub - 2 maintainers
discord-tools 2.1
Simulates Discord User using Selenium(Web-Scraping) Chromium-webdriver
7 versions - Latest release: about 3 years ago - 1 dependent repositories - 65 downloads last month - 2 stars on GitHub - 2 maintainers