pypi.org "crawler" keyword
Top 0.4% on pypi.org
115 versions - Latest release: 28 days ago - 136 dependent packages - 2,753 dependent repositories - 4.3 million downloads last month - 64,575 stars on GitHub - 4 maintainers
scrapy 2.19.0
A high-level Web Crawling and Web Scraping framework115 versions - Latest release: 28 days ago - 136 dependent packages - 2,753 dependent repositories - 4.3 million downloads last month - 64,575 stars on GitHub - 4 maintainers
qcrawl 0.4.0
Fast async web crawler & scraping framework, supporting deduplication, and extensible middleware.7 versions - Latest release: 4 months ago - 28 downloads last month - 110 stars on GitHub - 1 maintainer
Top 1.7% on pypi.org
54 versions - Latest release: 1 day ago - 71 dependent packages - 63 dependent repositories - 12.9 million downloads last month - 6,909 stars on GitHub - 1 maintainer
trafilatura 2.3.1 💰
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction...54 versions - Latest release: 1 day ago - 71 dependent packages - 63 dependent repositories - 12.9 million downloads last month - 6,909 stars on GitHub - 1 maintainer
scrape2md 0.1.0
Scrape websites and convert them to clean markdown format1 version - Latest release: 11 months ago - 21 downloads last month - 1 stars on GitHub - 1 maintainer
crawl4ai-gautamp8 0.7.7 💰
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & scraper7 versions - Latest release: about 1 year ago - 41 downloads last month - 84,750 stars on GitHub - 1 maintainer
aegis-stack-crawl4ai 0.1.0 💰
Web crawling and scraping for Aegis Stack projects, via Crawl4AI1 version - Latest release: 13 days ago - 146 downloads last month - 84,750 stars on GitHub - 1 maintainer
crawl4ai-ctf 0.7.6.post3 💰
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & scraper (CTF fork with Docker cgroup memory +...2 versions - Latest release: 11 months ago - 81 downloads last month - 84,750 stars on GitHub - 1 maintainer
crawl4ai-nightly 25.7.11.125807 💰
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & scraper (Nightly Build)3 versions - Latest release: about 1 year ago - 27 downloads last month - 84,750 stars on GitHub - 1 maintainer
docpull 6.5.5
Declare, sync, diff, and lock context dependencies for AI agents41 versions - Latest release: about 1 month ago - 471 downloads last month - 25 stars on GitHub - 1 maintainer
patchright-httpx 0.1.1
HTTPX-style HTTP client powered by Patchright browser automation2 versions - Latest release: 11 months ago - 20 downloads last month - 1 maintainer
hexagon-sdk 1.0.0
Make your website AI-readable by ChatGPT, Perplexity, Claude and other AI platforms1 version - Latest release: 11 months ago - 45 downloads last month - 1 maintainer
lightnovel-crawler-patiorjunrick 4.0.1 💰
Download lightnovels from various online sources and generate output in different formats, e.g. e...2 versions - Latest release: 9 months ago - 9 downloads last month - 2,640 stars on GitHub - 1 maintainer
Top 7.4% on pypi.org
213 versions - Latest release: 2 months ago - 1 dependent package - 1 dependent repositories - 1.43 thousand downloads last month - 2,640 stars on GitHub - 1 maintainer
lightnovel-crawler 4.14.0 💰
Download lightnovels from 300+ sources and export to EPUB, MOBI, PDF, DOCX, and more — with a CLI...213 versions - Latest release: 2 months ago - 1 dependent package - 1 dependent repositories - 1.43 thousand downloads last month - 2,640 stars on GitHub - 1 maintainer
genga-lightnovel-crawler 1.0.0 💰
Modified lightnovel crawler with new features1 version - Latest release: 7 months ago - 10 downloads last month - 2,640 stars on GitHub - 1 maintainer
rustmapper 0.1.3
Sitemap crawler and URL discovery tool built with Rust (256 workers, sharded frontier, WAL persis...4 versions - Latest release: 11 months ago - 19 downloads last month - 1 stars on GitHub - 1 maintainer
Top 2.3% on pypi.org
70 versions - Latest release: about 4 years ago - 46 dependent packages - 175 dependent repositories - 5.28 million downloads last month - 1,686 stars on GitHub - 1 maintainer
selectolax 3.8.9
A fast HTML5 parser with CSS selectors, written in Cython, using the Lexbor engine.70 versions - Latest release: about 4 years ago - 46 dependent packages - 175 dependent repositories - 5.28 million downloads last month - 1,686 stars on GitHub - 1 maintainer
datacrawler-test-sdk 1.0.2
A Smart, Automatic, Fast and Lightweight Web Scraper for Python3 versions - Latest release: 11 months ago - 34 downloads last month - 1 maintainer
Top 2.8% on pypi.org
17 versions - Latest release: over 8 years ago - 1 dependent package - 98 dependent repositories - 367 downloads last month - 16,767 stars on GitHub - 1 maintainer
pyspider 0.3.10
A Powerful Spider System in Python17 versions - Latest release: over 8 years ago - 1 dependent package - 98 dependent repositories - 367 downloads last month - 16,767 stars on GitHub - 1 maintainer
crawl4ai 0.9.4 💰
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & scraper72 versions - Latest release: 15 days ago - 1.28 million downloads last month - 84,750 stars on GitHub - 1 maintainer
never-primp 3.0.3
基于原primp 用rust重构调整的python请求库 - The fastest python HTTP client that can impersonate web browsers36 versions - Latest release: 4 months ago - 1.98 thousand downloads last month - 1 maintainer
iflow-mcp_d4vinci-scrapling 0.3.14 💰
Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web ...1 version - Latest release: 8 months ago - 16 downloads last month - 85,163 stars on GitHub - 1 maintainer
scrapling 0.4.15 💰
Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web ...53 versions - Latest release: about 2 months ago - 920 thousand downloads last month - 85,163 stars on GitHub - 1 maintainer
scrapling-zhng 0.2.99 💰
Scrapling is an undetectable, powerful, flexible, high-performance Python library that makes Web ...1 version - Latest release: about 1 year ago - 7 downloads last month - 85,163 stars on GitHub - 1 maintainer
whizoai 1.0.0
Official WhizoAI SDK for Python - Enterprise-grade web scraping API client1 version - Latest release: 12 months ago - 13 downloads last month - 1 maintainer
leetcode-obsidian-sync 1.1.0
自动同步 LeetCode 笔记到 Obsidian/Markdown，支持增量更新、Cookie 自动检测和多种提醒方式1 version - Latest release: 12 months ago - 8 downloads last month - 2 stars on GitHub - 1 maintainer
linkwalker 0.9.0
Deep URL crawler for Python supporting dynamic and static content, domain restrictions, and callb...1 version - Latest release: 12 months ago - 17 downloads last month - 1 stars on GitHub - 1 maintainer
acs-crawler 0.1.3
A professional crawler for American Chemical Society papers with modern web dashboard3 versions - Latest release: 12 months ago - 49 downloads last month - 2 stars on GitHub - 1 maintainer
firecrawl-py 4.49.2
Python SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature s...208 versions - Latest release: about 17 hours ago - 1 dependent package - 5.34 million downloads last month - 189,200 stars on GitHub - 1 maintainer
firecrawl 4.49.2
Python SDK for the Firecrawl API: web scraping, crawling, web search, and scientific literature s...185 versions - Latest release: about 17 hours ago - 702 thousand downloads last month - 189,200 stars on GitHub - 1 maintainer
geek-google-play-scraper 1.2.6
Google-Play-Scraper provides APIs to easily crawl the Google Play Store for Python without any ex...1 version - Latest release: over 2 years ago - 18 downloads last month - 1,013 stars on GitHub - 1 maintainer
Top 2.1% on pypi.org
39 versions - Latest release: over 2 years ago - 4 dependent packages - 118 dependent repositories - 698 thousand downloads last month - 1,013 stars on GitHub - 1 maintainer
google-play-scraper 1.2.7
Google-Play-Scraper provides APIs to easily crawl the Google Play Store for Python without any ex...39 versions - Latest release: over 2 years ago - 4 dependent packages - 118 dependent repositories - 698 thousand downloads last month - 1,013 stars on GitHub - 1 maintainer
linkminer 1.0.0
A CLI tool to recursively download specific file types from websites (e.g., pdf, txt.1 version - Latest release: 12 months ago - 15 downloads last month - 1 maintainer
collab-tunnel 2.0.0
Python client library for the Collaboration Tunnel Protocol (TCT)4 versions - Latest release: 11 months ago - 65 downloads last month - 0 stars on GitHub - 1 maintainer
Top 5.4% on pypi.org
32 versions - Latest release: 4 months ago - 8 dependent packages - 31 dependent repositories - 11.9 million downloads last month - 177 stars on GitHub - 1 maintainer
courlan 1.4.0 💰
Clean, filter and sample URLs to optimize data collection – includes spam, content type and langu...32 versions - Latest release: 4 months ago - 8 dependent packages - 31 dependent repositories - 11.9 million downloads last month - 177 stars on GitHub - 1 maintainer
is-crawler 1.5.25 💰
Crawler detection from User-Agent strings in 50 ns. Zero deps, no regex, ReDoS-safe.86 versions - Latest release: 4 months ago - 627 downloads last month - 0 stars on GitHub - 1 maintainer
xray-proxy-rotator 0.1.0
Async VMESS proxy rotation manager with automatic subscription updates and connection testing1 version - Latest release: 12 months ago - 12 downloads last month - 11 stars on GitHub - 1 maintainer
crawlee 1.10.4
Crawlee for Python834 versions - Latest release: 1 day ago - 819 thousand downloads last month - 9,563 stars on GitHub - 1 maintainer
scrava 0.1.1
The Definitive Web Scraping Framework for Python2 versions - Latest release: 12 months ago - 18 downloads last month - 0 stars on GitHub - 1 maintainer
cdvl-crawler 0.7.3 💰
Crawl and download videos from the CDVL (Consumer Digital Video Library) research repository11 versions - Latest release: 6 months ago - 62 downloads last month - 0 stars on GitHub - 1 maintainer
yquoter 0.4.2
A unified financial data interface and analysis toolkit for CN/HK/US markets.5 versions - Latest release: 5 months ago - 56 downloads last month - 6 stars on GitHub - 1 maintainer
humanlike-automation 1.0.0
Human-like browser automation with stealth capabilities and anti-detection features1 version - Latest release: 12 months ago - 16 downloads last month - 1 maintainer
raysearch 0.1.2
Omni meta-search engine for agentic AI.3 versions - Latest release: 6 months ago - 139 downloads last month - 1 maintainer
Top 0.7% on pypi.org
18 versions - Latest release: about 8 years ago - 75 dependent packages - 1,068 dependent repositories - 441 thousand downloads last month - 15,169 stars on GitHub - 1 maintainer
newspaper3k 0.2.8 💰
Simplified python article discovery & extraction.18 versions - Latest release: about 8 years ago - 75 dependent packages - 1,068 dependent repositories - 441 thousand downloads last month - 15,169 stars on GitHub - 1 maintainer
enlivensystems-newspaper 0.3.11 💰
Simplified python article discovery & extraction.12 versions - Latest release: over 4 years ago - 1 dependent repositories - 29 downloads last month - 15,169 stars on GitHub - 1 maintainer
Top 2.3% on pypi.org
22 versions - Latest release: almost 12 years ago - 264 dependent repositories - 1.79 thousand downloads last month - 15,169 stars on GitHub - 1 maintainer
newspaper 0.0.9 💰
Simplified python article discovery & extraction.22 versions - Latest release: almost 12 years ago - 264 dependent repositories - 1.79 thousand downloads last month - 15,169 stars on GitHub - 1 maintainer
elon-newspaper1 0.3.1 💰
ffffffffffffffffff1 version - Latest release: over 2 years ago - 13 downloads last month - 15,169 stars on GitHub - 1 maintainer
livingbio-newspaper 1514473007.65 💰
Simplified python article discovery & extraction.2 versions - Latest release: almost 9 years ago - 1 dependent repositories - 10 downloads last month - 15,169 stars on GitHub - 1 maintainer
newspaper3k-no-image 0.2.9 💰
Simplified python article discovery & extraction. (With image processing removed)1 version - Latest release: almost 8 years ago - 1 dependent repositories - 33 downloads last month - 15,169 stars on GitHub - 1 maintainer
newspaper3k-nop0x 0.2.8 💰
Simplified python article discovery & extraction.1 version - Latest release: almost 7 years ago - 1 dependent repositories - 3 downloads last month - 15,169 stars on GitHub - 1 maintainer
gplay-scraper 1.0.6
🚀 Advanced Google Play Store Scraper - Extract 65+ app fields, reviews, ratings, ASO data, develo...7 versions - Latest release: 11 months ago - 1.2 thousand downloads last month - 278 stars on GitHub - 1 maintainer
pyprestascan 1.7.3
Scanner SEO professionale per PrestaShop con fix AI-powered (DeepSeek/GPT/Claude), export Excel e...14 versions - Latest release: 12 months ago - 100 downloads last month - 1 stars on GitHub - 1 maintainer
panparsex 0.5.2
Universal, extensible parser for many file types and websites with a clean plugin architecture.10 versions - Latest release: about 1 year ago - 45 downloads last month - 0 stars on GitHub - 1 maintainer
xpaw 0.12.0
Async web scraping framework21 versions - Latest release: about 7 years ago - 1 dependent repositories - 39 downloads last month - 6 stars on GitHub - 1 maintainer
Top 6.1% on pypi.org
13 versions - Latest release: about 5 years ago - 87 dependent repositories - 2.04 thousand downloads last month - 222 stars on GitHub - 1 maintainer
metafinder 1.2
MetaFinder - Metadata search through Search Engines13 versions - Latest release: about 5 years ago - 87 dependent repositories - 2.04 thousand downloads last month - 222 stars on GitHub - 1 maintainer
crawl4weibo 0.5.2
A professional Weibo crawler library15 versions - Latest release: 6 months ago - 1.28 thousand downloads last month - 42 stars on GitHub - 1 maintainer
Top 8.6% on pypi.org
132 versions - Latest release: 11 days ago - 1 dependent repositories - 1.49 thousand downloads last month - 734 stars on GitHub - 1 maintainer
pyptt 2.3.9
PyPtt github: https://github.com/PyPtt/PyPtt132 versions - Latest release: 11 days ago - 1 dependent repositories - 1.49 thousand downloads last month - 734 stars on GitHub - 1 maintainer
fjud-mcp 1.1.0
Taiwan Judicial Yuan judgment search MCP server2 versions - Latest release: about 1 year ago - 24 downloads last month - 1 maintainer
scrappify 0.0.1
A powerful web scraping and downloading utility1 version - Latest release: about 1 year ago - 14 downloads last month - 1 maintainer
fyp-scrape 0.1.1
A TikTok FYP scraper that downloads videos.2 versions - Latest release: about 1 year ago - 25 downloads last month - 4 stars on GitHub - 1 maintainer
Top 1.6% on pypi.org
21 versions - Latest release: over 2 years ago - 6 dependent packages - 392 dependent repositories - 45.9 thousand downloads last month - 5,642 stars on GitHub - 4 maintainers
scrapy-redis 0.9.1
Redis-based components for Scrapy.21 versions - Latest release: over 2 years ago - 6 dependent packages - 392 dependent repositories - 45.9 thousand downloads last month - 5,642 stars on GitHub - 4 maintainers
bookergpttool 2026.3.25.0
iBooker/DracoUnion 大模型 Agent 工具1 version - Latest release: 7 months ago - 108 downloads last month - 5 stars on GitHub - 1 maintainer
batchdownload 0.1.2
Asynchronous batch directory crawler & downloader3 versions - Latest release: about 1 year ago - 18 downloads last month - 1 maintainer
ainfo 1.3.0
Add your description here8 versions - Latest release: about 1 year ago - 96 downloads last month - 2 stars on GitHub - 1 maintainer
waifuboard 2.0.1
Asynchronous API for downloading images, tags, and metadata from image board sites (e.g., Danboor...34 versions - Latest release: about 2 months ago - 167 downloads last month - 2 stars on GitHub - 1 maintainer
Top 8.9% on pypi.org
31 versions - Latest release: 5 months ago - 5 dependent repositories - 173 downloads last month - 139 stars on GitHub - 1 maintainer
dosage 3.3
a comic strip downloader and archiver31 versions - Latest release: 5 months ago - 5 dependent repositories - 173 downloads last month - 139 stars on GitHub - 1 maintainer
respectscraper 0.2.0
Crawl websites within their robots.txt (RFC 9309), with a recorded reason for every request.2 versions - Latest release: 6 days ago - 50 downloads last month - 2 stars on GitHub - 1 maintainer
scrapy-hls 0.1
scrapy integration for m3u8 files1 version - Latest release: over 5 years ago - 1 dependent repositories - 3 downloads last month - 64,575 stars on GitHub - 1 maintainer
bf-scrapy-base 0.0.6
基于scrapy的二次开发6 versions - Latest release: about 1 year ago - 25 downloads last month - 64,575 stars on GitHub - 1 maintainer
scrapy-qfm 2.11.2
A high-level Web Crawling and Web Scraping framework2 versions - Latest release: almost 2 years ago - 23 downloads last month - 64,575 stars on GitHub - 1 maintainer
aminer-scrapy 2.11.1
A high-level Web Crawling and Web Scraping framework6 versions - Latest release: over 2 years ago - 42 downloads last month - 64,575 stars on GitHub - 1 maintainer
Top 9.5% on pypi.org
2 versions - Latest release: about 5 years ago - 1 dependent repositories - 5 downloads last month - 64,575 stars on GitHub - 1 maintainer
pylab-utils 0.5
python utility tools2 versions - Latest release: about 5 years ago - 1 dependent repositories - 5 downloads last month - 64,575 stars on GitHub - 1 maintainer
stealth-crawler 0.9.0
A stealth web crawler using headless Chrome1 version - Latest release: about 1 year ago - 59 downloads last month - 4 stars on GitHub - 1 maintainer
pw-simple-scraper 0.1.4
A simple and light Playwright-based scraper5 versions - Latest release: 12 months ago - 14 downloads last month - 0 stars on GitHub - 1 maintainer
agentcrawl-ai 0.5.2
Self-hosted web scraping and Markdown extraction for AI agents.10 versions - Latest release: 2 days ago - 2.76 thousand downloads last month - 7 stars on GitHub - 1 maintainer
nadf 0.1.34
NamuWiki crawler & PDF utilities33 versions - Latest release: 11 months ago - 205 downloads last month - 0 stars on GitHub - 1 maintainer
nordvpn-switcher-pro 2.0.1
An advanced Python library to automate NordVPN server switching on Windows.5 versions - Latest release: 11 months ago - 53 downloads last month - 1 stars on GitHub - 1 maintainer
ankur-scraper 0.1.6
A robust website scraper that supports static and dynamic pages with intelligent content extraction.6 versions - Latest release: 11 months ago - 54 downloads last month - 1 maintainer
scrapy-ua-rotator 1.0.1
Flexible and modern User-Agent rotator middleware for Scrapy, supporting Faker, fake-useragent, a...2 versions - Latest release: about 1 year ago - 62 downloads last month - 3 stars on GitHub - 1 maintainer
olyptik 0.1.6
Official Python SDK for Olyptik API7 versions - Latest release: 11 months ago - 28 downloads last month - 1 maintainer
playwright-simple-scraper 0.1.5.dev0
A simple Playwright-based scraper that has simple result (based on List[str])1 version - Latest release: about 1 year ago - 0 stars on GitHub - 1 maintainer
Top 5.2% on pypi.org
20 versions - Latest release: 4 months ago - 15 dependent repositories - 257 thousand downloads last month - 257 stars on GitHub - 1 maintainer
ultimate-sitemap-parser 1.8.1
A performant library for parsing and crawling sitemaps20 versions - Latest release: 4 months ago - 15 dependent repositories - 257 thousand downloads last month - 257 stars on GitHub - 1 maintainer
parcel-tw 0.0.1
The Python package for Taiwan parcel tracking.1 version - Latest release: about 1 year ago - 16 downloads last month - 3 stars on GitHub - 1 maintainer
Top 3.7% on pypi.org
124 versions - Latest release: about 1 year ago - 1 dependent package - 123 dependent repositories - 1.02 thousand downloads last month - 2,464 stars on GitHub - 1 maintainer
grab 1.2.0
Web scraping framework124 versions - Latest release: about 1 year ago - 1 dependent package - 123 dependent repositories - 1.02 thousand downloads last month - 2,464 stars on GitHub - 1 maintainer
dl-coursera 1.0.1
A simple, fast, and reliable Coursera crawling & downloading tool4 versions - Latest release: about 1 year ago - 2 dependent repositories - 257 downloads last month - 178 stars on GitHub - 1 maintainer
s3recon 1.4.0
Amazon S3 bucket finder.10 versions - Latest release: over 6 years ago - 1 dependent repositories - 62 downloads last month - 154 stars on GitHub - 1 maintainer
instagram-media-downloader 1.0.0
Instagram Media Downloader: HD Reels, Stories & Posts — free API client for the Apify platform. N...1 version - Latest release: 3 months ago - 0 stars on GitHub - 1 maintainer
inspire-crawler 3.0.4
Crawler integration with INSPIRE-HEP.33 versions - Latest release: about 7 years ago - 6 dependent repositories - 232 downloads last month - 5 stars on GitHub - 2 maintainers
Top 9.5% on pypi.org
186 versions - Latest release: 4 months ago - 6 dependent repositories - 829 downloads last month - 20 stars on GitHub - 2 maintainers
hepcrawl 13.0.83
Scrapy project for feeds into INSPIRE-HEP (http://inspirehep.net).186 versions - Latest release: 4 months ago - 6 dependent repositories - 829 downloads last month - 20 stars on GitHub - 2 maintainers
Top 4.4% on pypi.org
179 versions - Latest release: 10 months ago - 4 dependent repositories - 2.5 thousand downloads last month - 3,738 stars on GitHub - 1 maintainer
feapder 1.9.3
feapder是一款支持分布式、批次采集、数据防丢、报警丰富的python爬虫框架179 versions - Latest release: 10 months ago - 4 dependent repositories - 2.5 thousand downloads last month - 3,738 stars on GitHub - 1 maintainer
jmcomic 2.7.7 💰
Python API For JMComic (禁漫天堂)168 versions - Latest release: 24 days ago - 1 dependent package - 47.8 thousand downloads last month - 7,471 stars on GitHub - 1 maintainer
jmcomic-ai 0.1.8 💰
AI-powered JMComic crawler with MCP server and skills management for seamless AI agent integration19 versions - Latest release: 9 days ago - 606 downloads last month - 111 stars on GitHub - 1 maintainer
bpc-fetch 0.1.1
Bypass paywall sites: search, discover, and fetch articles as markdown2 versions - Latest release: 3 months ago - 84 downloads last month - 216 stars on GitHub - 1 maintainer
hget-audio 2025.7.24a0
Comprehensive audio scraping tool for websites.1 version - Latest release: about 1 year ago - 55 downloads last month - 1 maintainer
github-domain-scraper 3.2.0
This Python package is designed for web crawling through input links that belong to GitHub domain...8 versions - Latest release: about 1 year ago - 54 downloads last month - 0 stars on GitHub - 1 maintainer
harvex 0.2.0
The data-harvesting foundation for the AI era — a zero-boilerplate framework for AI agents and vi...3 versions - Latest release: 4 months ago - 12 downloads last month - 0 stars on GitHub - 1 maintainer
haipproxy2 0.1.4
High aviariable proxy pool client for crawlers.5 versions - Latest release: over 5 years ago - 1 dependent repositories - 38 downloads last month - 5,522 stars on GitHub - 1 maintainer
rankcomp 0.0.2
high fided extraction of differential expression genes without considering the batch effects1 version - Latest release: over 6 years ago - 1 dependent repositories - 3 downloads last month - 5,522 stars on GitHub - 1 maintainer
haipproxy 0.11.6
High aviariable proxy pool client for crawlers.6 versions - Latest release: over 8 years ago - 1 dependent repositories - 47 downloads last month - 5,522 stars on GitHub - 1 maintainer
ai-graph-crawler 0.9.2
AI layer for graph-crawler: graph search, LLM agents, extraction recipes, MCP and REST servers, c...1 version - Latest release: 4 days ago - 118 downloads last month - 1 maintainer
lightfeed-sdk 0.1.7
Lightfeed SDK for Python1 version - Latest release: over 1 year ago - 11 downloads last month - 5 stars on GitHub - 1 maintainer
Related Keywords
python
275
scraper
243
scraping
189
spider
150
web-scraping
149
scrapy
82
web
76
llm
69
crawling
66
markdown
63
playwright
60
ai
59
python3
55
automation
50
web scraping
49
web-crawler
47
api
46
cli
41
mcp
39
json
37
downloader
37
webscraping
37
html
37
data
37
async
35
proxy
35
selenium
35
apify
33
requests
33
asyncio
33
csv
33
data-extraction
32
dataset
32
data extraction
31
rag
31
search
30
seo
30
framework
29
parser
28
unofficial api
27
no api key
27
ai-agents
27
http
27
data export
27
web-scraper
26
crawl
24
news
24
security
23
web-scraping-python
21
beautifulsoup
21
bot
21
hacktoberfest
21
twitter
20
sdk
19
pdf
18
pypi
18
anti-bot
18
sitemap
18
stealth
17
website
17
documentation
17
aiohttp
16
redis
16
web-crawling
16
distributed
15
html-to-markdown
14
scrape
14
mcp-server
13
browser-automation
13
download
13
google
13
browser
13
research
13
cloudflare
12
social-media
12
crawler-python
12
httpx
12
chrome
11
headless
11
douyin
11
model-context-protocol
11
bilibili
11
fastapi
11
weibo
11
captcha
11
novel
11
agent
11
mongodb
11
nlp
10
open-source
10
audit
10
rss
10
ai-scraping
10
scanner
10
image
10
robots.txt
10
webdriver
10
user-agent
10
data-collection
10
bot-detection
9