Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
pypi.org "scrapy" keyword
scrapy-scraper 1.7 💰
Web crawler and scraper based on Scrapy and Playwright's headless browser.8 versions - Latest release: about 2 hours ago - 39 downloads last month - 4 stars on GitHub - 2 maintainers
Top 6.0% on pypi.org
10 versions - Latest release: over 1 year ago - 4 dependent packages - 2 dependent repositories - 2.42 thousand downloads last month - 230 stars on GitHub - 1 maintainer
anti-useragent 1.0.10
fake pc or app browser useragent, anti useragent, and other awesome tools10 versions - Latest release: over 1 year ago - 4 dependent packages - 2 dependent repositories - 2.42 thousand downloads last month - 230 stars on GitHub - 1 maintainer
scrapy-selenium2 0.0.8
Scrapy with selenium1 version - Latest release: 2 months ago - 39 downloads last month - 887 stars on GitHub - 2 maintainers
scrapy-selenium-mm 0.1.1
Scrapy with selenium4 versions - Latest release: 7 months ago - 35 downloads last month - 887 stars on GitHub - 1 maintainer
Top 3.5% on pypi.org
6 versions - Latest release: over 5 years ago - 69 dependent repositories - 14.3 thousand downloads last month - 887 stars on GitHub - 2 maintainers
scrapy-selenium 0.0.7
Scrapy with selenium6 versions - Latest release: over 5 years ago - 69 dependent repositories - 14.3 thousand downloads last month - 887 stars on GitHub - 2 maintainers
city-scrapers-core 0.10.1
Core functionality for City Scrapers projects36 versions - Latest release: about 3 years ago - 16 dependent repositories - 505 downloads last month - 8 stars on GitHub - 2 maintainers
Top 5.0% on pypi.org
17 versions - Latest release: 3 months ago - 23 dependent repositories - 1.74 thousand downloads last month - 2,987 stars on GitHub - 2 maintainers
scrapydweb 1.5.0
Web app for Scrapyd cluster management, with support for Scrapy log analysis & visualization.17 versions - Latest release: 3 months ago - 23 dependent repositories - 1.74 thousand downloads last month - 2,987 stars on GitHub - 2 maintainers
scrapyd_ui 0.9.9
Full-featured web UI for Scrapyd cluster management, Scrapy log analysis & visualization1 version - Latest release: over 5 years ago - 13 downloads last month - 2,987 stars on GitHub - 2 maintainers
scrachy 0.7.0
Enhanced functionality for Scrapy.10 versions - Latest release: about 1 month ago - 1 dependent repositories - 129 downloads last month - 2 maintainers
Top 8.8% on pypi.org
16 versions - Latest release: 6 months ago - 15 dependent repositories - 1.66 thousand downloads last month - 36 stars on GitHub - 1 maintainer
scrapeops-scrapy 0.5.4
Scrapeops Scrapy SDK, is a monitoring tool for your Scrapy spiders.16 versions - Latest release: 6 months ago - 15 dependent repositories - 1.66 thousand downloads last month - 36 stars on GitHub - 1 maintainer
Top 2.5% on pypi.org
12 versions - Latest release: over 3 years ago - 4 dependent packages - 121 dependent repositories - 41 thousand downloads last month - 678 stars on GitHub - 1 maintainer
scrapy-fake-useragent 1.4.4
Use a random User-Agent provided by fake-useragent for every request12 versions - Latest release: over 3 years ago - 4 dependent packages - 121 dependent repositories - 41 thousand downloads last month - 678 stars on GitHub - 1 maintainer
Top 4.8% on pypi.org
47 versions - Latest release: 10 months ago - 34 dependent repositories - 547 downloads last month - 3,206 stars on GitHub - 1 maintainer
gerapy 0.9.13
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, D...47 versions - Latest release: 10 months ago - 34 dependent repositories - 547 downloads last month - 3,206 stars on GitHub - 1 maintainer
Top 3.3% on pypi.org
6 versions - Latest release: about 6 years ago - 3 dependent packages - 215 dependent repositories - 9.39 thousand downloads last month - 265 stars on GitHub - 2 maintainers
python-scrapyd-api 2.1.2
A Python wrapper for working with the Scrapyd API6 versions - Latest release: about 6 years ago - 3 dependent packages - 215 dependent repositories - 9.39 thousand downloads last month - 265 stars on GitHub - 2 maintainers
Top 1.5% on pypi.org
11 versions - Latest release: over 1 year ago - 5 dependent packages - 429 dependent repositories - 118 thousand downloads last month - 3,085 stars on GitHub - 4 maintainers
scrapy-splash 0.9.0
JavaScript support for Scrapy using Splash11 versions - Latest release: over 1 year ago - 5 dependent packages - 429 dependent repositories - 118 thousand downloads last month - 3,085 stars on GitHub - 4 maintainers
herodotus 0.1.0
Package for fast integration between SQLAlchemy models and Scrapy spiders1 version - Latest release: over 1 year ago - 643 downloads last month - 0 stars on GitHub - 2 maintainers
netkeiba 0.0.3
A Django app which crawls and imports race data from netkeiba.com1 version - Latest release: about 5 years ago - 1 dependent repositories - 16 downloads last month - 3 stars on GitHub - 2 maintainers
scrapyd-heroku 0.2.2
Wrapper for running Scrapyd in Heroku or locally as a service4 versions - Latest release: over 3 years ago - 5 dependent repositories - 40 downloads last month - 18 stars on GitHub - 2 maintainers
scrapy-promise 0.0.6
Promise-style workflow for Scrapy1 version - Latest release: over 3 years ago - 1 dependent repositories - 13 downloads last month - 2 maintainers
scrapy-kafka 0.1.1
Kafka-based components for Scrapy1 version - Latest release: over 8 years ago - 2 dependent repositories - 14 downloads last month - 81 stars on GitHub - 2 maintainers
scrapy-impersonate 1.3.0
Scrapy download handler that can impersonate browser fingerprints7 versions - Latest release: 19 days ago - 10.3 thousand downloads last month - 57 stars on GitHub - 2 maintainers
gzspidertools 0.0.18
魔改使用工具库18 versions - Latest release: about 1 month ago - 277 downloads last month - 1 maintainer
scrapejs 0.0.1
A lightweight Javascript-aware, headless web scraping library for Python2 versions - Latest release: over 7 years ago - 1 dependent repositories - 30 downloads last month - 4 stars on GitHub - 2 maintainers
Top 5.3% on pypi.org
8 versions - Latest release: 2 days ago - 7 dependent repositories - 14.9 thousand downloads last month - 348 stars on GitHub - 2 maintainers
scrapy-zyte-smartproxy 2.3.4
Scrapy middleware for Zyte Smart Proxy Manager8 versions - Latest release: 2 days ago - 7 dependent repositories - 14.9 thousand downloads last month - 348 stars on GitHub - 2 maintainers
scrapy-proxycrawl-middleware 1.2.0
Scrapy ProxyCrawl Proxy Middleware: ProxyCrawl interfacing middleware for Scrapy5 versions - Latest release: 10 months ago - 2 dependent repositories - 201 downloads last month - 10 stars on GitHub - 2 maintainers
spdclient 0.0.1
Python Wrapper for Scrapyd WebService1 version - Latest release: over 1 year ago - 11 downloads last month - 0 stars on GitHub - 2 maintainers
django-covid19 0.4rc1
A django app of covid-19 API in countries around the world, provinces and cities in China, and st...8 versions - Latest release: almost 4 years ago - 1 dependent repositories - 87 downloads last month - 153 stars on GitHub - 1 maintainer
Top 3.7% on pypi.org
18 versions - Latest release: 4 days ago - 14 dependent packages - 1,988 dependent repositories - 1.31 million downloads last month - 60 stars on GitHub - 6 maintainers
itemadapter 0.9.0
Common interface for data container classes18 versions - Latest release: 4 days ago - 14 dependent packages - 1,988 dependent repositories - 1.31 million downloads last month - 60 stars on GitHub - 6 maintainers
scrapy-ai 0.0.1
AI-powered scrapy plugin1 version - Latest release: 3 months ago - 28 downloads last month - 1 stars on GitHub - 2 maintainers
Top 2.8% on pypi.org
34 versions - Latest release: 4 months ago - 3 dependent packages - 22 dependent repositories - 35.5 thousand downloads last month - 839 stars on GitHub - 1 maintainer
scrapy-playwright 0.0.34
Playwright integration for Scrapy34 versions - Latest release: 4 months ago - 3 dependent packages - 22 dependent repositories - 35.5 thousand downloads last month - 839 stars on GitHub - 1 maintainer
scrapy-playwright-full 0.0.3404
Playwright integration for Scrapy6 versions - Latest release: 3 days ago - 67 downloads last month - 839 stars on GitHub - 2 maintainers
flake8-scrapy 0.0.1
A Flake8 plugin to catch common issues on Scrapy spiders1 version - Latest release: over 5 years ago - 1 dependent package - 5 dependent repositories - 51 downloads last month - 20 stars on GitHub - 1 maintainer
scrapy-processors 2.0.5
Provides processors for the itemloaders package, commonly used with scrapy.9 versions - Latest release: 3 days ago - 49 downloads last month - 0 stars on GitHub - 2 maintainers
scrapyproxyport 1.1.1
Proxy Port Scrapy middleware5 versions - Latest release: about 1 year ago - 1 dependent repositories - 40 downloads last month - 3 stars on GitHub - 2 maintainers
ml-scrapy 0.0.4
Components For Scrapy Project3 versions - Latest release: over 2 years ago - 1 dependent repositories - 18 downloads last month - 0 stars on GitHub - 2 maintainers
scrapy-prometheus 0.4.4
Exporting scrapy stats as prometheus metrics through pushgateway service9 versions - Latest release: over 6 years ago - 1 dependent repositories - 523 downloads last month - 6 stars on GitHub - 2 maintainers
scrapy-proxyland-middleware 1.0
Middleware to easily implement Proxyland in Scrapy projects1 version - Latest release: over 2 years ago - 1 dependent repositories - 11 downloads last month - 1 stars on GitHub - 2 maintainers
scrapy-count-filter 0.2.0
Scrapy Middleware for limiting requests based on a counter.2 versions - Latest release: over 4 years ago - 2 dependent repositories - 34 downloads last month - 7 stars on GitHub - 2 maintainers
scrapy-omdena-latam 0.0.2
Web Crawling application running Scrapy Tool extracting official policies2 versions - Latest release: over 3 years ago - 1 dependent repositories - 25 downloads last month - 0 stars on GitHub - 4 maintainers
pyspider-mark 0.3.10
兼容Python3.7的pyspider1 version - Latest release: almost 5 years ago - 1 dependent repositories - 31 downloads last month - 2 maintainers
scrapyc 0.0.4
Simple client to scrapyd. Done right.3 versions - Latest release: over 6 years ago - 1 dependent repositories - 24 downloads last month - 3 stars on GitHub - 2 maintainers
kafka-scrapy-connect 2.5.0
Integrating Scrapy with kafka using the confluent-kafka python client8 versions - Latest release: 2 months ago - 87 downloads last month - 6 stars on GitHub - 1 maintainer
Top 7.1% on pypi.org
3 versions - Latest release: about 9 years ago - 1 dependent package - 20 dependent repositories - 105 downloads last month - 3,085 stars on GitHub - 8 maintainers
scrapyjs 0.1.1
JavaScript support for Scrapy using Splash3 versions - Latest release: about 9 years ago - 1 dependent package - 20 dependent repositories - 105 downloads last month - 3,085 stars on GitHub - 8 maintainers
scrapy-qos 0.0.2
implement QOS(TokenBucket) in scrapy download middleware2 versions - Latest release: 4 months ago - 17 downloads last month - 2 maintainers
scrapy-redis-expiredupefilter 0.2.1
A distributed crawler component based on scrapy_redis which can specify the expiration time of fi...4 versions - Latest release: almost 5 years ago - 1 dependent repositories - 22 downloads last month - 11 stars on GitHub - 2 maintainers
Top 2.4% on pypi.org
57 versions - Latest release: 3 months ago - 4 dependent packages - 30 dependent repositories - 116 thousand downloads last month - 1,060 stars on GitHub - 1 maintainer
advertools 0.14.2
Productivity and analysis tools for online marketing57 versions - Latest release: 3 months ago - 4 dependent packages - 30 dependent repositories - 116 thousand downloads last month - 1,060 stars on GitHub - 1 maintainer
ska-advertools 0.14.0a8 removed
Digital Marketing productivity and analysis tools.1 version - Latest release: about 2 years ago - 693 stars on GitHub
thisisapogreq 21.3.3 💰
Faster & simpler requests replacement for Python1 version - Latest release: about 2 years ago - 1 dependent repositories - 14 downloads last month - 1,076 stars on GitHub - 2 maintainers
portiaitempipelineutils 0.0.1
Scrapy portia pipeline which allow you to do items related stuff.1 version - Latest release: almost 5 years ago - 1 dependent repositories - 16 downloads last month - 2 maintainers
leto 0.1.3
A crawler framework.15 versions - Latest release: almost 3 years ago - 1 dependent repositories - 121 downloads last month - 2 maintainers
ayugespidertools 3.9.7
scrapy 扩展库：用于扩展 Scrapy 功能来解放双手。88 versions - Latest release: 2 months ago - 1 dependent repositories - 431 downloads last month - 58 stars on GitHub - 1 maintainer
bookscrape 0.0.7
Scrape and build e-books from various websites25 versions - Latest release: about 5 years ago - 142 downloads last month - 10 stars on GitHub - 2 maintainers
Top 6.2% on pypi.org
10 versions - Latest release: over 2 years ago - 15 dependent repositories - 3.78 thousand downloads last month - 119 stars on GitHub - 2 maintainers
scrapyscript 1.1.5
Run a Scrapy spider programmatically from a script or a Celery task - no project required.10 versions - Latest release: over 2 years ago - 15 dependent repositories - 3.78 thousand downloads last month - 119 stars on GitHub - 2 maintainers
spider-admin-pro 2.0.13
a spider admin based vue, scrapyd api and APScheduler29 versions - Latest release: about 1 month ago - 1 dependent repositories - 301 downloads last month - 492 stars on GitHub - 1 maintainer
scrapy-xlsx 0.1.1
XLSX exporter for Scrapy2 versions - Latest release: about 5 years ago - 6 dependent repositories - 479 downloads last month - 25 stars on GitHub - 2 maintainers
scrapy-tdd 0.1.5
Helpers and examples to build Scrapy Crawlers in a test driven way.4 versions - Latest release: over 3 years ago - 809 downloads last month - 5 stars on GitHub - 1 maintainer
scrapy-script 1.0.0
Run a Scrapy spider programmatically from a script or a Celery task - no project required.1 version - Latest release: almost 4 years ago - 1 dependent repositories - 16 downloads last month - 2 stars on GitHub - 2 maintainers
scrapy-plus 1.0.5
scrapy 常用爬网必备工具包6 versions - Latest release: over 3 years ago - 1 dependent repositories - 32 downloads last month - 22 stars on GitHub - 2 maintainers
scrapy-beautifulsoup 0.0.2
Simple Scrapy middleware to process non-well-formed HTML with BeautifulSoup2 versions - Latest release: over 7 years ago - 1 dependent repositories - 811 downloads last month - 20 stars on GitHub - 2 maintainers
Top 5.5% on pypi.org
3 versions - Latest release: almost 5 years ago - 1 dependent package - 34 dependent repositories - 3.73 thousand downloads last month - 80 stars on GitHub - 2 maintainers
logparser 0.8.2
A tool for parsing Scrapy log files periodically and incrementally, designed for ScrapydWeb.3 versions - Latest release: almost 5 years ago - 1 dependent package - 34 dependent repositories - 3.73 thousand downloads last month - 80 stars on GitHub - 2 maintainers
scrapyer-redis 0.1.4
Redis-based components for Scrapy.4 versions - Latest release: over 1 year ago - 1 dependent repositories - 35 downloads last month - 5,448 stars on GitHub - 1 maintainer
scrapy-qiniu 0.1.2
Scrapy pipeline extension for qiniu.com3 versions - Latest release: over 8 years ago - 3 dependent repositories - 27 downloads last month - 24 stars on GitHub - 2 maintainers
scrapy-puppeteer 0.0.1b0
Scrapy with puppeteer1 version - Latest release: over 5 years ago - 1 dependent repositories - 41 downloads last month - 110 stars on GitHub - 2 maintainers
scrapy-requests 0.2.0
Scrapy with requests-html3 versions - Latest release: about 3 years ago - 1 dependent repositories - 101 downloads last month - 25 stars on GitHub - 2 maintainers
Top 4.3% on pypi.org
13 versions - Latest release: almost 5 years ago - 91 dependent repositories - 12.3 thousand downloads last month - 713 stars on GitHub - 4 maintainers
scrapy-rotating-proxies 0.6.2
Rotating proxies for Scrapy13 versions - Latest release: almost 5 years ago - 91 dependent repositories - 12.3 thousand downloads last month - 713 stars on GitHub - 4 maintainers
scrapyduler 1.0.2
Scrapyd launcher module that schedules scrapy spiders by time3 versions - Latest release: 4 months ago - 5 downloads last month - 1 stars on GitHub - 1 maintainer
scrapy-slackbot 0.3.0
A Scrapy extension to send notification to the Slack channel.2 versions - Latest release: over 1 year ago - 1 dependent repositories - 93 downloads last month - 9 stars on GitHub - 2 maintainers
Top 2.7% on pypi.org
42 versions - Latest release: 11 months ago - 2 dependent packages - 86 dependent repositories - 6.19 thousand downloads last month - 805 stars on GitHub - 4 maintainers
icrawler 0.6.7
A multi-thread crawler framework with many builtin image crawlers provided.42 versions - Latest release: 11 months ago - 2 dependent packages - 86 dependent repositories - 6.19 thousand downloads last month - 805 stars on GitHub - 4 maintainers
scrapygraphite 0.2
Output scrapy statistics to carbon/graphite.2 versions - Latest release: about 11 years ago - 1 dependent repositories - 14 downloads last month - 54 stars on GitHub - 2 maintainers
scrapy-sentry-sdk 0.4.1
Scrapy extension for integration of Sentry SDK to Scrapy projects6 versions - Latest release: over 3 years ago - 1 dependent repositories - 207 downloads last month - 5 stars on GitHub - 2 maintainers
gitleak 0.9.2.3
A tool library for searching your leaked sourcecode on github2 versions - Latest release: almost 7 years ago - 1 dependent repositories - 271 downloads last month - 18 stars on GitHub - 2 maintainers
parser-engine 0.1.4
template-driven parser engine for scrapy2 versions - Latest release: about 5 years ago - 1 dependent repositories - 11 downloads last month - 5 stars on GitHub - 4 maintainers
scrapyappsearch 0.1.0
Scrapy pipeline which allow you to store multiple scrapy items in AppSearch.1 version - Latest release: over 3 years ago - 1 dependent repositories - 11 downloads last month - 3 stars on GitHub - 2 maintainers
spiderkeeper-deploy 0.1.3
Deploy to SpiderKeeper2 versions - Latest release: over 5 years ago - 1 dependent repositories - 18 downloads last month - 2 stars on GitHub - 2 maintainers
Top 7.7% on pypi.org
6 versions - Latest release: about 3 years ago - 4 dependent repositories - 232 downloads last month - 400 stars on GitHub - 4 maintainers
wayback-machine-scraper 1.0.8
A command-line utility for scraping Wayback Machine snapshots from archive.org.6 versions - Latest release: about 3 years ago - 4 dependent repositories - 232 downloads last month - 400 stars on GitHub - 4 maintainers
scrapy-tor-proxy-rotation 0.0.4
IP Rotator for Scrapy via Tor4 versions - Latest release: about 1 year ago - 1 dependent repositories - 37 downloads last month - 26 stars on GitHub - 2 maintainers
crwy 1.7.1
A Simple Web Crawling and Web Scraping framework30 versions - Latest release: over 3 years ago - 98 downloads last month - 13 stars on GitHub - 2 maintainers
scrapy-athlinks 0.0.1
Web scraper for race results hosted on Athlinks.1 version - Latest release: over 1 year ago - 14 downloads last month - 0 stars on GitHub - 2 maintainers
zhihu-crawler 1.0.3
知乎关键词搜索、热榜、用户信息、回答、专栏文章、评论等信息的抓取程序6 versions - Latest release: about 2 years ago - 1 dependent repositories - 24 downloads last month - 26 stars on GitHub - 2 maintainers
scrapydd 0.7.5
distributed scrapy spider scheduling system46 versions - Latest release: over 3 years ago - 1 dependent repositories - 214 downloads last month - 5 stars on GitHub - 2 maintainers
s01.demo 0.16.2
Buildout based scrapy spider demo package for s01.worker3 versions - Latest release: over 11 years ago - 2 dependent repositories - 10 downloads last month - 4 maintainers
scrapy-new 0.2.1
A package providing code generation command for scrapy CLI17 versions - Latest release: almost 4 years ago - 1 dependent repositories - 110 downloads last month - 2 stars on GitHub - 2 maintainers
scrapy-multifeedexporter 0.1.1
Export scraped items of different types to multiple feeds.2 versions - Latest release: over 9 years ago - 3 dependent repositories - 13 downloads last month - 7 stars on GitHub - 2 maintainers
Top 8.1% on pypi.org
6 versions - Latest release: over 6 years ago - 5 dependent repositories - 110 downloads last month - 2,703 stars on GitHub - 1 maintainer
spiderkeeper 1.2.0
Admin ui for spider service6 versions - Latest release: over 6 years ago - 5 dependent repositories - 110 downloads last month - 2,703 stars on GitHub - 1 maintainer
stickymeta 0.0.5
Handy tools to maintain persistent meta values between requests in Scrapy spiders3 versions - Latest release: over 7 years ago - 2 dependent repositories - 23 downloads last month - 1 stars on GitHub - 2 maintainers
Top 1.6% on pypi.org
18 versions - Latest release: almost 2 years ago - 5 dependent packages - 392 dependent repositories - 7.04 thousand downloads last month - 5,448 stars on GitHub - 6 maintainers
scrapy-redis 0.7.3
Redis-based components for Scrapy.18 versions - Latest release: almost 2 years ago - 5 dependent packages - 392 dependent repositories - 7.04 thousand downloads last month - 5,448 stars on GitHub - 6 maintainers
scrapy-time-machine 1.1.1
A downloader middleware that stores the current request chain to be crawled at another time.3 versions - Latest release: 3 months ago - 1 dependent repositories - 96 downloads last month - 4 stars on GitHub - 4 maintainers
scrapyu 0.1.12
Scrapy utils3 versions - Latest release: over 4 years ago - 1 dependent repositories - 34 downloads last month - 1 stars on GitHub - 2 maintainers
scrapybox 0.1
A Scrapy GUI1 version - Latest release: about 8 years ago - 2 dependent repositories - 9 downloads last month - 12 stars on GitHub - 2 maintainers
scrapy-spiderstats-extension 0.0.2
Scrapy Spider Stats to MongoDB Extension2 versions - Latest release: over 3 years ago - 1 dependent repositories - 20 downloads last month - 2 stars on GitHub - 2 maintainers
moear-spider-zhihudaily 1.1.1
MoEar爬虫功能扩展插件 - 知乎日报5 versions - Latest release: almost 6 years ago - 1 dependent repositories - 37 downloads last month - 3 stars on GitHub - 2 maintainers
scrapy-fake-useragent-fix 0.1.1
Use a random User-Agent provided by fake-useragent for every request2 versions - Latest release: over 5 years ago - 1 dependent repositories - 49 downloads last month - 1 stars on GitHub - 2 maintainers
scrapy-httpproxy 0.0.5
A middleware of http proxy for Scrapy2 versions - Latest release: almost 6 years ago - 1 dependent repositories - 42 downloads last month - 4 stars on GitHub - 2 maintainers
Top 3.8% on pypi.org
5 versions - Latest release: over 5 years ago - 19 dependent packages - 94 dependent repositories - 161 thousand downloads last month - 92 stars on GitHub - 2 maintainers
random-user-agent 1.0.1
A package to get random user agents based filters provided by user5 versions - Latest release: over 5 years ago - 19 dependent packages - 94 dependent repositories - 161 thousand downloads last month - 92 stars on GitHub - 2 maintainers
scrapy-wayback-middleware 0.3.3
Scrapy middleware for submitting URLs to the Internet Archive Wayback Machine10 versions - Latest release: over 2 years ago - 11 dependent repositories - 1.08 thousand downloads last month - 10 stars on GitHub - 2 maintainers
scrapy-spiderdocs 0.1.3
Generate spiders md documentation based on spider docstrings.8 versions - Latest release: about 1 year ago - 1 dependent repositories - 37 downloads last month - 1 stars on GitHub - 2 maintainers
scrapy-random-useragent-pro 1.0.0
A random user-agent for all your needs1 version - Latest release: over 4 years ago - 1 dependent repositories - 29 downloads last month - 9 stars on GitHub - 2 maintainers
scrapydot 0.1
Export a graph of link between crawled items in dot file format.1 version - Latest release: over 12 years ago - 1 dependent repositories - 11 downloads last month - 26 stars on GitHub - 2 maintainers
sentry-scrapy 0.2
Scrapy integration with Sentry SDK (unofficial)2 versions - Latest release: over 5 years ago - 1 dependent repositories - 38 downloads last month - 7 stars on GitHub - 2 maintainers
scrapy-redis-ironman 0.1.0
Scrapy Redis Ironman1 version - Latest release: over 4 years ago - 1 dependent repositories - 10 downloads last month - 2 maintainers
fspider 1.1.0
基于asyncio异步爬虫网络框架，仿scrapy2 versions - Latest release: over 2 years ago - 1 dependent repositories - 12 downloads last month - 2 stars on GitHub - 1 maintainer
Related Keywords
python
80
crawler
67
spider
51
scraping
41
scraper
31
middleware
24
scrapyd
20
proxy
20
python3
19
crawling
17
redis
17
web-scraping
16
mongodb
14
web
14
distributed
13
pipeline
12
asyncio
11
kafka
10
scrapy-redis
9
cookiecutter
9
templates
9
requests
8
rabbitmq
8
scrapyd-ui
7
scrapy-extension
7
aiohttp
7
selenium
7
django
7
hacktoberfest
7
user-agent
6
crawl
6
api
6
plugin
6
extension
5
json-rpc
5
zope
5
elasticsearch
5
p01
5
zope3
5
async
5
s01
5
headless-browser
5
scheduler
5
data
5
frontier
5
dashboard
5
celery
4
search
4
scrapy-spider
4
package
4
news
4
spiders
4
html
4
scrapy-plugin
4
webscraping
4
data-science
4
webcrawler
4
extraction
4
webui
4
aws
4
twisted
4
buildout
4
httpx
4
scrapy-log-analysis
4
log-analysis
4
apscheduler
3
scrapyd-log-analysis
3
task-scheduling
3
high-availability
3
timing
3
ipproxy
3
client
3
cli
3
consume-confirm
3
utils
3
sqlachemy
3
framework
3
nimbus
3
wayback-machine
3
random
3
javascript-renderer
3
python-asyncio
3
item
3
pipelines
3
web-scraper
3
scrapyd-dashboard
3
scrapy-ui
3
scrapy-visualization
3
http
3
proxypool
3
scrapinghub
3
log-parsing
3
distributed-framework
3
mqtt
3
kombu
3
heroku
3
tor
3
open-data
3
function-scheduling
3
nsq
3