Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

pypi.org : web-crawler-plus

A micro-framework to crawl the web pages with crawlers configs. It can use MongoDB, Elasticsearch and Solr databases to cache and save the extracted data.

Registry - Source - Documentation - JSON
purl: pkg:pypi/web-crawler-plus
Keywords: crawler, elasticsearch, mongodb, parser-configs, python, scrapy
License:
Latest release: about 6 years ago
First release: about 6 years ago
Dependent repositories: 1
Downloads: 61 last month
Stars: 31 on GitHub
Forks: 9 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: about 1 month ago

    Loading...
    Readme
    Loading...