proxy.golang.org : github.com/lizongying/go-crawler
A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middleware and supports various parsing and storage methods. Additionally, it supports distributed deployment. 基于golang实现的爬虫框架，编写简单，性能强劲。内置了丰富的实用中间件，支持多种解析、保存方式，支持分布式部署。
Registry
-
Source
- Documentation
- JSON
purl: pkg:golang/github.com/lizongying/go-crawler
Keywords:
crawler
, golang
, scraping
, scrapy
, spider
License:
Latest release: 6 months ago
First release: over 2 years ago
Namespace: github.com/lizongying
Stars: 139 on GitHub
Forks: 19 on GitHub
See more repository details: repos.ecosyste.ms
Last synced: 29 days ago