Ecosyste.ms: Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

proxy.golang.org "colly" keyword

Top 9.7% on proxy.golang.org
github.com/yizhezhang-ervin/backend_golang v0.0.0-20240118125522-99cc9aaab47b
Frameworks By Golang (Beego/Gin/Colly/GoMicro/GoChain/Fyne)
2 versions - Latest release: 5 months ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/hezhizheng/go-movies v1.0.0
golang spider Crawler 爬虫 电影
1 version - Latest release: about 4 years ago - 204 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/yizhezhang-ervin/tmpl_beego
Frameworks By Golang (Beego/Gin/Colly/GoMicro/GoChain/Fyne)
Latest release: about 1 month ago - 2 stars on GitHub
Top 9.2% on proxy.golang.org
github.com/ithrael/xspider v0.0.3
XSpider是一款高效的站点爬虫工具，采用深度遍历策略，持续发现并访问页面中的新链接。
3 versions - Latest release: 4 months ago - 0 stars on GitHub
Top 9.2% on proxy.golang.org
github.com/ithrael/XSpider v0.0.3
XSpider是一款高效的站点爬虫工具，采用深度遍历策略，持续发现并访问页面中的新链接。
3 versions - Latest release: 4 months ago - 0 stars on GitHub
github.com/ngshiheng/michelin-my-maps/v2 v2.2.3 💰
Go Colly spider which curates a list of awesome restaurants from the Michelin Guide
29 versions - Latest release: 24 days ago - 15 stars on GitHub
Top 8.0% on proxy.golang.org
github.com/ngshiheng/michelin-my-maps v1.7.8 💰
Go Colly spider which curates a list of awesome restaurants from the Michelin Guide
35 versions - Latest release: 10 months ago - 13 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/QIN2DIM/istockphoto-go v0.0.0-20230217133935-4f724564f954
📸 Gracefully download dataset from iStockPhoto.
2 versions - Latest release: over 1 year ago - 2 stars on GitHub
Top 9.0% on proxy.golang.org
github.com/sabiennguyen/poke-scraper
tool that allows users to collect filtered data on pokemon from the pokemondb database!
Latest release: about 1 month ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/gotneb/manga_api v0.0.0-20230415235545-9626b3f7d60d
A simple manga api whose scrape data from manga websites.
3 versions - Latest release: about 1 year ago - 3 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/jph5396/sumoscrape v0.1.1
Gather Sumo data from the web
2 versions - Latest release: over 3 years ago - 3 stars on GitHub
Top 8.3% on proxy.golang.org
github.com/jamesjarvis/web-graph v0.1.0
Experiment with web scraping
1 version - Latest release: about 3 years ago - 0 stars on GitHub
github.com/ecshreve/jepp v0.2.1
api fun with jeopardy!
19 versions - Latest release: 11 months ago - 3 stars on GitHub
Top 9.7% on proxy.golang.org
github.com/luckylittle/dzone-refcardz-downloader v0.0.0-20221012065533-b122f16f8f8b
Downloads all refcardz from https://dzone.com/refcardz
1 version - Latest release: over 1 year ago - 15 stars on GitHub
Top 8.3% on proxy.golang.org
github.com/ductnn/cUrls v0.0.0-20220730110507-c46b8513ed2c
Simple tool crawler URLs form domain
1 version - Latest release: almost 2 years ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/stangirard/crawlycolly v0.0.0-20200420205957-9abf1456cc61
Website Crawler to extract all urls
1 version - Latest release: about 4 years ago - 1 stars on GitHub
Top 9.8% on proxy.golang.org
github.com/nronzel/realescrape-go v0.0.0-20230811190720-1a624b73719f
Extracts listings from Realtor.com
1 version - Latest release: 10 months ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/alibo/gosubscene v0.0.1
A simple API wrapper for https://subscene.com written in golang
1 version - Latest release: about 4 years ago - 7 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/xilaluna/fentanyl-epidemic-tracker v0.0.0-20220905215917-a6606ebafaf7
A go scraper that identifies articles relating to fentanyl to map the trend of the fentanyl epide...
1 version - Latest release: over 1 year ago - 15 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/Antonio-Costa00/Go-Price-Monitor v0.0.0-20221222235409-006b425cf51c
Price monitor using Go that sends a message to the user whatsapp if the product it's on sale
2 versions - Latest release: over 1 year ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/est5/gohltv v0.0.0-20220517135416-519c6cce7852
Unofficial hltv.org api
1 version - Latest release: about 2 years ago - 1 stars on GitHub
Top 9.8% on proxy.golang.org
github.com/luckylittle/aws-whitepapers-downloader v0.0.0-20221012065451-e90de7d3bfcc
Golang downloader for all AWS whitepapers
1 version - Latest release: over 1 year ago - 5 stars on GitHub
Top 7.0% on proxy.golang.org
github.com/elonzh/colly-bolt-storage v0.1.0
Simple and fast storage for colly, built on top of bolt.
3 versions - Latest release: over 4 years ago - 7 stars on GitHub
Top 9.0% on proxy.golang.org
github.com/rea1shane/corder v0.1.1
Recorder for Colly program.
2 versions - Latest release: almost 2 years ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/sb-child/lsp v0.0.0-20211106041857-87487f793538
python 爬虫, golang 爬虫: 某网站视频爬取下载工具 完美适配 miya(蜜芽)和 yysp(夜夜视频, 夜夜視頻)
1 version - Latest release: over 2 years ago - 25 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/kangoo13/proxy-checker v1.0.0
Check for a set of proxies different conditions, is the proxy working, does the proxy bypass clou...
1 version - Latest release: about 4 years ago - 13 stars on GitHub
Top 3.5% on proxy.golang.org
github.com/foolin/pagser v0.1.6
Package pagser is a simple, easy, extensible, configurable HTML parser to struct based on goquery...
16 versions - Latest release: 8 months ago - 13 dependent packages - 11 dependent repositories - 81 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/eval-exec/goodreads v0.0.0-20211022042328-115bae410d3b
Copyright © 2019 Eval-EXEC <[email protected]> Permission is hereby granted, free of charge, to a...
2 versions - Latest release: over 2 years ago - 4 stars on GitHub
Top 8.0% on proxy.golang.org
github.com/zolamk/colly-mongo-storage v0.0.0-20190324054405-abf7ea547b23
MongoDB Storage For Colly
1 version - Latest release: about 5 years ago - 1 dependent repositories - 21 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/StanGirard/CrawlyColly v0.0.0-20200420205957-9abf1456cc61
Website Crawler to extract all urls
1 version - Latest release: about 4 years ago - 1 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/youngjuning/homebrew-juejin-spider v0.1.0
爬取掘金专栏并转为Markdown保存到本地
2 versions - Latest release: almost 4 years ago - 13 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/chakrakan/radiant
🎮 Grab your valorant rank and display it in a gist
Latest release: 25 days ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/youngkingman/gentlemanspider v0.0.2
基于colly，支持标签(xp)筛选和多线程加速的绅士漫画爬虫优雅实现
2 versions - Latest release: over 1 year ago - 40 stars on GitHub
github.com/Youngkingman/gentlemanSpider v0.0.2
基于colly，支持标签(xp)筛选和多线程加速的绅士漫画爬虫优雅实现
2 versions - Latest release: over 1 year ago - 41 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/ocelotsloth/nflscores v0.0.0-20200510034257-a8fd42dd9c20
Scraping utility which generates spreadsheet of NFL Weekly Scores
1 version - Latest release: about 4 years ago - 0 stars on GitHub
Top 9.3% on proxy.golang.org
github.com/rustyeddy/crawl
Website Baby Sitter
Latest release: 26 days ago - 4 stars on GitHub
github.com/matheusgb/go-jobs-crawler v0.0.0-20230927001955-3133ff2635a1
A job vacancy data scraper.
1 version - Latest release: 8 months ago - 0 stars on GitHub
Top 8.0% on proxy.golang.org
github.com/k-d-k/countwords
Project to count words used on the website by scraping.
Latest release: 29 days ago - 0 stars on GitHub
Top 8.0% on proxy.golang.org
github.com/thebluemagician/go-rest-scrape/services/database
A simple Go project, Implementing Colly library for scraping, Storing documents in Elastisearch a...
Latest release: 29 days ago - 0 stars on GitHub
Top 8.3% on proxy.golang.org
github.com/sabiennguyen/golang-webscraper
tool that allows users to collect filtered data on pokemon from the pokemondb database!
Latest release: 29 days ago - 0 stars on GitHub
Top 8.3% on proxy.golang.org
github.com/hylim-tech-lover/web-scraper-go
A web scraper with Go as education purpose. Can be used as microservices
Latest release: 29 days ago - 0 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/rustyeddy/moni
Website Baby Sitter
Latest release: 29 days ago - 4 stars on GitHub
Top 8.0% on proxy.golang.org
github.com/tohanilhan/scraper-golang
This is a simple scraper that scrapes data from dolap.com
Latest release: 29 days ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/zhshch2002/gospIDer v1.0.0
⚡ Light weight Golang spider framework | 轻量的 Golang 爬虫框架
1 version - Latest release: about 3 years ago - 185 stars on GitHub
Top 8.3% on proxy.golang.org
github.com/shihanng/webdl
Simple CLI tool to archive web pages using Colly.
Latest release: about 1 month ago - 0 stars on GitHub
Top 4.9% on proxy.golang.org
github.com/zhshch2002/gospider v1.0.0
⚡ Light weight Golang spider framework | 轻量的 Golang 爬虫框架
1 version - Latest release: about 3 years ago - 1 dependent package - 1 dependent repositories - 185 stars on GitHub
Top 8.3% on proxy.golang.org
github.com/thebluemagician/go-rest-scrape/services/product
A simple Go project, Implementing Colly library for scraping, Storing documents in Elastisearch a...
Latest release: about 1 month ago - 0 stars on GitHub
Top 9.4% on proxy.golang.org
github.com/milindmadhukar/stonksapi
An API to provide with stocks,crypto data and news.
Latest release: about 1 month ago - 3 stars on GitHub
Related Keywords
golang 39 go 21 scraper 9 spider 8 crawler 8 gocolly 4 mongodb 3 webscraping 3 fyne 3 hentai 2 erohon 2 downloader 2 monitoring 2 rest 2 discover 2 crawl 2 gin-gonic 2 api 2 gospider 2 spider-framework 2 sitemap 2 webscraper 2 pokemon 2 restaurants 2 michelin 2 redis 2 html 2 beego 2 gochain 2 go-micro 2 gin 2 goquery 1 deserialization 1 proxy-checker 1 proxy-ban-checker 1 proxy-al 1 proxies-detected 1 proxies-checker 1 multiprocessing 1 cloudflare-checker 1 cloudflare-bypass 1 python 1 requests 1 video 1 ban-checker 1 page 1 parser 1 scrapy 1 goodreads 1 goodreads-quotes 1 trackergg 1 valorant 1 csv 1 nfl 1 crypto 1 cryptocurrency 1 finance 1 go-chi 1 stock 1 stocks 1 subscene 1 url 1 scanning 1 domain 1 scraping 1 refcardz 1 go-colly 1 dzone 1 scrape 1 jeopardy 1 web-graph 1 database 1 scraping-websites 1 manga-scraper 1 istockphoto 1 movies 1 fasthttp 1 docker 1 m3u8 1 ffmpeg 1 decrypt 1 beautifulsoup4 1 boltdb 1 bolt 1 whitepapers 1 aws 1 amazon-web-services 1 logrus 1 hltv-scraper 1 hltv-api 1 gorilla-mux 1 whatsapp 1 postgresql 1 gui 1 gorm 1 subtitles 1