Ecosyste.ms: Packages
An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.
proxy.golang.org "crawler" keyword
Top 6.7% on proxy.golang.org
1 version - Latest release: about 6 years ago - 1 dependent repositories - 49 stars on GitHub
h12.io/html-query v0.0.0-20180505161840-775479db558c
Package query provides a fluent and functional interface for querying HTML DOM using Go. It is ba...1 version - Latest release: about 6 years ago - 1 dependent repositories - 49 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 3 years ago - 2 stars on GitHub
github.com/telanflow/scrago v0.0.0-20201104150845-85a6395b20ba
A micro crawler framework. achieved by GOLANG.1 version - Latest release: over 3 years ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
5 versions - Latest release: about 1 year ago - 50 stars on GitHub
github.com/edermi/skweez v0.0.0-20230325201447-db472a8f6d0f
Copyright © 2021 Michael Eder @edermi / twitter.com/michael_eder_ This program is free software:...5 versions - Latest release: about 1 year ago - 50 stars on GitHub
Top 1.1% on proxy.golang.org
7 versions - Latest release: about 1 year ago - 74 dependent packages - 67 dependent repositories - 1,880 stars on GitHub
github.com/geziyor/geziyor v0.0.0-20230315135110-a242b58aaa65
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.7 versions - Latest release: about 1 year ago - 74 dependent packages - 67 dependent repositories - 1,880 stars on GitHub
Top 8.2% on proxy.golang.org
3 versions - Latest release: over 2 years ago - 0 stars on GitHub
github.com/nyarla/net-paranoid-go v0.0.0-20220128023827-1f72d4cf809c
This package provide utilities for should be blocked about IP or hostname. This package made for...3 versions - Latest release: over 2 years ago - 0 stars on GitHub
Top 4.5% on proxy.golang.org
40 versions - Latest release: about 1 year ago - 5,242 stars on GitHub
github.com/montferret/ferret v0.18.0 💰
Declarative web scraping40 versions - Latest release: about 1 year ago - 5,242 stars on GitHub
Top 1.3% on proxy.golang.org
40 versions - Latest release: about 1 year ago - 15 dependent packages - 18 dependent repositories - 5,242 stars on GitHub
github.com/MontFerret/ferret v0.18.0 💰
Declarative web scraping40 versions - Latest release: about 1 year ago - 15 dependent packages - 18 dependent repositories - 5,242 stars on GitHub
Top 8.2% on proxy.golang.org
40 versions - Latest release: about 1 year ago - 5,242 stars on GitHub
github.com/Montferret/ferret v0.18.0 💰
Declarative web scraping40 versions - Latest release: about 1 year ago - 5,242 stars on GitHub
Top 5.6% on proxy.golang.org
16 versions - Latest release: 7 months ago - 1,809 stars on GitHub
github.com/thewhiteh4t/FinalRecon v1.1.6
The Last Web Recon Tool You'll Need16 versions - Latest release: 7 months ago - 1,809 stars on GitHub
Top 5.6% on proxy.golang.org
16 versions - Latest release: 7 months ago - 1,809 stars on GitHub
github.com/thewhiteh4t/finalrecon v1.1.6
The Last Web Recon Tool You'll Need16 versions - Latest release: 7 months ago - 1,809 stars on GitHub
github.com/tonnytg/webreq v1.3.0
Light way to make web request GET and POST easily using standard library http. This is a helpful ...12 versions - Latest release: 6 months ago - 2 dependent repositories - 4 stars on GitHub
Top 7.4% on proxy.golang.org
Latest release: about 9 hours ago - 0 stars on GitHub
github.com/hrvadl/goweekly/protos
Application for querying top articles from https://golangweekly.com/, translating them to Ukraini...Latest release: about 9 hours ago - 0 stars on GitHub
Top 7.4% on proxy.golang.org
Latest release: about 9 hours ago - 0 stars on GitHub
github.com/hrvadl/goweekly/core
Application for querying top articles from https://golangweekly.com/, translating them to Ukraini...Latest release: about 9 hours ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
8 versions - Latest release: 7 months ago - 1,898 stars on GitHub
github.com/DedSecInside/TorBot v4.0.0+incompatible 💰
Dark Web OSINT Tool8 versions - Latest release: 7 months ago - 1,898 stars on GitHub
Top 8.2% on proxy.golang.org
8 versions - Latest release: 7 months ago - 1,898 stars on GitHub
github.com/dedsecinside/torbot v4.0.0+incompatible 💰
Dark Web OSINT Tool8 versions - Latest release: 7 months ago - 1,898 stars on GitHub
Top 4.9% on proxy.golang.org
16 versions - Latest release: about 1 month ago - 740 stars on GitHub
github.com/edoardottt/cariddi v1.3.4
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, to...16 versions - Latest release: about 1 month ago - 740 stars on GitHub
Top 10.0% on proxy.golang.org
10 versions - Latest release: almost 5 years ago - 1 dependent package - 2 dependent repositories - 6 stars on GitHub
github.com/aerogo/crawler v0.2.5
:rowboat: Web crawler.10 versions - Latest release: almost 5 years ago - 1 dependent package - 2 dependent repositories - 6 stars on GitHub
Top 2.0% on proxy.golang.org
8 versions - Latest release: almost 3 years ago - 4 dependent packages - 7 dependent repositories - 2,009 stars on GitHub
github.com/PuerkitoBio/gocrawl v1.1.0 💰
Package gocrawl is a polite, slim and concurrent web crawler written in Go.8 versions - Latest release: almost 3 years ago - 4 dependent packages - 7 dependent repositories - 2,009 stars on GitHub
Top 7.7% on proxy.golang.org
2 versions - Latest release: over 1 year ago - 3 stars on GitHub
github.com/eversinc33/urlExtract v1.0.1
Recursively extract urls from a web page for reconnaissance.2 versions - Latest release: over 1 year ago - 3 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: almost 5 years ago - 6 stars on GitHub
github.com/tzxyz/webber v0.0.0-20190629152119-6ffd0bb5845d
基于golang实现的一个轻量级爬虫框架1 version - Latest release: almost 5 years ago - 6 stars on GitHub
Top 8.9% on proxy.golang.org
3 versions - Latest release: 7 months ago - 0 stars on GitHub
github.com/yusufaine/gocrawler v0.0.3
A simple concurrent webcrawler written in Go3 versions - Latest release: 7 months ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
10 versions - Latest release: over 2 years ago - 5 stars on GitHub
github.com/logocomune/botdetector v1.0.9
BotDetector is a golang library that detects Bot/Spider/Crawler from user agent10 versions - Latest release: over 2 years ago - 5 stars on GitHub
Top 7.7% on proxy.golang.org
2 versions - Latest release: 10 months ago - 9 stars on GitHub
github.com/maengsanha/instacrawler v0.0.0-20230727163850-eee38b25ac0e
KMU CS Capstone Design project: Instagram Meta Search Engine2 versions - Latest release: 10 months ago - 9 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 5 years ago - 7 stars on GitHub
github.com/gocrawler/bingbot v0.0.0-20181031221204-1830ed778ba8
A crawler that crawls search engine! 😎 Usable for collecting site with dorks and wildcards. Also ...1 version - Latest release: over 5 years ago - 7 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: about 6 years ago - 2 stars on GitHub
github.com/nakabonne/netsurfer v0.0.0-20180221140301-4e0db3b3936c
netsurfer is a very lightweight scraping framework1 version - Latest release: about 6 years ago - 2 stars on GitHub
Top 6.3% on proxy.golang.org
6 versions - Latest release: over 3 years ago - 35 stars on GitHub
github.com/andreaskoch/gargantua v0.5.0-alpha
The fast website crawler6 versions - Latest release: over 3 years ago - 35 stars on GitHub
Top 8.2% on proxy.golang.org
16 versions - Latest release: about 1 month ago - 740 stars on GitHub
github.com/edoardottt/Cariddi v1.3.4
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, to...16 versions - Latest release: about 1 month ago - 740 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: about 7 years ago - 0 stars on GitHub
github.com/dineshsprabu/concurrent-web-crawler v0.0.0-20170505055956-d21717df7b11
Concurrent Web Crawler is a light weight configurable crawler with concurrecy enabled. Configrati...1 version - Latest release: about 7 years ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 2 years ago - 0 stars on GitHub
github.com/indrasaputra/sulong v0.0.0-20211216113637-44fde6293eb3
Simple application that crawls a specific fundraising website and notifies users if there is a ne...1 version - Latest release: over 2 years ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
2 versions - Latest release: over 2 years ago - 1 stars on GitHub
github.com/fnkr/gocrawl v1.1.0
Simple web crawler.2 versions - Latest release: over 2 years ago - 1 stars on GitHub
Top 9.6% on proxy.golang.org
12 versions - Latest release: 21 days ago - 1 stars on GitHub
github.com/pzaino/thecrowler v0.9.2
Package main (TheCROWler) is the application. It's responsible for starting the crawler and kicks...12 versions - Latest release: 21 days ago - 1 stars on GitHub
Top 8.2% on proxy.golang.org
2 versions - Latest release: over 5 years ago - 36 stars on GitHub
github.com/crawlerclub/crawler v0.2.0
十年磨一剑：Crawler4U, a general purpose focused crawler2 versions - Latest release: over 5 years ago - 36 stars on GitHub
Top 9.6% on proxy.golang.org
47 versions - Latest release: 22 days ago - 3,020 stars on GitHub
github.com/hardkoded/puppeteer-sharp v17.0.0+incompatible 💰
Headless Chrome .NET API47 versions - Latest release: 22 days ago - 3,020 stars on GitHub
Top 10.0% on proxy.golang.org
1 version - Latest release: about 2 years ago - 3 dependent packages - 2 dependent repositories - 3 stars on GitHub
github.com/sauerbraten/chef v0.0.0-20220215195510-3ee2cbc2a6c9
Cube 2: Sauerbraten spy bot: collects IP-name combinations from extinfo and provides a web interf...1 version - Latest release: about 2 years ago - 3 dependent packages - 2 dependent repositories - 3 stars on GitHub
Top 8.2% on proxy.golang.org
5 versions - Latest release: almost 3 years ago - 1 stars on GitHub
github.com/hi20160616/youtube_web v0.0.5
A fetcher web for youtube.5 versions - Latest release: almost 3 years ago - 1 stars on GitHub
Top 7.8% on proxy.golang.org
4 versions - Latest release: over 1 year ago - 3 stars on GitHub
github.com/eric2788/platformscrawler v0.1.4
多平台爬蟲 + 模塊化管理，用於搜集資料並經 redis pubsub 發送4 versions - Latest release: over 1 year ago - 3 stars on GitHub
Top 7.9% on proxy.golang.org
2 versions - Latest release: 8 months ago - 23 stars on GitHub
github.com/bitxx/pholcus v1.0.1
对基于golang的henrylee2cn/pholcusl爬虫框架的修复和完善，满足自身需要2 versions - Latest release: 8 months ago - 23 stars on GitHub
Top 8.3% on proxy.golang.org
4 versions - Latest release: about 3 years ago - 2 stars on GitHub
github.com/empire/go-tse v0.0.4
Go client for http://www.tsetmc.com/4 versions - Latest release: about 3 years ago - 2 stars on GitHub
github.com/AhmadWaleed/go-scrapper v1.1.0
GO Scraper - an highly opinionated web-interface using go2 versions - Latest release: almost 4 years ago - 1 dependent repositories - 4 stars on GitHub
Top 8.2% on proxy.golang.org
2 versions - Latest release: about 5 years ago - 0 stars on GitHub
github.com/rapidclock/web-octopus v1.2.2
A concurent web crawler library written in Go.2 versions - Latest release: about 5 years ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: about 6 years ago - 88 stars on GitHub
github.com/rookmoot/proxifier v0.0.0-20180316152539-9922fc51a8e9
A fast, modern and intelligent proxy rotator perfect for crawling and scraping public data.1 version - Latest release: about 6 years ago - 88 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: almost 3 years ago - 5 stars on GitHub
github.com/florinutz/filme v0.0.0-20210524092642-07904314fb79 💰
Filme provides utilities for torrenting movies1 version - Latest release: almost 3 years ago - 5 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: about 4 years ago - 2 stars on GitHub
github.com/ericz99/go-crawler v0.0.0-20200325152842-2c4d4a42cb38
Simple lightweight crawler, that will find all endpoints on any website.1 version - Latest release: about 4 years ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: almost 7 years ago - 1 dependent package - 2 dependent repositories - 4 stars on GitHub
github.com/crawlerclub/x v0.1.0
A crawler framework1 version - Latest release: almost 7 years ago - 1 dependent package - 2 dependent repositories - 4 stars on GitHub
Top 6.8% on proxy.golang.org
9 versions - Latest release: about 1 year ago - 25 stars on GitHub
github.com/allanpk716/xray_pool v0.3.1
基于 Xray-core、glider 的代理池工具9 versions - Latest release: about 1 year ago - 25 stars on GitHub
Top 9.6% on proxy.golang.org
10 versions - Latest release: over 3 years ago - 1,713 stars on GitHub
github.com/howie6879/ruia v0.8.0
Async Python 3.6+ web scraping micro-framework based on asyncio10 versions - Latest release: over 3 years ago - 1,713 stars on GitHub
Top 2.7% on proxy.golang.org
12 versions - Latest release: almost 3 years ago - 1 dependent package - 2 dependent repositories - 1,884 stars on GitHub
github.com/jaeles-project/gospider v1.1.6 💰
Gospider - Fast web spider written in Go12 versions - Latest release: almost 3 years ago - 1 dependent package - 2 dependent repositories - 1,884 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: almost 7 years ago - 0 stars on GitHub
github.com/frobware/grawler v0.0.0-20170526072801-e4418206f032
Web Crawler1 version - Latest release: almost 7 years ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 5 years ago - 2 stars on GitHub
github.com/v-braun/hero-scrape v0.0.0-20181224225300-011d13fc2106
Find the hero (main) image of an URL1 version - Latest release: over 5 years ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 5 years ago - 15 stars on GitHub
github.com/datatogether/sentry v0.0.0-20181002124504-20d87104f196
Sentry is a service for archiving URL's with a clean, current, auditable trail of digital provena...1 version - Latest release: over 5 years ago - 15 stars on GitHub
github.com/oglinuk/goccer v0.3.0
Go Concurrent Crawler Library3 versions - Latest release: over 2 years ago - 1 dependent repositories - 1 stars on GitHub
Top 7.2% on proxy.golang.org
1 version - Latest release: about 4 years ago - 11 stars on GitHub
github.com/Koshqua/scrapio v0.0.0-20200504235533-2f0050d63ae3
Simple and easy-to-use scraper and crawler in Go.1 version - Latest release: about 4 years ago - 11 stars on GitHub
Top 8.2% on proxy.golang.org
2 versions - Latest release: about 2 years ago - 3 stars on GitHub
github.com/hktalent/scrapysite v0.0.6
ScrapySite,go Web Crawler（spider）, scraping，intelligence gathering2 versions - Latest release: about 2 years ago - 3 stars on GitHub
Top 8.2% on proxy.golang.org
15 versions - Latest release: almost 4 years ago - 0 stars on GitHub
github.com/KillianMeersman/wander v0.14.0-alpha
Package wander is a scraping library for Go. It aims to provide an easy to use API while also exp...15 versions - Latest release: almost 4 years ago - 0 stars on GitHub
Top 5.7% on proxy.golang.org
1 version - Latest release: over 2 years ago - 1 dependent repositories - 194 stars on GitHub
github.com/R4yGM/dorkscout v0.0.0-20210818101352-dd87daf1c10a
DorkScout - Golang tool to automate google dork scan against the entiere internet or specific tar...1 version - Latest release: over 2 years ago - 1 dependent repositories - 194 stars on GitHub
github.com/chamzzzzzz/supersimplesoup v0.0.0-20221231053842-410947423f1b
Package supersimplesoup implements a super simple soup like DOM API.2 versions - Latest release: over 1 year ago - 7 dependent packages - 1 dependent repositories - 0 stars on GitHub
Top 7.4% on proxy.golang.org
Latest release: 3 days ago - 1 stars on GitHub
github.com/RealAlexandreAI/sticky-hand
✋ Fetch webpage content into text using crawlers or AI at your command.Latest release: 3 days ago - 1 stars on GitHub
Top 7.4% on proxy.golang.org
6 versions - Latest release: 16 days ago - 1 stars on GitHub
github.com/realalexandreai/sticky-hand v0.0.6
✋ Fetch webpage content into text using crawlers or AI at your command.6 versions - Latest release: 16 days ago - 1 stars on GitHub
Top 7.2% on proxy.golang.org
1 version - Latest release: almost 4 years ago - 11 stars on GitHub
github.com/shadawck/recon-archy v0.0.1
Linkedin Tools (and maybe later other source) to reconstruct a company hierarchy from scraping re...1 version - Latest release: almost 4 years ago - 11 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 5 years ago - 0 stars on GitHub
github.com/igene/crawlptt v0.0.0-20181031081704-b994a3cc2d5e
Golang PTT 爬蟲 PTT crawler written in Golang1 version - Latest release: over 5 years ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 5 years ago - 0 stars on GitHub
github.com/iGene/crawlptt v0.0.0-20181031081704-b994a3cc2d5e
Golang PTT 爬蟲 PTT crawler written in Golang1 version - Latest release: over 5 years ago - 0 stars on GitHub
Top 7.7% on proxy.golang.org
1 version - Latest release: about 2 years ago - 3 stars on GitHub
github.com/markoczy/crawler v0.0.0-20220419131100-f71a1c166fea
A Web Crawler based on Go and Chromedp1 version - Latest release: about 2 years ago - 3 stars on GitHub
Top 8.2% on proxy.golang.org
8 versions - Latest release: almost 3 years ago - 2,009 stars on GitHub
github.com/puerkitobio/gocrawl v1.1.0 💰
Package gocrawl is a polite, slim and concurrent web crawler written in Go.8 versions - Latest release: almost 3 years ago - 2,009 stars on GitHub
Top 8.2% on proxy.golang.org
4 versions - Latest release: over 5 years ago - 2 stars on GitHub
github.com/danielnaveda/gocrawler v0.0.1
Simple web Crawler written in Golang4 versions - Latest release: over 5 years ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: almost 4 years ago - 0 stars on GitHub
github.com/foolishway/blog-crawler v1.0.0
blog-crawler crawl blogs by your configuration file.1 version - Latest release: almost 4 years ago - 0 stars on GitHub
Top 0.8% on proxy.golang.org
16 versions - Latest release: 24 days ago - 14 dependent packages - 9 dependent repositories - 20,363 stars on GitHub
github.com/iawia002/annie v0.24.0
👾 Fast and simple video download library and CLI tool written in Go16 versions - Latest release: 24 days ago - 14 dependent packages - 9 dependent repositories - 20,363 stars on GitHub
Top 1.4% on proxy.golang.org
15 versions - Latest release: 3 months ago - 5 dependent packages - 8 dependent repositories - 20,413 stars on GitHub
github.com/iawia002/lux v0.23.0
👾 Fast and simple video download library and CLI tool written in Go15 versions - Latest release: 3 months ago - 5 dependent packages - 8 dependent repositories - 20,413 stars on GitHub
Top 3.5% on proxy.golang.org
16 versions - Latest release: 7 months ago - 11 dependent packages - 11 dependent repositories - 81 stars on GitHub
github.com/foolin/pagser v0.1.6
Package pagser is a simple, easy, extensible, configurable HTML parser to struct based on goquery...16 versions - Latest release: 7 months ago - 11 dependent packages - 11 dependent repositories - 81 stars on GitHub
Top 8.2% on proxy.golang.org
2 versions - Latest release: almost 6 years ago - 6 stars on GitHub
github.com/tosone/GithubTraveler v1.1.0
Travel all of the GitHub users, orgs, repos.2 versions - Latest release: almost 6 years ago - 6 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: about 4 years ago - 1 stars on GitHub
github.com/StanGirard/CrawlyColly v0.0.0-20200420205957-9abf1456cc61
Website Crawler to extract all urls1 version - Latest release: about 4 years ago - 1 stars on GitHub
Top 8.2% on proxy.golang.org
8 versions - Latest release: over 3 years ago - 20 stars on GitHub
github.com/alanshaw/libp2p-dht-scrape-aas v0.5.0
🧹 A libp2p DHT scraper as a service allowing anyone to collect, consume and use to generate usefu...8 versions - Latest release: over 3 years ago - 20 stars on GitHub
Top 8.2% on proxy.golang.org
3 versions - Latest release: over 2 years ago - 1 stars on GitHub
github.com/qhzhyt/go-crawler v0.0.3
A simple crawler library implement with Golang3 versions - Latest release: over 2 years ago - 1 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: almost 3 years ago - 30 stars on GitHub
github.com/davidleitw/goGamer v0.0.0-20210803064159-1004ae7a3f8c
巴哈姆特自訂API1 version - Latest release: almost 3 years ago - 30 stars on GitHub
Top 8.0% on proxy.golang.org
3 versions - Latest release: 7 months ago - 4 stars on GitHub
github.com/kevincobain2000/go-app-reviews-scraper v0.0.0-20231022084959-74838b34e9c3
Apple app store reviews and ratings scraper.3 versions - Latest release: 7 months ago - 4 stars on GitHub
Top 5.5% on proxy.golang.org
Latest release: 4 days ago - 110 stars on GitHub
github.com/twiny/spidy
Domain names collector - Crawl websites and collect domain names along with their availability st...Latest release: 4 days ago - 110 stars on GitHub
Top 5.5% on proxy.golang.org
2 versions - Latest release: over 1 year ago - 110 stars on GitHub
github.com/twiny/spidy/v2 v2.0.1
Domain names collector - Crawl websites and collect domain names along with their availability st...2 versions - Latest release: over 1 year ago - 110 stars on GitHub
Top 8.2% on proxy.golang.org
2 versions - Latest release: almost 2 years ago - 0 stars on GitHub
github.com/ekinbulut/gdiff v1.0.1
A simple web crawler2 versions - Latest release: almost 2 years ago - 0 stars on GitHub
Top 6.1% on proxy.golang.org
5 versions - Latest release: about 1 year ago - 156 stars on GitHub
github.com/wujunwei928/parse-video v0.0.0-20230506225948-6b68539e6f2b
Golang短视频去水印：抖音,皮皮虾,火山,微视,最右,快手,全民小视频,皮皮搞笑,西瓜视频,虎牙,梨视频,acfun,好看视频...5 versions - Latest release: about 1 year ago - 156 stars on GitHub
Top 8.2% on proxy.golang.org
6 versions - Latest release: almost 3 years ago - 775 stars on GitHub
github.com/puerkitobio/fetchbot v1.4.0 💰
Package fetchbot provides a simple and flexible web crawler that follows the robots.txt policies ...6 versions - Latest release: almost 3 years ago - 775 stars on GitHub
Top 6.8% on proxy.golang.org
8 versions - Latest release: 11 months ago - 269 stars on GitHub
github.com/malwarize/webpalm v1.1.1
WebPalm is a powerful command-line tool for website mapping and web scraping. With its recursive ...8 versions - Latest release: 11 months ago - 269 stars on GitHub
Top 6.8% on proxy.golang.org
18 versions - Latest release: 3 months ago - 269 stars on GitHub
github.com/malwarize/webpalm/v2 v2.0.18
WebPalm is a powerful command-line tool for website mapping and web scraping. With its recursive ...18 versions - Latest release: 3 months ago - 269 stars on GitHub
Top 6.8% on proxy.golang.org
18 versions - Latest release: 3 months ago - 269 stars on GitHub
github.com/Malwarize/webpalm/v2 v2.0.18
WebPalm is a powerful command-line tool for website mapping and web scraping. With its recursive ...18 versions - Latest release: 3 months ago - 269 stars on GitHub
Top 6.8% on proxy.golang.org
8 versions - Latest release: 11 months ago - 269 stars on GitHub
github.com/Malwarize/webpalm v1.1.1
WebPalm is a powerful command-line tool for website mapping and web scraping. With its recursive ...8 versions - Latest release: 11 months ago - 269 stars on GitHub
Top 2.1% on proxy.golang.org
13 versions - Latest release: over 1 year ago - 3 dependent packages - 3 dependent repositories - 2,357 stars on GitHub
github.com/Qianlitp/crawlergo v0.4.4
A powerful browser crawler for web vulnerability scanners13 versions - Latest release: over 1 year ago - 3 dependent packages - 3 dependent repositories - 2,357 stars on GitHub
Top 6.4% on proxy.golang.org
7 versions - Latest release: about 5 years ago - 2 dependent packages - 27 stars on GitHub
github.com/terorie/od-database-crawler v1.2.2
OD-Database Go crawler7 versions - Latest release: about 5 years ago - 2 dependent packages - 27 stars on GitHub
Top 2.6% on proxy.golang.org
1 version - Latest release: over 4 years ago - 10 dependent packages - 17 dependent repositories - 99 stars on GitHub
github.com/badoux/goscraper v0.0.0-20190827161153-36995ce6b19f
Golang pkg to quickly return a preview of a webpage (title/description/images)1 version - Latest release: over 4 years ago - 10 dependent packages - 17 dependent repositories - 99 stars on GitHub
Top 3.4% on proxy.golang.org
1 version - Latest release: about 5 years ago - 6 dependent packages - 6 dependent repositories - 124 stars on GitHub
github.com/storyicon/graphquery v0.0.0-20190317074716-6a20a75cd98f
GraphQuery is a query language and execution engine tied to any backend service.1 version - Latest release: about 5 years ago - 6 dependent packages - 6 dependent repositories - 124 stars on GitHub
Top 8.2% on proxy.golang.org
13 versions - Latest release: over 1 year ago - 2,357 stars on GitHub
github.com/qianlitp/crawlergo v0.4.4
A powerful browser crawler for web vulnerability scanners13 versions - Latest release: over 1 year ago - 2,357 stars on GitHub
github.com/hueristiq/xcrawl3r v0.0.0-20230602162649-417e374b8ea5
A CLI utility to recursively crawl webpages.1 version - Latest release: 12 months ago - 5 stars on GitHub
Top 8.2% on proxy.golang.org
6 versions - Latest release: over 8 years ago - 119 stars on GitHub
github.com/nasa-jpl-memex/memex-explorer v0.4.0
Viewers for statistics and dashboarding of Domain Search Engine data6 versions - Latest release: over 8 years ago - 119 stars on GitHub
Top 5.4% on proxy.golang.org
2 versions - Latest release: over 4 years ago - 149 stars on GitHub
github.com/trandoshan-io/crawler v0.0.0-20191219080745-a2c0119c1b14
Go process used to crawl websites2 versions - Latest release: over 4 years ago - 149 stars on GitHub
Top 5.3% on proxy.golang.org
1 version - Latest release: over 2 years ago - 149 stars on GitHub
github.com/saeeddhqan/evine v0.0.0-20211015222239-46051ded7145
Interactive CLI Web Crawler1 version - Latest release: over 2 years ago - 149 stars on GitHub
github.com/dreamingtech/imoocgocrawler v0.0.0-20230804015534-ceee0dcc56b9
distributed crawler project from imooc go course by ccmouse. 分布式爬虫项目-Google资深工程师深度讲解Go语言1 version - Latest release: 10 months ago - 0 stars on GitHub
Top 2.3% on proxy.golang.org
6 versions - Latest release: almost 3 years ago - 4 dependent packages - 12 dependent repositories - 775 stars on GitHub
github.com/PuerkitoBio/fetchbot v1.4.0 💰
Package fetchbot provides a simple and flexible web crawler that follows the robots.txt policies ...6 versions - Latest release: almost 3 years ago - 4 dependent packages - 12 dependent repositories - 775 stars on GitHub
Top 7.8% on proxy.golang.org
1 version - Latest release: almost 2 years ago - 1 stars on GitHub
github.com/sudoLife/shopify v0.0.0-20220731162310-6fc91e375af6
An easy-to-use crawler to keep track of reviews of an app on Shopify.1 version - Latest release: almost 2 years ago - 1 stars on GitHub
Top 8.2% on proxy.golang.org
1 version - Latest release: over 5 years ago - 3 stars on GitHub
github.com/ernesto-jimenez/crawler v0.0.0-20181005204911-67712f94df18
Easily crawl websites in Go.1 version - Latest release: over 5 years ago - 3 stars on GitHub
Top 5.3% on proxy.golang.org
8 versions - Latest release: over 1 year ago - 204 stars on GitHub
github.com/Ptt-Alertor/ptt-alertor v3.0.0+incompatible
:loudspeaker: Ptt 文章通知機器人！Notify Ptt Article in Realtime8 versions - Latest release: over 1 year ago - 204 stars on GitHub
Top 5.3% on proxy.golang.org
1 version - Latest release: about 6 years ago - 1 dependent repositories - 140 stars on GitHub
github.com/go-crawler/douban-movie v0.0.0-20180321035844-73b936237b8a
Golang爬虫 爬取豆瓣电影Top2501 version - Latest release: about 6 years ago - 1 dependent repositories - 140 stars on GitHub
Top 6.9% on proxy.golang.org
2 versions - Latest release: 7 months ago - 71 stars on GitHub
github.com/ethereum/node-crawler v0.0.0-20231016092432-484b21b126e6
Attempts to crawl the Ethereum network of valid Ethereum execution nodes and visualizes them in a...2 versions - Latest release: 7 months ago - 71 stars on GitHub
Top 9.0% on proxy.golang.org
1 version - Latest release: almost 2 years ago - 0 stars on GitHub
github.com/greytabby/grawl v0.0.0-20220617150153-27509e8526bb
Simple web crawler for learning.1 version - Latest release: almost 2 years ago - 0 stars on GitHub
Related Keywords
golang
168
go
123
spider
77
scraper
53
scraping
32
crawling
31
framework
20
osint
16
security
13
cli
13
web
13
web-crawler
12
hacktoberfest
11
webcrawler
9
concurrency
8
tool
8
colly
8
bugbounty
8
sitemap
8
telegram-bot
8
web-spider
8
scanner
8
penetration-testing
7
reconnaissance
7
data-mining
7
chrome
7
ptt
7
headless
7
json
6
concurrent
6
youtube
6
automation
6
recon
6
infosec
6
scrapy
6
github
6
hack
6
ipfs
6
telegram
6
scraping-websites
6
html
6
dom
6
pentesting
6
parser
6
library
6
api
5
chrome-devtools
5
python
5
headless-chrome
5
security-tools
5
testing
5
bot
5
docker
5
bug-bounty
5
bugbounty-tool
5
seo
5
scrapper
5
proxypool
5
gospider
5
redis
5
dsl
5
downloader
5
python3
5
video
5
libp2p
4
website
4
proxy
4
url-extractor
4
javascript
4
proxy-server
4
web-scraping
4
search-engine
4
messenger-bot
4
linebot
4
chatbot
4
pentest
4
domain
4
bilibili
4
redteam
4
graph
4
elasticsearch
4
puppeteer
4
subdomain-enumeration
4
robots-txt
4
spider-framework
4
gocrawler
4
commoncrawl
4
audit
4
bitbucket
4
cache
4
web3
4
hacking
4
tor
4
nodejs
3
sitemap-generator
3
cdp
3
webpage
3
download
3
slp
3
iqiyi
3