An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

proxy.golang.org "web-scraping" keyword

View the packages on the proxy.golang.org package registry that are tagged with the "web-scraping" keyword.

Top 9.0% on proxy.golang.org
github.com/commonkestrel/lexos-cli v0.0.0-20230123160435-954b32a00a3f
A tool for gathering Lexile and Atos(AR) levels from an ISBN.
1 version - Latest release: over 2 years ago - 0 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/mherrmann/selenium-python-helium v5.1.1+incompatible
Lighter web automation for Python
27 versions - Latest release: 8 months ago - 4,094 stars on GitHub
Top 6.5% on proxy.golang.org
github.com/mintplex-labs/anything-llm v1.8.5 💰
The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builde...
20 versions - Latest release: about 2 months ago - 49,335 stars on GitHub
Top 6.5% on proxy.golang.org
github.com/Mintplex-Labs/anything-llm v1.8.5 💰
The all-in-one Desktop & Docker AI application with built-in RAG, AI agents, No-code agent builde...
20 versions - Latest release: about 2 months ago - 49,335 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/0x676e67/wreq v5.3.0+incompatible 💰
An ergonomic Rust HTTP Client with TLS fingerprint
63 versions - Latest release: 2 months ago - 433 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/scrapegraphai/scrapegraph-ai v1.62.0 💰
Python scraper based on AI
429 versions - Latest release: about 2 months ago - 21,328 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/ScrapeGraphAI/Scrapegraph-ai v1.62.0 💰
Python scraper based on AI
429 versions - Latest release: about 2 months ago - 21,328 stars on GitHub
Top 0.8% on proxy.golang.org
github.com/go-rod/rod v0.116.2 💰
Package rod is a high-level driver directly based on DevTools Protocol. This example opens https...
368 versions - Latest release: about 1 year ago - 353 dependent packages - 1,118 dependent repositories - 6,285 stars on GitHub
Top 7.4% on proxy.golang.org
github.com/gipsh/miradetodo-scrapper
extract links from miradetodo.co
Latest release: 1 day ago - 2 stars on GitHub
Top 5.7% on proxy.golang.org
github.com/gildas-lormeau/single-file-cli v2.0.75+incompatible
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on Single...
63 versions - Latest release: 8 months ago - 805 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/datahenhq/useragent v0.1.0
DataHen useragent tool is a Golang package and standalone tool that generates a random combinatio...
1 version - Latest release: over 4 years ago - 10 stars on GitHub
Top 6.5% on proxy.golang.org
github.com/infinilabs/crawler v0.11.0 💰
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
4 versions - Latest release: about 7 years ago - 309 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/apify/crawlee v3.12.0+incompatible
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In ...
624 versions - Latest release: 11 months ago - 19,547 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/postmodern/spidr v0.7.2 💰
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or...
16 versions - Latest release: 8 months ago - 825 stars on GitHub
Top 9.0% on proxy.golang.org
github.com/thetardigrade/golang-cachedpagedownloader v1.4.14
Go package to download webpages, or access previously cached versions of them.
25 versions - Latest release: over 2 years ago - 0 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/0x676e67/rquest v5.3.0+incompatible 💰
A blazing-fast Rust HTTP Client with TLS fingerprint
66 versions - Latest release: 2 months ago - 247 stars on GitHub
Top 7.5% on proxy.golang.org
github.com/DataHenHQ/useragent v0.1.0
DataHen useragent tool is a Golang package and standalone tool that generates a random combinatio...
1 version - Latest release: over 4 years ago - 3 dependent packages - 2 dependent repositories - 10 stars on GitHub
Top 2.9% on proxy.golang.org
github.com/ysmood/rod v0.116.2 💰
Open github, search for "git" The launcher lib comes with a lot of default switches (flags) to ...
368 versions - Latest release: about 1 year ago - 2 dependent packages - 1 dependent repositories - 3,524 stars on GitHub
github.com/cyclone-github/spider v0.9.0
Spider - web crawler and local wordlist processor to generate frequency sorted wordlist / ngrams
5 versions - Latest release: 5 months ago - 24 stars on GitHub
Top 4.1% on proxy.golang.org
github.com/intoli/user-agents v1.0.1096
A JavaScript library for generating random user agents with data that's updated daily.
1,773 versions - Latest release: about 3 years ago - 1,103 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/yusuftaufiq/laravel-books-api v1.0.1
Fully documented & tested Laravel 9 RESTful books API scraped from Gramedia.
2 versions - Latest release: over 3 years ago - 67 stars on GitHub
Top 9.9% on proxy.golang.org
github.com/gpsyrou/tube-virality v0.0.0-20240112232404-57b3fc6b008c
The YouTube Virality project collects and analyzes trending video data from multiple countries us...
4 versions - Latest release: over 1 year ago - 20 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/mherrmann/helium v5.1.1+incompatible
Lighter web automation with Python
27 versions - Latest release: 8 months ago - 7,978 stars on GitHub
Top 5.8% on proxy.golang.org
github.com/tinyfish-io/agentql-mcp v1.0.0
Model Context Protocol server that integrates AgentQL's data extraction capabilities.
3 versions - Latest release: 7 months ago - 105 stars on GitHub
Top 7.2% on proxy.golang.org
github.com/aidenesco/connect v0.0.0-20210628195256-6db2dfcb2467
Rotating proxy pool usable as a client or HTTPS CONNECT server
1 version - Latest release: over 4 years ago - 3 stars on GitHub
Top 9.4% on proxy.golang.org
github.com/go-rod/rod/lib/examples/custom-websocket 💰
Package main ...
Latest release: 6 days ago - 6,285 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/go-rod/rod/lib/utils/check-issue 💰
A Chrome DevTools Protocol driver for web automation and scraping.
Latest release: 6 days ago - 6,285 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/apifytech/apify-js v3.15.1+incompatible
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In ...
641 versions - Latest release: 7 days ago - 11,973 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/lorien/grab v1.2.0
Web Scraping Framework
16 versions - Latest release: 15 days ago - 2,416 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/devsheke/scrapollo
A cli application that scrapes leads off of apollo.io
Latest release: 6 days ago - 0 stars on GitHub
Top 5.0% on proxy.golang.org
github.com/infinitbyte/gopa v0.11.0 💰
GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn
4 versions - Latest release: about 7 years ago - 294 stars on GitHub
Top 9.0% on proxy.golang.org
github.com/theTardigrade/golang-cachedPageDownloader v1.4.14
Package cachedPageDownloader makes it easy to download, or access previously cached versions of, ...
25 versions - Latest release: over 2 years ago - 0 stars on GitHub
Top 9.7% on proxy.golang.org
github.com/jollyboss123/tcg_my-server v0.1.9
server for TCG.MY
10 versions - Latest release: about 2 years ago - 3 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/seleniumbase/seleniumbase v4.41.10+incompatible 💰
Python APIs for web automation, testing, and bypassing bot-detection.
750 versions - Latest release: 8 days ago - 11,667 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/seleniumbase/SeleniumBase v4.41.10+incompatible 💰
Python APIs for web automation, testing, and bypassing bot-detection.
750 versions - Latest release: 8 days ago - 11,667 stars on GitHub
github.com/aidenesco/randomua v0.0.0-20201111025750-034f5a0807a9
Package randomua generates User-Agent strings
1 version - Latest release: almost 5 years ago - 2 dependent packages - 1 dependent repositories - 1 stars on GitHub
Top 9.0% on proxy.golang.org
github.com/k9mil/eagle v0.1.0 💰
🦅 A simple, fast, and fun CLI-based application which functions as a helper to find answers to yo...
1 version - Latest release: over 3 years ago - 1 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/datahenhq/till v0.10.2
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, m...
37 versions - Latest release: almost 4 years ago - 800 stars on GitHub
Top 10.0% on proxy.golang.org
github.com/semanser/jsongenius v0.0.0-20231011162704-3b80bd6e57be
Get structured JSON data from any page.
1 version - Latest release: almost 2 years ago - 178 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/aljoni/webgrab v0.1.6
WebGrab is a simple Go library which allows for easy scraping of web pages.
7 versions - Latest release: about 1 month ago - 0 stars on GitHub
Top 8.0% on proxy.golang.org
github.com/xarantolus/jsonextract/examples/stackoverflow-chart v0.0.0-20221016082544-f299c87bd36c
Go package for finding and extracting any JavaScript object (not just JSON) from an io.Reader
2 versions - Latest release: almost 3 years ago - 6 stars on GitHub
Top 10.0% on proxy.golang.org
github.com/dohnj0e/snagtag v1.2.0-stable
Scrape social media platforms such as Youtube and Tiktok, powered by Go.
3 versions - Latest release: almost 2 years ago - 4 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/AngraTeam/Dionisio v0.0.0-20221012122616-88e5d9cd4a47
[Under development...]🍷 The tool capable of automating the entire process of a penetration test o...
2 versions - Latest release: almost 3 years ago - 1 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/jimmyyyeh/tw-stock-plugin v0.1.5
Some common function when doing Taiwan stock web scraping.
2 versions - Latest release: over 4 years ago - 1 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/hrbrmstr/splashr v0.4.0
:sweat_drops: Tools to Work with the 'Splash' JavaScript Rendering Service in R
1 version - Latest release: about 8 years ago - 98 stars on GitHub
Top 5.8% on proxy.golang.org
github.com/vrknetha/mcp-server-firecrawl v3.2.0+incompatible
Official Firecrawl MCP Server - Adds powerful web scraping to Cursor, Claude and any other LLM cl...
15 versions - Latest release: 17 days ago - 2,210 stars on GitHub
Top 7.6% on proxy.golang.org
github.com/gastonbecerra/ojsr v0.1.0
R package to crawl and scrape OJS (open journal system)
1 version - Latest release: over 5 years ago - 3 stars on GitHub
Top 8.7% on proxy.golang.org
github.com/gosom/google-maps-scraper v1.8.4 💰
scrape data data from Google Maps. Extracts data such as the name, address, phone number, websit...
60 versions - Latest release: about 1 month ago - 2,315 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/gosom/scrapemate v0.9.6 💰
Golang Crawling and scraping framework
32 versions - Latest release: about 1 month ago - 1 dependent package - 2 dependent repositories - 138 stars on GitHub
Top 5.8% on proxy.golang.org
github.com/mendableai/firecrawl-mcp-server v3.2.0+incompatible
🔥 Official Firecrawl MCP Server - Adds powerful web scraping to Cursor, Claude and any other LLM ...
15 versions - Latest release: 17 days ago - 4,190 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/jibble330/lexos-cli v0.0.0-20221002185233-e008fe61a2c3
A tool for gathering Lexile and Atos(AR) levels from an ISBN.
1 version - Latest release: about 3 years ago - 0 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/DataHenHQ/till v0.10.2
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, m...
37 versions - Latest release: almost 4 years ago - 799 stars on GitHub
Top 5.5% on proxy.golang.org
github.com/kareemsasa3/arachne v1.1.1
A resilient, concurrent web scraper service built in Go, featuring a REST API, Redis-backed job q...
3 versions - Latest release: 3 months ago - 1 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/serpapi/nokolexbor v0.6.2
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and X...
24 versions - Latest release: 5 months ago - 347 stars on GitHub
github.com/promptapi/scraper-go v0.1.4
Golang wrapper for Prompt API's Scraper API
5 versions - Latest release: almost 5 years ago - 1 dependent package - 1 dependent repositories - 3 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/tech-at-du/acs-4210-strongly-typed-languages v0.0.0-20221212184733-45577a215780
💪 Learn and implement the design patterns and best practices that make Go a top choice at high-ve...
1 version - Latest release: almost 3 years ago - 2 stars on GitHub
Top 6.0% on proxy.golang.org
github.com/GoodbyteCo/Watchlist-Picker-Backend
Picks a random movie from your Letterboxd watchlist for when you can't decide what to watch
Latest release: 17 days ago - 3 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/DataHenHQ/till/examples/go/standard
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, m...
Latest release: 17 days ago - 815 stars on GitHub
Top 6.6% on proxy.golang.org
github.com/alirezamika/autoscraper v1.1.14 💰
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
16 versions - Latest release: about 3 years ago - 6,896 stars on GitHub
Top 7.3% on proxy.golang.org
github.com/IBMDeveloperUK/golang-web-scraping v0.0.0-20200814092308-885b19c51368
Learn how to scrape web content from HTML and see how web scraping differs to web crawling
1 version - Latest release: about 5 years ago - 1 dependent repositories - 10 stars on GitHub
Top 5.1% on proxy.golang.org
github.com/suntong/cascadia v1.3.0
Go cascadia package command line CSS selector
7 versions - Latest release: over 2 years ago - 1 dependent package - 127 stars on GitHub
Top 6.0% on proxy.golang.org
github.com/tednaleid/ganda v1.0.3
fast cmd-line app that quickly request millions of urls and save/echo the results
22 versions - Latest release: about 1 year ago - 54 stars on GitHub
Top 8.6% on proxy.golang.org
github.com/pchaparro/youtube-scraper v1.0.3
Youtube search web scraper using youtube data api, regular expressions and http requests.
4 versions - Latest release: almost 3 years ago - 1 stars on GitHub
Top 7.5% on proxy.golang.org
github.com/jakewarren/scrape v1.0.2
A command line scraping utility supporting CSS selectors or XPath
3 versions - Latest release: over 6 years ago - 4 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/s0rg/crawley v1.7.13
The unix-way web crawler
70 versions - Latest release: about 2 months ago - 296 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/lit26/finvizfinance v1.2.0 💰
Finviz analysis python library.
46 versions - Latest release: 27 days ago - 658 stars on GitHub
Top 8.6% on proxy.golang.org
github.com/PChaparro/youtube-scraper v1.0.3
Youtube search web scraper using youtube data api, regular expressions and http requests.
4 versions - Latest release: almost 3 years ago - 1 stars on GitHub
Top 9.3% on proxy.golang.org
github.com/markusmobius/go-htmldate v1.9.3
CLI and Go package for extracting publication date of a web pages.
13 versions - Latest release: 5 months ago - 1 dependent package - 2 dependent repositories - 4 stars on GitHub
Top 5.7% on proxy.golang.org
github.com/tidyverse/rvest v1.0.5
Simple web scraping for R
15 versions - Latest release: about 1 month ago - 1,506 stars on GitHub
Top 9.2% on proxy.golang.org
github.com/xarantolus/jsonextract v1.5.3
Package jsonextract implements functions for finding and extracting any valid JavaScript object (...
25 versions - Latest release: over 4 years ago - 2 dependent packages - 5 dependent repositories - 6 stars on GitHub
Top 8.6% on proxy.golang.org
github.com/aosousa/go-hltb-lookup
CMD Tool to look up game play time data through scraping the How Long to Beat website.
Latest release: 25 days ago - 0 stars on GitHub
Top 6.8% on proxy.golang.org
github.com/doc-mccoy/go-web-scrap-simple-example
Web scrap simples escrito em Go. Início dos meus estudos nesta linguagem.
Latest release: 26 days ago - 0 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/roach-php/core v3.2.1+incompatible 💰
The complete web scraping toolkit for PHP.
5 versions - Latest release: 7 months ago - 1,423 stars on GitHub
Top 7.2% on proxy.golang.org
github.com/bazuker/browserbro v1.0.2
Turn any website into an API with BrowserBro.
3 versions - Latest release: over 1 year ago - 2 stars on GitHub
Top 8.1% on proxy.golang.org
github.com/qascade/yast v0.0.0-20230514183902-09a8973a0286
Copyright © 2022 NAME HERE <EMAIL ADDRESS>
4 versions - Latest release: over 2 years ago - 23 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/hadley/rvest v1.0.5
Simple web scraping for R
15 versions - Latest release: about 1 month ago - 1,436 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/lindsaygelle/amiibo v1.0.1-alpha
Package amiibo provides a simple SDK to build an application that provides data about Nintendo Am...
2 versions - Latest release: about 5 years ago - 1 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/promptapi/scraper-cli v0.1.1
CLI Tool for Prompt API's Scraper API, works for macOS, linux and windows :)
5 versions - Latest release: almost 5 years ago - 1 stars on GitHub
Top 6.8% on proxy.golang.org
github.com/jonfriesen/playwright-go-stealth v0.0.1
🥷 A simple puppeteer evasions shim for playwright-go projects.
1 version - Latest release: over 1 year ago - 33 stars on GitHub
Top 8.3% on proxy.golang.org
github.com/calebtracey/go-scraper
Web scraping API written in Golang for business data collection.
Latest release: about 1 month ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/siongui/goigstorydl v0.0.0-20180211021843-4117d63370d4
Package igstorydl helps you download Instagram stories.
1 version - Latest release: over 7 years ago - 2 stars on GitHub
Top 6.9% on proxy.golang.org
github.com/eze-kiel/go-scraper
a simple web scraper in go
Latest release: about 1 month ago - 0 stars on GitHub
Top 6.0% on proxy.golang.org
github.com/DataHenHQ/till/examples/go/colly
Tutorial from from https://github.com/gocolly/colly/blob/master/_examples/basic/basic.go modified...
Latest release: about 1 month ago - 811 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/ibmdeveloperuk/golang-web-scraping v0.0.0-20200814092308-885b19c51368
Learn how to scrape web content from HTML and see how web scraping differs to web crawling
1 version - Latest release: about 5 years ago - 10 stars on GitHub
Top 9.9% on proxy.golang.org
github.com/robertjgabriel/golang-link-scraper v0.0.0-20161105150730-8cdb97e95a2b
I like Golang but dont get to write much in work so made a simple web scrapper in Golang
1 version - Latest release: almost 9 years ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/keltia/fetiche v0.0.0-20180820120723-54b438a95f9b
Web pages monitoring daemon w/ CLI interface (WWW to come) ** Work-in-Progress.
1 version - Latest release: about 7 years ago - 1 stars on GitHub
Top 7.5% on proxy.golang.org
github.com/kadnan/yelp-scraper-go
A simple web scraper for Yelp written in Go language.
Latest release: about 2 months ago - 3 stars on GitHub
github.com/ZUR1C4T0/scraper-flv
Un web scraper para el sitio web AnimeFLV para extraer información sobre los animes.
Latest release: about 2 months ago - 1 stars on GitHub
Top 6.1% on proxy.golang.org
github.com/siongui/instago v0.0.0-20230301150703-9da679ec808b
Package instago helps you access the private API of Instagram. For examle, get URLs of all posts ...
2 versions - Latest release: over 2 years ago - 2 dependent repositories - 87 stars on GitHub
github.com/csunibo/raccoglitesi v0.0.0-20231011233434-c925834a978e
Una raccolta di proposte di tesi del DISI di Unibo periodicamente aggiornata.
2 versions - Latest release: almost 2 years ago - 0 stars on GitHub
Top 6.9% on proxy.golang.org
github.com/jib1337/cloner
A simple website cloner for social engineering.
Latest release: 2 months ago - 1 stars on GitHub
Top 9.0% on proxy.golang.org
github.com/Jibble330/lexos-cli v0.0.0-20220812055413-67de92099ef5
A tool for gathering Lexile and Atos(AR) levels from an ISBN.
2 versions - Latest release: about 3 years ago - 0 stars on
Top 9.9% on proxy.golang.org
github.com/RobertJGabriel/golang-link-scraper v0.0.0-20161105150730-8cdb97e95a2b
I like Golang but dont get to write much in work so made a simple web scrapper in Golang
1 version - Latest release: almost 9 years ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/siongui/goigstorylink v0.0.0-20180210200147-626c48d7ffca
Get Links (URL) of Instagram Stories in Go
1 version - Latest release: over 7 years ago - 11 stars on GitHub
Top 6.9% on proxy.golang.org
github.com/Scrip7/imdb-api v0.0.0-20230221033235-f02f0c9ddbbe
[🚧 WIP] Cross-platform microservice to scrape the IMDb website.
2 versions - Latest release: over 2 years ago - 23 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/heinrichb/scrapey-cli
Scrapey CLI is a lightweight, modular command-line tool built in Go for web crawling and scraping...
Latest release: 3 months ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/aidenesco/netroutine v0.0.0-20210814211830-80171513de35
Creation and execution of network request routines
1 version - Latest release: about 4 years ago - 2 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/siongui/go-facebook-post-parser v0.0.0-20180704141744-fceb8bda7d99
web scrape facebook post and extract data
1 version - Latest release: over 7 years ago - 7 stars on GitHub
Top 9.5% on proxy.golang.org
github.com/zer-far/roulette
Random user-agent and referrer generator.
Latest release: 4 months ago - 0 stars on GitHub
Top 9.7% on proxy.golang.org
github.com/gellel/labo v0.0.0-20191024080821-472f0fb6afa1
Golang package. Labo package fetches the current Nintendo Labo Kits available. Uses GoQuery to pa...
1 version - Latest release: almost 6 years ago - 0 stars on GitHub