Data

Tools

Indexes

Applications

Experiments

Packages

An open API service providing package, version and dependency metadata of many open source software ecosystems and registries.

proxy.golang.org "crawler" keyword

Top 9.6% on proxy.golang.org
github.com/kblok/puppeteer-sharp v25.5.0+incompatible 💰
Headless Chrome .NET API
92 versions - Latest release: 3 months ago - 3,919 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/adbar/courlan v1.4.0 💰
Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication...
32 versions - Latest release: 5 months ago - 177 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/HardKoded/puppeteer-sharp v25.13.1+incompatible 💰
Headless Chrome .NET API
101 versions - Latest release: 13 days ago - 3,928 stars on GitHub
Top 9.6% on proxy.golang.org
github.com/hardkoded/puppeteer-sharp v25.15.0+incompatible 💰
Headless Chrome .NET API
102 versions - Latest release: about 2 hours ago - 3,928 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/Hardkoded/puppeteer-sharp v25.14.0+incompatible 💰
Headless Chrome .NET API
104 versions - Latest release: 4 days ago - 3,928 stars on GitHub
Top 4.9% on proxy.golang.org
github.com/bda-research/node-crawler v2.1.1+incompatible
Web Crawler/Spider for NodeJS + server-side jQuery ;-)
3 versions - Latest release: 4 months ago - 6,796 stars on GitHub
Top 1.1% on proxy.golang.org
github.com/geziyor/geziyor v0.0.0-20240812061556-229b8ca83ac1
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
8 versions - Latest release: about 2 years ago - 87 dependent packages - 67 dependent repositories - 2,781 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/ScrapeGraphAI/Scrapegraph-ai v2.3.1+incompatible 💰
Python scraper based on AI
480 versions - Latest release: 17 days ago - 31,947 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/scrapegraphai/scrapegraph-ai v2.3.1+incompatible 💰
Python scraper based on AI
480 versions - Latest release: 17 days ago - 31,947 stars on GitHub
Top 4.2% on proxy.golang.org
github.com/algolia/npm-search v1.10.0
🗿 npm ↔️ Algolia replication tool :skier: :snail: :artificial_satellite:
77 versions - Latest release: 6 months ago - 142 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/adbar/trafilatura v2.3.1+incompatible 💰
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction...
43 versions - Latest release: 14 days ago - 6,981 stars on GitHub
Top 4.2% on proxy.golang.org
github.com/pinkpixel-dev/web-scout-mcp v1.5.2
An MCP server providing web search and content extraction capabilities. Integrates DuckDuckGo sea...
2 versions - Latest release: about 1 year ago - 136 stars on GitHub
Top 6.0% on proxy.golang.org
github.com/unclecode/crawl4ai v0.9.5 💰
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Mar...
42 versions - Latest release: 9 days ago - 85,904 stars on GitHub
Top 4.9% on proxy.golang.org
github.com/rushter/selectolax v1.0.0
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
64 versions - Latest release: 20 days ago - 1,693 stars on GitHub
Top 6.6% on proxy.golang.org
github.com/boris-code/feapder v1.9.3
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSp...
54 versions - Latest release: 10 months ago - 3,735 stars on GitHub
Top 6.6% on proxy.golang.org
github.com/Boris-code/feapder v1.9.3
🚀🚀🚀feapder is an easy to use, powerful crawler framework | feapder是一款上手简单，功能强大的Python爬虫框架。内置AirSp...
54 versions - Latest release: 10 months ago - 3,735 stars on GitHub
Top 1.0% on proxy.golang.org
github.com/ramkansal/gofang v1.0.0
All-in-one web crawler with extraction superpowers
1 version - Latest release: 9 months ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/danielemoraschi/go-sitemap-app v0.0.0-20161019063245-a86336441b7c
1 version - Latest release: about 10 years ago - 0 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/getmaxun/maxun v0.0.48
Turn any website into a structured API. Extract, automate, search and monitor the web.
47 versions - Latest release: 22 days ago - 17,881 stars on GitHub
Top 5.1% on proxy.golang.org
github.com/d4vinci/scrapling v0.4.15 💰
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-sca...
49 versions - Latest release: 2 months ago - 88,105 stars on GitHub
Top 5.0% on proxy.golang.org
github.com/D4Vinci/scrapling v0.4.15 💰
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-sca...
49 versions - Latest release: 2 months ago - 88,105 stars on GitHub
Top 5.1% on proxy.golang.org
github.com/D4Vinci/Scrapling v0.4.15 💰
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-sca...
49 versions - Latest release: 2 months ago - 88,105 stars on GitHub
Top 5.0% on proxy.golang.org
github.com/firecrawl/firecrawl v3.0.0+incompatible
Supercharge your AI agents with data from the web and beyond. Building the library for superintel...
658 versions - Latest release: 5 months ago - 194,035 stars on GitHub
Top 5.0% on proxy.golang.org
github.com/firecrawl/firecrawl/apps/go-sdk v1.16.8
Package firecrawl provides a Go client for Firecrawl, the context API for AI agents: search, scra...
33 versions - Latest release: 1 day ago - 194,035 stars on GitHub
Top 5.1% on proxy.golang.org
github.com/meysam81/scry v0.0.2 💰
Package main is the entry point for the scry CLI.
2 versions - Latest release: 7 months ago - 8 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/lorien/grab v1.2.0
Web Scraping Framework
16 versions - Latest release: about 1 year ago - 2,463 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/lorien/awesome-web-scraping v0.0.0-20260902071515-59f7b358eacf removed
List of libraries, tools and APIs for web scraping and data processing.
2 versions - Latest release: about 2 months ago - 8,184 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/scrapfly/scrapfly-scrapers v0.0.0-20260902140739-6d87191c13f0 removed
Scalable Python web scraping scripts for +40 popular domains
2 versions - Latest release: about 2 months ago - 1,099 stars on GitHub
Top 4.1% on proxy.golang.org
github.com/s0md3v/Photon v1.3.0 💰
Incredibly fast crawler designed for OSINT.
19 versions - Latest release: over 7 years ago - 13,292 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/S0md3v/Photon v1.3.0 💰
Incredibly fast crawler designed for OSINT.
19 versions - Latest release: over 7 years ago - 13,292 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/s0md3v/photon v1.3.0 💰
Incredibly fast crawler designed for OSINT.
19 versions - Latest release: over 7 years ago - 13,292 stars on GitHub
Top 5.1% on proxy.golang.org
github.com/RevoltSecurities/SpideyX v1.0.0
SpideyX a multipurpose Web Penetration Testing tool with asynchronous concurrent performance wit...
1 version - Latest release: about 2 years ago - 245 stars on GitHub
Top 5.1% on proxy.golang.org
github.com/revoltsecurities/spideyx v1.0.0
SpideyX a multipurpose Web Penetration Testing tool with asynchronous concurrent performance wit...
1 version - Latest release: about 2 years ago - 245 stars on GitHub
Top 5.7% on proxy.golang.org
github.com/gildas-lormeau/single-file-cli v2.18.3+incompatible
CLI tool for saving a faithful copy of a complete web page in a single HTML file (based on Single...
121 versions - Latest release: 10 days ago - 1,666 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/puerkitobio/gocrawl v1.1.0 💰
Package gocrawl is a polite, slim and concurrent web crawler written in Go.
8 versions - Latest release: over 5 years ago - 2,052 stars on GitHub
Top 2.0% on proxy.golang.org
github.com/PuerkitoBio/gocrawl v1.1.0 💰
Package gocrawl is a polite, slim and concurrent web crawler written in Go.
8 versions - Latest release: over 5 years ago - 4 dependent packages - 7 dependent repositories - 2,052 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/ma63d/leetcode-spider v1.0.2
用 node.js 爬你自己的 leetcode 解题源码
14 versions - Latest release: over 8 years ago - 186 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/Ma63d/leetcode-spider v1.0.2
用 node.js 爬你自己的 leetcode 解题源码
14 versions - Latest release: over 8 years ago - 186 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/TikHub/TikHub-API-Python-SDK v2.2.0+incompatible
High-performance asynchronous Douyin(抖音) TikTok Xiaohongshu(小红书) Kuaishou(快手) Weibo(微博) Instagram...
4 versions - Latest release: 20 days ago - 919 stars on GitHub
Top 3.9% on proxy.golang.org
github.com/tikhub/tikhub-api-python-sdk v2.2.0+incompatible
High-performance asynchronous Douyin(抖音) TikTok Xiaohongshu(小红书) Kuaishou(快手) Weibo(微博) Instagram...
4 versions - Latest release: 20 days ago - 920 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/dineshsprabu/concurrent-web-crawler v0.0.0-20170505055956-d21717df7b11
Concurrent Web Crawler is a light weight configurable crawler with concurrecy enabled.
1 version - Latest release: over 9 years ago - 1 stars on GitHub
Top 7.2% on proxy.golang.org
github.com/zhang555/crawler1
go crawler
Latest release: 3 months ago - 1 stars on GitHub
Top 0.8% on proxy.golang.org
github.com/iawia002/annie v0.24.1
👾 Fast and simple video download library and CLI tool written in Go
17 versions - Latest release: over 2 years ago - 14 dependent packages - 9 dependent repositories - 31,730 stars on GitHub
Top 4.3% on proxy.golang.org
github.com/Evil0ctal/Douyin_Tiktok_Download_API v5.1.3+incompatible 💰
🚀 自托管的抖音、TikTok 数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok &...
10 versions - Latest release: 21 days ago - 20,806 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/Evil0ctal/douyin_tiktok_download_api v5.1.3+incompatible 💰
🚀 自托管的抖音、TikTok 数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok &...
9 versions - Latest release: 21 days ago - 20,806 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/evil0ctal/Douyin_TikTok_Download_API v5.1.3+incompatible 💰
🚀 自托管的抖音、TikTok 数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok &...
10 versions - Latest release: 21 days ago - 20,806 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/Evil0ctal/Douyin_TikTok_Download_API v5.1.5+incompatible 💰
🚀 自托管的抖音、TikTok 数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok &...
12 versions - Latest release: 3 days ago - 20,806 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/evil0ctal/douyin_tiktok_download_api v5.1.5+incompatible 💰
🚀 自托管的抖音、TikTok 数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok &...
11 versions - Latest release: 3 days ago - 20,806 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/EVIL0CTAL/Douyin_TikTok_Download_API v5.1.3+incompatible 💰
🚀 自托管的抖音、TikTok 数据采集与无水印视频下载 API，支持 AI agent 通过 MCP 调用与离线语音转文字，Docker 一键部署。| Self-hosted TikTok &...
10 versions - Latest release: 21 days ago - 20,806 stars on GitHub
Top 4.5% on proxy.golang.org
github.com/projectdiscovery/Katana v1.8.0
A next-generation crawling and spidering framework.
23 versions - Latest release: 18 days ago - 17,694 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/ProjectDiscovery/katana v1.8.0
A next-generation crawling and spidering framework.
23 versions - Latest release: 18 days ago - 17,694 stars on GitHub
Top 2.2% on proxy.golang.org
github.com/projectdiscovery/katana v1.8.0
A next-generation crawling and spidering framework.
23 versions - Latest release: 18 days ago - 5 dependent packages - 1 dependent repositories - 17,694 stars on GitHub
Top 6.2% on proxy.golang.org
github.com/Projectdiscovery/katana v1.8.0
A next-generation crawling and spidering framework.
23 versions - Latest release: 18 days ago - 17,694 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/Projectdiscovery/Katana v1.8.0
A next-generation crawling and spidering framework.
23 versions - Latest release: 18 days ago - 17,694 stars on GitHub
Top 6.3% on proxy.golang.org
github.com/projectDiscovery/katana v1.8.0
A next-generation crawling and spidering framework.
23 versions - Latest release: 18 days ago - 17,694 stars on GitHub
Top 5.6% on proxy.golang.org
github.com/ProjectDiscovery/Katana v1.8.0
A next-generation crawling and spidering framework.
23 versions - Latest release: 18 days ago - 17,694 stars on GitHub
Top 1.0% on proxy.golang.org
github.com/serkan-ozal/driflyte-mcp-server v0.1.15
The Driflyte MCP Server exposes tools that allow AI assistants to query and retrieve topic-specif...
36 versions - Latest release: about 1 year ago - 11 stars on GitHub
Top 0.4% on proxy.golang.org
github.com/gocolly/colly/v2 v2.3.0
Package colly implements a HTTP scraping framework
5 versions - Latest release: 11 months ago - 660 dependent packages - 591 dependent repositories - 25,555 stars on GitHub
Top 4.6% on proxy.golang.org
github.com/helgesverre/ardvark v0.7.0 💰
Crawler & indexer for ARD (Agentic Resource Discovery) ai-catalog.json documents
8 versions - Latest release: 3 months ago - 0 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/ericz99/go-crawler v0.0.0-20200325152842-2c4d4a42cb38
Simple lightweight crawler, that will find all endpoints on any website.
1 version - Latest release: over 6 years ago - 3 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/alonecandies/golwarc
All-in-One crawlers for Golang
Latest release: 3 days ago - 0 stars on GitHub
Top 6.6% on proxy.golang.org
github.com/Python3WebSpider/DouYin v0.3.6
API of DouYin for Humans used to Crawl Popular Videos and Musics
11 versions - Latest release: almost 8 years ago - 653 stars on GitHub
Top 6.6% on proxy.golang.org
github.com/python3webspider/douyin v0.3.6
API of DouYin for Humans used to Crawl Popular Videos and Musics
11 versions - Latest release: almost 8 years ago - 653 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/samvad-hq/samvad-news-harvester v0.2.0
A small Go service that crawls news sitemaps, identifies articles by a stable ID, and delivers th...
2 versions - Latest release: about 2 months ago - 12 stars on GitHub
Top 3.7% on proxy.golang.org
github.com/rmax/scrapy-redis v0.9.1
Redis-based components for Scrapy.
11 versions - Latest release: over 2 years ago - 1 dependent repositories - 5,643 stars on GitHub
Top 4.4% on proxy.golang.org
github.com/quantmind-br/repodocs v1.0.2
Go CLI for extracting websites, repositories, sitemaps, and package docs into structured Markdown
2 versions - Latest release: 10 months ago - 0 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/88899/gitmen-lottery v1.2.3
彩票 数据 双色球 大乐透 快开 超级大乐透 预测 仅供学习
6 versions - Latest release: 9 months ago - 12 stars on GitHub
Top 4.9% on proxy.golang.org
github.com/mysleekdesigns/crawlforge-mcp v6.20.1+incompatible 💰
31 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, re...
107 versions - Latest release: 12 days ago - 2 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/bitextor/bitextor v8.1.1+incompatible
Bitextor generates translation memories from multilingual websites
12 versions - Latest release: about 5 years ago - 301 stars on GitHub
Top 4.7% on proxy.golang.org
github.com/goelayu/sprinter
A web crawler that leverages compute memoization techniques to enable lightning fast crawling of ...
Latest release: 4 days ago - 9 stars on GitHub
Top 4.9% on proxy.golang.org
github.com/ma6254/fictiondown v0.1.3
Package FictionDown is a Fiction download tool
3 versions - Latest release: over 6 years ago - 1,046 stars on GitHub
Top 4.9% on proxy.golang.org
github.com/ma6254/FictionDown v0.1.3
小说下载|小说爬取|起点|笔趣阁|导出Markdown|导出txt|转换epub|广告过滤|自动校对
3 versions - Latest release: over 6 years ago - 1,046 stars on GitHub
Top 4.9% on proxy.golang.org
github.com/dwisiswant0/go-dork v1.0.3 💰
The fastest dork scanner written in Go.
5 versions - Latest release: over 2 years ago - 1,307 stars on GitHub
Top 8.6% on proxy.golang.org
github.com/amirf194/wingfoot v0.1.2
Verified-bot identity for AI agents (Web Bot Auth / RFC 9421), with a doctor that reports why a r...
3 versions - Latest release: 3 months ago - 7 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/webscrape-ai/webscrape-ai/sdk/go v0.1.0
Package webscrape is the official Go SDK for the webscrape.ai API.
1 version - Latest release: 4 months ago - 11 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/arnesssr/Spyber v0.2.3
Go-only ecommerce business intelligence crawler for discovering country-scoped companies, extra...
1 version - Latest release: 4 months ago - 2 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/arnesssr/spyber v0.2.3
Go-only ecommerce business intelligence crawler for discovering country-scoped companies, extra...
4 versions - Latest release: 4 months ago - 2 stars on GitHub
github.com/xorbit01/webpalm v1.1.1
🕸️ Crawl in the web network
8 versions - Latest release: over 3 years ago - 384 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/xorbit01/webpalm/v2 v2.0.20
🕸️ Crawl in the web network
20 versions - Latest release: over 1 year ago - 384 stars on GitHub
Top 5.9% on proxy.golang.org
github.com/XORbit01/webpalm/v2 v2.0.20
🕸️ Crawl in the web network
20 versions - Latest release: over 1 year ago - 384 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/XORBit01/webpalm v1.1.1
🕸️ Crawl in the web network
8 versions - Latest release: over 3 years ago - 384 stars on GitHub
github.com/XORbit01/webpalm v1.1.1
🕸️ Crawl in the web network
8 versions - Latest release: over 3 years ago - 4 dependent packages - 384 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/XORBit01/webpalm/v2 v2.0.20
🕸️ Crawl in the web network
20 versions - Latest release: over 1 year ago - 384 stars on GitHub
Top 2.4% on proxy.golang.org
github.com/hu17889/go_spider v0.0.0-20150809033053-85ede20bf88b
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and m...
1 version - Latest release: about 11 years ago - 2 dependent packages - 4 dependent repositories - 1,817 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/rendora/rendora v0.3.0
Dynamic server-side rendering using headless Chrome
2 versions - Latest release: almost 8 years ago - 1,988 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/nekmo/dirhunt v1.0.0
Find web directories without bruteforce
14 versions - Latest release: about 3 years ago - 2,009 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/Nekmo/dirhunt v1.0.0
Find web directories without bruteforce
14 versions - Latest release: about 3 years ago - 2,009 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/webrecorder/browsertrix-crawler v1.15.0 💰
Run a high-fidelity browser-based web archiving crawler in a single Docker container
142 versions - Latest release: 21 days ago - 1,168 stars on GitHub
Top 5.8% on proxy.golang.org
github.com/goclone-dev/goclone v1.2.2
Website Cloner - Utilizes powerful Go routines to clone websites to your computer within seconds.
9 versions - Latest release: about 1 year ago - 2,282 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/felipecsl/wombat v3.3.0+incompatible 💰
Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
37 versions - Latest release: 7 months ago - 1,360 stars on GitHub
github.com/orangecoding/fredy v0.0.0-20260921102938-4662af23fc42 removed 💰
❤️ Fredy - [F]ind [R]eal [E]state [D]amn Eas[y] - Fredy keeps searching for new apartments, house...
2 versions - Latest release: about 1 month ago - 1,584 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/togo-framework/knowledge-base v0.1.1 💰
Package knowledgebase is a managed knowledge base for togo: ingest documents, chunk + embed them,...
2 versions - Latest release: 4 months ago - 0 stars on GitHub
Top 4.8% on proxy.golang.org
github.com/togo-framework/ai-crawlee v0.1.0 💰
Go-native site crawler data-source for the togo AI kit
1 version - Latest release: 4 months ago - 0 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/diskoverdata/diskover-community v2.3.5+incompatible
Diskover Community Edition - Open source file indexer, file search engine and data management and...
18 versions - Latest release: 8 months ago - 1,823 stars on GitHub
Top 5.2% on proxy.golang.org
github.com/Autumn-27/ScopeSentry v1.9.4 💰
ScopeSentry-Cyberspace mapping, subdomain enumeration, port scanning, sensitive information disco...
8 versions - Latest release: 2 months ago - 1,967 stars on GitHub
Top 5.2% on proxy.golang.org
github.com/autumn-27/scopesentry v1.9.4 💰
ScopeSentry-Cyberspace mapping, subdomain enumeration, port scanning, sensitive information disco...
8 versions - Latest release: 2 months ago - 1,967 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/TeamNewPipe/NewPipeExtractor v0.26.5 💰
NewPipe's core library for extracting data from streaming sites
86 versions - Latest release: 2 months ago - 2,017 stars on GitHub
Top 6.7% on proxy.golang.org
github.com/teamnewpipe/newpipeextractor v0.26.5 💰
NewPipe's core library for extracting data from streaming sites
86 versions - Latest release: 2 months ago - 2,017 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/0xinfection/xsrfprobe v3.0.0+incompatible
The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.
7 versions - Latest release: 3 months ago - 1,306 stars on GitHub
Top 8.2% on proxy.golang.org
github.com/0xInfection/XSRFProbe v3.0.0+incompatible
The Prime Cross Site Request Forgery (CSRF) Audit and Exploitation Toolkit.
7 versions - Latest release: 3 months ago - 1,306 stars on GitHub
Related Keywords
golang 257 go 204 spider 156 scraper 112 scraping 77 crawling 69 web-scraping 49 web-crawler 41 osint 39 python 34 cli 29 security 29 hacktoberfest 29 bugbounty 27 scrapy 25 recon 24 framework 24 automation 23 webcrawler 23 reconnaissance 22 markdown 22 web 20 docker 19 security-tools 19 telegram-bot 18 web-spider 18 telegram 17 api 17 downloader 17 webscraping 16 web-scraper 16 scanner 15 pentesting 15 redis 15 ai 15 user-agent 15 seo 15 nodejs 15 mcp-server 14 llm 14 pentest 14 mcp 14 data 13 headless 13 hack 13 douyin 13 infosec 13 commoncrawl 12 redteam 12 data-extraction 12 sitemap 12 puppeteer 12 concurrency 12 tiktok 11 bots 11 tool 11 python3 11 proxy-server 11 headless-chrome 11 colly 11 bot 11 youtube 11 playwright 11 ai-agents 10 typescript 10 webspider 10 http 9 penetration-testing 9 javascript 9 crawlab 9 crawling-tasks 9 github 9 platform 9 detect 9 scrapyd-ui 9 spiders-management 9 ai-scraping 9 urlscan 9 rest-api 9 proxy 9 proxypool 9 chatgpt 8 bug-bounty 8 data-collection 8 elasticsearch 8 php 8 gospider 8 gocrawler 8 rag 8 model-context-protocol 8 csharp 8 parser 8 video-downloader 8 html 8 search-engine 8 data-science 8 hacking 8 crawl 8 privacy 7 bilibili 7