Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Golang Scraper Crawler Open Source Projects

Open source projects categorized as Golang Scraper Crawler
Lux ⭐ 24,752
👾 Fast and simple video download library and CLI tool written in Go
dependent packages 8total releases 40most recent commit 22 days ago
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22most recent commit a month ago
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56most recent commit 4 months ago
Rod ⭐ 4,505
A Devtools driver for web automation and scraping
dependent packages 140total releases 406most recent commit 3 months ago
Geziyor ⭐ 1,892
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
dependent packages 11total releases 6most recent commit a year ago
Cariddi ⭐ 1,228
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
total releases 15most recent commit 3 months ago
Till ⭐ 770
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes.
total releases 37most recent commit 2 years ago
Gosint ⭐ 567
OSINT Swiss Army Knife
most recent commit 3 years ago
Dataflowkit ⭐ 394
Extract structured data from web sites. Web sites scraping.
most recent commit 4 years ago
Gopa ⭐ 281
[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn
total releases 6most recent commit 3 years ago
Ant ⭐ 271
A web crawler for Go
total releases 8most recent commit a year ago
Antch ⭐ 177
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
dependent packages 1total releases 1most recent commit 4 years ago
Goribot ⭐ 162
[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。
total releases 11most recent commit 4 years ago
Spidy ⭐ 138
Domain names collector - Crawl websites and collect domain names along with their availability status.
total releases 3most recent commit 9 months ago
Evine ⭐ 117
Interactive CLI Web Crawler
total releases 8most recent commit 3 years ago
Scraply ⭐ 114
Scraply a simple dom scraper to fetch information from any html based website
total releases 1most recent commit 2 years ago
Blinkist M4a Downloader ⭐ 97
Grabs all of the audio files from all of the Blinkist books
most recent commit 2 years ago
Dorkscout ⭐ 78
DorkScout - Golang tool to automate google dork scan against the entiere internet or specific targets
most recent commit 3 years ago
Collyzar ⭐ 65
Distributed redis-based web crawler framework for colly
total releases 2most recent commit 3 years ago
Goscraper ⭐ 58
Golang pkg to quickly return a preview of a webpage (title/description/images)
dependent packages 6total releases 1most recent commit 4 years ago
Tool Gin ⭐ 54
基于go-gin框架建立减少冗余动作项目，如：下载一些工具
most recent commit a year ago
Proxifier ⭐ 43
A fast, modern and intelligent proxy rotator perfect for crawling and scraping public data.
most recent commit 6 years ago
Goclone ⭐ 41
🌱 goclone - clone websites in a matter of seconds
total releases 3most recent commit 6 months ago
The 7 Most Depended On Golang Scraper Crawler Open Source Projects
Colly ⭐ 21,902
Elegant Scraper and Crawler Framework for Golang
dependent packages 328total releases 22latest release March 08, 2022most recent commit a month ago
Rod ⭐ 4,505
A Devtools driver for web automation and scraping
dependent packages 140total releases 406latest release November 06, 2023most recent commit 3 months ago
Geziyor ⭐ 1,892
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
dependent packages 11total releases 6latest release April 19, 2021most recent commit a year ago
Lux ⭐ 24,752
👾 Fast and simple video download library and CLI tool written in Go
dependent packages 8total releases 40latest release November 06, 2023most recent commit 22 days ago
Goscraper ⭐ 58
Golang pkg to quickly return a preview of a webpage (title/description/images)
dependent packages 6total releases 1latest release August 27, 2019most recent commit 4 years ago
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56latest release March 28, 2023most recent commit 4 months ago
Antch ⭐ 177
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
dependent packages 1total releases 1latest release December 25, 2017most recent commit 4 years ago
The 10 Latest Releases In Golang Scraper Crawler Open Source Projects
Rod ⭐ 4,505
A Devtools driver for web automation and scraping
dependent packages 140total releases 406latest release November 06, 2023most recent commit 3 months ago
Lux ⭐ 24,752
👾 Fast and simple video download library and CLI tool written in Go
dependent packages 8total releases 40latest release November 06, 2023most recent commit 22 days ago
Goclone ⭐ 41
🌱 goclone - clone websites in a matter of seconds
total releases 3latest release July 09, 2023most recent commit 6 months ago
Krawler ⭐ 11
A crawler for kernel releases distributed by the major Linux distributions.
total releases 6latest release June 08, 2023most recent commit 10 months ago
Worker ⭐ 12
Containerized Ferret worker
total releases 26latest release March 29, 2023most recent commit a year ago
Ferret ⭐ 5,540
Declarative web scraping
dependent packages 5total releases 56latest release March 28, 2023most recent commit 4 months ago
Scraply ⭐ 114
Scraply a simple dom scraper to fetch information from any html based website
total releases 1latest release July 07, 2022most recent commit 2 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.