Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Golang Crawler Open Source Projects

Open source projects categorized as Golang Crawler
Insecres ⭐ 39
A console tool that finds insecure resources on HTTPS sites
total releases 1most recent commit 8 years ago
Scrapemate ⭐ 39
Golang Crawling and scraping framework
most recent commit 5 months ago
Hotso ⭐ 36
crawler data weibo & baidu & zhihu & newsmth & tianya & v2ex
most recent commit 2 years ago
Httpsyet ⭐ 36
Crawler to find links you can update to HTTPS
total releases 6most recent commit 4 years ago
Golearn ⭐ 36
🔥 Golang basics and actual-combat (including: crawler, distributed-systems, data-analysis, redis, etcd, raft, crontab-task)
most recent commit 3 years ago
Xray_pool ⭐ 35
基于 Xray-core、glider 的代理池工具
total releases 9most recent commit 10 months ago
Gargantua ⭐ 34
The fast website crawler
total releases 7most recent commit 3 years ago
Go Crawler ⭐ 33
A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middleware and supports various parsing and storage methods. Additionally, it supports distributed deployment. 基于golang实现的爬虫框架，编写简单，性能强劲。内置了丰富的实用中间件，支持多种解析、保存方式，
total releases 26most recent commit 5 months ago
Schannel Qt5 ⭐ 33
A GUI client of schannel powered by therecipe/qt and golang
total releases 1most recent commit 5 years ago
Wikiracer ⭐ 32
Finds the shortest path between two Wikipedia articles, using only Wikipedia links.
most recent commit 7 years ago
Crawler ⭐ 31
十年磨一剑：Crawler4U, a general purpose focused crawler
total releases 4most recent commit 3 years ago
Newkidsontheblock ⭐ 31
Source code for IMC 2016 submission
most recent commit 8 years ago
Grawler ⭐ 31
A web crawler / scraper engine written in Golang
total releases 1most recent commit 8 years ago
Dnsseeder ⭐ 30
Go Language dns seeder for Bitcoin based networks
total releases 1most recent commit 2 years ago
Gogetcrawl ⭐ 29
Extract web archive data using Wayback Machine and Common Crawl
total releases 8most recent commit a year ago
Telegram_bbbot ⭐ 29
Telegram Bug Bounty Bot
total releases 1most recent commit 7 years ago
Feedme ⭐ 27
Create Atom/RSS feeds from any website
total releases 1most recent commit 9 years ago
Colly Sqlite3 Storage ⭐ 27
A SQLite3 storage back end for the Colly web crawling/scraping framework https://go-colly.org
most recent commit 5 years ago
Dhtsearch ⭐ 27
[mirror] Standalone DHT search
total releases 2most recent commit 3 years ago
Cat Crawler ⭐ 27
A webcrawler I wrote in Golang that I can use to find and download cat pictures.
total releases 1most recent commit 4 years ago
Gogamer ⭐ 27
巴哈姆特自訂API
most recent commit 3 years ago
Crawl ⭐ 26
Teach daily is web crawl by GoLang from web dev.to, freecodecamp.com, medium.com, hashnode.com, logrocket.com,infoq.com
most recent commit 2 years ago
Crawler Project ⭐ 25
Google资深工程师深度讲解Go语言 爬虫项目。
most recent commit 5 years ago
The 10 Latest Releases In Golang Crawler Open Source Projects
Schannel Qt5 ⭐ 33
A GUI client of schannel powered by therecipe/qt and golang
total releases 1latest release April 02, 2019most recent commit 5 years ago
Graphquery ⭐ 104
GraphQuery is a query language and execution engine tied to any backend service.
dependent packages 4total releases 1latest release March 17, 2019most recent commit 5 years ago
Eth Indexer ⭐ 139
An Ethereum project to crawl blockchain states into database
total releases 37latest release March 07, 2019most recent commit 2 years ago
Torture ⭐ 13
FTP search based on Go! and ElasticSearch for the 31. Chaos Communication Congress
total releases 1latest release December 27, 2018most recent commit 5 years ago
Reserve Stats ⭐ 11
KyberNetwork Reserve Stats
total releases 2latest release December 17, 2018most recent commit 2 years ago
Sentry ⭐ 14
Parallelized web crawler written in Golang
total releases 1latest release October 02, 2018most recent commit 6 years ago
Laosj ⭐ 199
golang light-weight image crawler
dependent packages 1total releases 1latest release September 09, 2018most recent commit 6 years ago
Vozer ⭐ 13
CLI tool to crawl images and URLs from VOZ (https://forums.voz.vn) thread
total releases 3latest release September 03, 2018most recent commit 6 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.