Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Golang Crawler Open Source Projects

Open source projects categorized as Golang Crawler
Fake Useragent ⭐ 7
Provide random user agent
total releases 2most recent commit 2 years ago
Vautour ⭐ 7
A distributed & extensible web hunter
most recent commit 4 years ago
Scrapio ⭐ 7
Simple and easy-to-use scraper and crawler in Go.
total releases 7most recent commit 4 years ago
Libp2p Dht Scrape Aas ⭐ 7
🧹 A libp2p DHT scraper as a service allowing anyone to collect, consume and use to generate useful reports & visualisations.
total releases 8most recent commit 4 years ago
Go Tutorial 2 ⭐ 7
most recent commit 6 years ago
Gophersnakecrawlers ⭐ 6
Comparing simple Go and Python web crawler
most recent commit 10 years ago
Linkchecker ⭐ 6
Recursively crawls a website and checks that URLs return 200.
most recent commit 3 years ago
Dotastats ⭐ 6
an app that crawls dota 2 matches information
most recent commit 6 years ago
Go Adstxt Crawler ⭐ 6
Ads.txt crawler and parser based on IAB Ads.txt Specification Version 1.0.1 implemented in Golang
total releases 1most recent commit 5 years ago
Webber ⭐ 6
基于golang实现的一个轻量级爬虫框架
most recent commit 5 years ago
Btc Crawler ⭐ 6
A Bitcoin network crawler
most recent commit 8 years ago
Rosi Girl ⭐ 6
👌🥖💦 rosi写真爬虫
most recent commit 4 years ago
Wikifeedia ⭐ 6
A feed of the daily top articles on Wikipedia in many languages.
total releases 4most recent commit 3 years ago
Turbo Tor Crawl ⭐ 6
Recursive hostnames crawler
most recent commit a year ago
Githubtraveler ⭐ 6
Travel all of the GitHub users, orgs, repos.
total releases 3most recent commit 3 years ago
Spider ⭐ 6
URL Spider - web crawler and wordlist / ngram generator
most recent commit 4 months ago
Spidergo ⭐ 6
🪲 A spider(crawler) written in go.
total releases 1most recent commit 8 years ago
Go Warc ⭐ 6
A golang library to work with WARC files from the common crawl
most recent commit 6 years ago
Oaicrawl ⭐ 6
OAI crawler for strange endpoints.
total releases 1most recent commit 5 years ago
Avarus ⭐ 6
It is a Go crawler that acquires css, js, and images from the target page.
most recent commit 4 years ago
Scheduler ⭐ 6
Go orchestrator process used to schedule website parsing
most recent commit 4 years ago
12306 Go ⭐ 6
Use Go-resty to crawl 12306
most recent commit 5 years ago
Ads.txt Parser ⭐ 6
A reference implementation of ads.txt parsing code (currently focused on app-ads.txt)
most recent commit 5 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.