Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for golang scraper
golang
x
scraper
x
72 search results found
Lux
⭐
24,752
👾 Fast and simple video download library and CLI tool written in Go
Colly
⭐
21,902
Elegant Scraper and Crawler Framework for Golang
Ferret
⭐
5,540
Declarative web scraping
Rod
⭐
4,505
A Devtools driver for web automation and scraping
Soup
⭐
2,074
Web Scraper in Go, similar to BeautifulSoup
Geziyor
⭐
1,892
Geziyor, blazing fast web crawling & scraping framework for Go. Supports JS rendering.
Scrape
⭐
1,464
A simple, higher level interface for Go web scraping.
Snmp_exporter
⭐
1,433
SNMP Exporter for Prometheus
Cariddi
⭐
1,228
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
Mangal
⭐
981
📖 The most advanced (yet simple) cli manga downloader in the entire universe! Lua scrapers, export formats, anilist integration, fancy TUI and more!
Till
⭐
770
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes.
Twitter Scraper
⭐
769
Scrape the Twitter frontend API without authentication with Golang.
Finance Go
⭐
620
📊 Financial markets data library implemented in go.
Lyricfier
⭐
591
a Spotify Lyrics alternative app | New updates at https://github.com/emilioastarita/lyricfier2 (a faster version in golang)
Gosint
⭐
567
OSINT Swiss Army Knife
Dataflowkit
⭐
394
Extract structured data from web sites. Web sites scraping.
Scraper
⭐
385
A scraper for EmulationStation written in Go using hashing
Real World Plantuml
⭐
342
Source code of https://real-world-plantuml.com/
Gopa
⭐
281
[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn
Go Structurizr
⭐
274
A library for auto-generating C4 diagrams from Go applications
Ant
⭐
271
A web crawler for Go
Torrodle
⭐
198
⚡️ A magnet link scraper for streaming videos (movies, tv shows, anime, porn) along with subtitles.
Gmdb
⭐
189
GMDB is the ultra-simple, cross-platform Movie Library with Features (Search, Take Note, Watch Later, Like, Import, Learn, Instantly Torrent Magnet Watch)
Antch
⭐
177
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Spider
⭐
173
Scheduler of spiders for scraping and parsing HTML and JSON pages
Goscrape
⭐
172
Web scraper that can create an offline readable version of a website
Still Good Food
⭐
172
Being a scraper to save a BBC good food recipe
Go Jd
⭐
171
京东App自动登录,在线商品自动下单
Goribot
⭐
162
[Crawler/Scraper for Golang]🕷A lightweight distributed friendly Golang crawler framework.一个轻量的分布式友好的 Golang 爬虫框架。
Demeter
⭐
162
Demeter is a tool for scraping the calibre web ui
Xquery
⭐
155
Extract data or evaluate value from HTML/XML documents using XPath
Sqrape
⭐
145
Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)
Amazon Scraper
⭐
140
Free Trial Amazon Scraper API for extracting search, product, offer listing, reviews, question and answers, best sellers and sellers data.
Spidy
⭐
138
Domain names collector - Crawl websites and collect domain names along with their availability status.
Dmm Scraper
⭐
126
DMM 影片内容刮削器
Papeer
⭐
126
Scrape the web in the eink era. Convert websites into ebooks and markdown.
Scrape
⭐
125
CLI utility to scrape emails from websites
Go Latest
⭐
120
Simple way to check version is latest or not from various sources in Golang
Evine
⭐
117
Interactive CLI Web Crawler
Scraply
⭐
114
Scraply a simple dom scraper to fetch information from any html based website
Headlesschrome
⭐
112
A Go package for working with headless Chrome. Run interactive JavaScript commands on web pages with Go and Chrome.
Blinkist M4a Downloader
⭐
97
Grabs all of the audio files from all of the Blinkist books
Scraperboard
⭐
94
Golang library to easily scrape websites based on simple XML declarations
Memento
⭐
92
Open-source Ethereum data scraper and indexer developed by Alethio
Fitter
⭐
91
New way for collect information from the API's/Websites
Pastego
⭐
91
Scrape/Parse Pastebin using GO and expression grammar (PEG)
Torrengo
⭐
87
Torrengo is a CLI (command line) program written in Go which concurrently searches torrents from various sources.
Jsongenius
⭐
85
Get structured JSON data from any page.
Godm
⭐
82
The Fast And Advanced Discord Multi-Tool
Dashboard Metrics Scraper
⭐
80
Container to scrape, store, and retrieve a window of time from the Metrics Server.
Dorkscout
⭐
78
DorkScout - Golang tool to automate google dork scan against the entiere internet or specific targets
Google Play Scraper
⭐
73
Golang scraper to get data from Google Play Store
Iterscraper
⭐
72
Scrape URLs that contain an incrementing integer ID in the path
Rrip
⭐
66
Bulk image downloader for reddit.
Collyzar
⭐
65
Distributed redis-based web crawler framework for colly
Go Metainspector
⭐
64
Simple web scraping for Go.
Grab
⭐
62
Configurable Scraper & Downloader, Powered by RegExp and Go
Goscraper
⭐
58
Golang pkg to quickly return a preview of a webpage (title/description/images)
Feedbridge
⭐
57
Plugin based RSS feed generator for sites that don't offer any. Serves RSS, Atom and JSON Feeds.
Scrape
⭐
55
Extensible paste site scraper written in Golang.
Zookeeper_exporter
⭐
54
Prometheus exporter for Zookeeper
Tool Gin
⭐
54
基于go-gin框架建立减少冗余动作项目,如:下载一些工具
Captcha Tools
⭐
53
All-in-one Python (And now Go!) module to help solve captchas with Capmonster, 2captcha, Anticaptcha, and Capsolver API's!
Scraper
⭐
49
A dual interface Go module for building simple web scrapers
Ultimate Guitar Scraper
⭐
48
A simple scraper for Ultimate-Guitar.com's mobile API, written in Go.
Goreadability
⭐
47
Webpage summary extractor using Facebook Open Graph and arc90's readability
Fiven1 Rent Scraper
⭐
47
🏠 a.k.a 591 rent scraper(591 租屋網爬蟲)
Gpes Check My Pages
⭐
43
Scrapping script used to test the Spanish web archive and redirects system, with more than 10,000 pages. It checks redirections, http responses, analytics, files hosted in soon-to-die servers, canonical urls and more.
Proxifier
⭐
43
A fast, modern and intelligent proxy rotator perfect for crawling and scraping public data.
Rex
⭐
43
Reverse Engineered Twitter's API
Go Web Scraping Quick Start Guide
⭐
41
Go Web Scraping Quick Start Guide, published by Packt
Goclone
⭐
41
🌱 goclone - clone websites in a matter of seconds
Scrapemate
⭐
39
Golang Crawling and scraping framework
Gentlemanspider
⭐
39
基于colly,支持标签(xp)筛选和多线程加速的绅士漫画爬虫优雅实现
Restify
⭐
37
Enables REST-like access to HTML pages by scraping and parsing them into JSON.
Ua
⭐
36
Universal Aggregator
Image Scraper
⭐
34
Fast concurrent image scraper
Go Crawler
⭐
33
A web crawling framework implemented in Golang, it is simple to write and delivers powerful performance. It comes with a wide range of practical middleware and supports various parsing and storage methods. Additionally, it supports distributed deployment. 基于golang实现的爬虫框架,编写简单,性能强劲。内置了丰富的实用中间件,支持多种解析、保存方式,
Piratebay
⭐
33
A Go library implementing robust and comprehensive searching of PirateBay
Jsonscraper
⭐
33
JSON configurable concurrent scraper
Wdg Projects
⭐
32
A list of /wdg/ personal projects https://wdg.one/
Pastebin_scraper
⭐
32
golang program to parse Pastebin for keywords and send them per E-Mail
Golinkedin
⭐
31
Golinkedin is a library written in pure golang for scraping Linkedin
Grawler
⭐
31
A web crawler / scraper engine written in Golang
Gopher Parse Sitemap
⭐
28
A high effective golang library for parsing big-sized sitemaps and avoiding high memory usage. The sitemap parser was written on golang without external dependencies.
Newser
⭐
28
Newser is a simple utility to generate a pdf with you favorite news articles
Qtrn
⭐
27
A cli tool to streamline financial markets data analysis 🔧
Colly Sqlite3 Storage
⭐
27
A SQLite3 storage back end for the Colly web crawling/scraping framework https://go-colly.org
Goskyr
⭐
27
A configurable command-line web scraper written in go with auto configuration capability
Ps_helper
⭐
27
Code and Executables for easy manipulation of the PSD station preference form
Instagram Go Scraper
⭐
27
Instagram Scraper for Go
Infosec Alfred
⭐
25
Scrap Latest Information Security Resources
Go Ps4
⭐
25
Search your favorite PS4 games from Playstation Store using the Command Line
Go Wenku Downloader
⭐
24
Go轻小说文库下载工具
Imdb Api
⭐
23
[🚧 WIP] Cross-platform microservice to scrape the IMDb website.
Ferret Server
⭐
22
Advanced declarative web scraping
Api Flight.com
⭐
22
Main API Flight Git Repository
Xdsl Exporter
⭐
22
xDSL Prometheus Exporter
Gogetjs
⭐
21
a tool for extracting, searching, and saving JavaScript files (with optional headless browser)
Zcrawl
⭐
21
An open source web crawling platform
Related Searches
Golang Command Line (8,308)
Golang Docker (7,769)
Golang Http (4,290)
Golang Server (4,285)
Python Scraper (3,513)
Javascript Golang (3,372)
Golang Database (2,927)
Golang Json (2,652)
Golang Proxy (2,606)
Golang Grpc (2,432)
1-72 of 72 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.