Awesome Open Source

Programming Languages

The Top 23 Golang Scraper Open Source Projects

Open source projects categorized as Golang Scraper

Categories > Programming Languages > Golang

Categories > Data Processing > Scraper

Goscrape ⭐ 21

Structured scraper for Go

total releases 1most recent commit 6 years ago

Pillaging the seven seas for torrents, pieces of eight and other bounty.

most recent commit 2 years ago

📈 Create GIFs from user's GitHub activity graph

total releases 1most recent commit a year ago

Architeuthis ⭐ 18

MITM HTTP(S) proxy with integrated load-balancing, rate-limiting and error handling. Built for automated web scraping.

most recent commit 4 years ago

Googleanalytics_exporter ⭐ 18

Obtains Google Analytics RealTime metrics, and presents them to prometheus for scraping.

total releases 1most recent commit 4 years ago

Go API for Finviz

total releases 21most recent commit 2 years ago

Depth controllable Web scraper and Sitemap Generator in Go

total releases 1most recent commit 7 years ago

Thread Safe ⭐ 17

Keep your favorite Twitter threads safe with a local copy

total releases 4most recent commit a year ago

Go Recipe ⭐ 17

Go package for scraping website recipes

most recent commit a year ago

a simple, powerful scraping library

total releases 1most recent commit 5 years ago

Covid 19 ⭐ 16

Current and historical coronavirus covid-19 confirmed, recovered, deaths and active case counts segmented by country and region. Includes csv, json and sqlite data along with an interactive website explorer.

most recent commit 4 years ago

Go Scrapy ⭐ 16

Web crawling and scraping framework for Golang

most recent commit 6 years ago

A Go scraper that validates security.txt files and outputs them in the disclose.io JSON format.

total releases 3most recent commit 3 years ago

Goscholar ⭐ 15

Google scholar scraper written in Go

most recent commit 6 years ago

Smag Mvp ⭐ 15

Social Record - Distributed scraping and analysis pipeline for a range of social media platforms

most recent commit 4 years ago

Reddit Post Exporter ⭐ 15

Export desired amount of posts from specified subreddit and category/sort without any API wrappers

most recent commit 9 months ago

Youtube Ma ⭐ 15

💾 YouTube video metadata archiver written in Golang

total releases 11most recent commit 4 years ago

Dzone Refcardz Downloader ⭐ 15

Downloads all refcardz from https://dzone.com/refcardz

most recent commit 2 years ago

Emailscraper ⭐ 15

Minimalistic library to scrape emails from websites with headless browser support.

most recent commit 4 months ago

Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.

total releases 1most recent commit 4 years ago

Moviestills ⭐ 13

A small CLI app to scrap high-quality movie snapshots from various websites.

most recent commit 4 months ago

total releases 17most recent commit a year ago

Gochanges ⭐ 13

**[ARCHIVED]** website changes tracker 🔍

most recent commit a year ago

The 10 Latest Releases In Golang Scraper Open Source Projects

Qurl is a drop-in and easy to deploy microservice who exposes an HTTP API you can use to extract content from any web page as JSON. Any information available at a given public URL can be extracted using selector queries (check examples below).

total releases 1latest release October 01, 2017most recent commit 7 years ago

Instagram Go Scraper ⭐ 27

Instagram Scraper for Go

total releases 1latest release August 01, 2017most recent commit 7 years ago

Jsonscraper ⭐ 33

JSON configurable concurrent scraper

total releases 1latest release May 03, 2017most recent commit 7 years ago

A simple Go package to interact with Digikala website

total releases 4latest release March 25, 2017most recent commit 7 years ago

Go Latest ⭐ 120

Simple way to check version is latest or not from various sources in Golang

dependent packages 144total releases 1latest release March 13, 2017most recent commit 4 years ago

Scrape ⭐ 1,464

A simple, higher level interface for Go web scraping.

dependent packages 15total releases 1latest release November 28, 2016most recent commit 7 years ago

Twitscrape ⭐ 11

Twitscrape is a library written in Go that allows you to search for tweets without authentication!

total releases 1latest release November 05, 2016most recent commit 7 years ago

Simple Query Scraping with CSS and Go Reflection (MOVED to Gitlab)

total releases 1latest release October 21, 2016most recent commit 8 years ago

Etcd Metrics Proxy ⭐ 8

Proxy metrics from secure etcd over http.

total releases 2latest release October 13, 2016most recent commit 8 years ago

Still Good Food ⭐ 172

Being a scraper to save a BBC good food recipe

total releases 1latest release June 25, 2016most recent commit 8 years ago

Popular Programming Languages Categories

Categories

Application Programming Interfaces

Artificial Intelligence

Cloud Computing

Command Line Interface

Computer Science

Configuration Management

Content Management

Data Processing

Integrated Development Environments

Learning Resources

Lists Of Projects

Machine Learning

Operating Systems

Package Managers

Programming Languages

Runtime Environments

Software Architecture

Software Development

Software Performance

Software Quality

Text Processing

User Interface Components

Version Control

Web User Interface

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.