Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for golang webscraper
golang
x
webscraper
x
3 search results found
Crawlab
⭐
10,521
Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台,支持任何语言和框架
Hakrawler
⭐
4,120
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
Soup
⭐
2,074
Web Scraper in Go, similar to BeautifulSoup
Fetchbot
⭐
758
A simple and flexible web crawler that follows the robots.txt policies and crawl delays.
Dcrawl
⭐
411
Simple, but smart, multi-threaded web crawler for randomly gathering huge lists of unique domain names.
Google Maps Scraper
⭐
330
scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
Gopa
⭐
281
[WIP] GOPA, a spider written in Golang, for Elasticsearch. DEMO: http://index.elasticsearch.cn
Ant
⭐
271
A web crawler for Go
Crawley
⭐
208
The unix-way web crawler
Digger
⭐
180
Digger is a powerful and flexible web crawler implemented by pure golang
Antch
⭐
177
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
Goscrape
⭐
172
Web scraper that can create an offline readable version of a website
Cascadia
⭐
128
Go cascadia package command line CSS selector
Evine
⭐
117
Interactive CLI Web Crawler
Get Sauce
⭐
97
A command line program to download Hentai videos and images from multiple websites
Bathyscaphe
⭐
83
Fast, highly configurable, cloud native dark web crawler.
Gocrawler
⭐
60
A distributed web crawler implemented using Go, Postgres, RabbitMQ and Docker
Owlcrawler
⭐
54
Crawl the web using nats.io and Go
Scrapemate
⭐
39
Golang Crawling and scraping framework
Goscrapy
⭐
34
GoScrapy: Harnessing Go's power for efficient web scraping, inspired by Python's Scrapy framework.
Jsonscraper
⭐
33
JSON configurable concurrent scraper
Yast
⭐
23
Yet Another Streaming Tool
Spinarago
⭐
22
A basic web crawler written in Go
Kraken
⭐
19
A parallelised web crawler in Go
Scrape
⭐
18
Depth controllable Web scraper and Sitemap Generator in Go
Proxi
⭐
14
Proxy pool. Finds and checks proxies with rest api for querying results. Can find over 25k proxies in under 5 minutes.
Sentry
⭐
14
Parallelized web crawler written in Golang
Webcrawlertokopedia
⭐
13
It is a web crawler and scrapper for https://www.Tokopedia.com. The project scrape the product-ID, product URL and product videos present under the product images present at right bottom of the page.
Grabber
⭐
12
Grabber is a concurrent declarative web scraper and downloader
Td Spider
⭐
10
Via Text Density Simple Web Crawler With Go
Gsoup
⭐
10
A tiny web scraper written in Go with similar features to jsoup
Doubak
⭐
9
豆备 (Doubak) - 豆瓣 (Douban.com) 命令行版备份工具,备份完整页面镜像,Golang实现。
Go Playstore Scraper
⭐
7
An API and a web scraper lib for the Playstore
Suck
⭐
6
I eat c̶h̶i̶l̶d̶r̶e̶n̶ websites.
Golang Web Scraper
⭐
5
A tutorial for building a web scraper in Golang
Related Searches
Golang Command Line (8,308)
Golang Docker (7,769)
Golang Http (4,290)
Golang Server (4,285)
Javascript Golang (3,372)
Golang Database (2,927)
Golang Json (2,652)
Golang Proxy (2,577)
Golang Grpc (2,432)
Python Golang (2,332)
1-3 of 3 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.