Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
The Top 10 Web Webscraper Open Source Projects
Open source projects categorized as Web Webscraper
Categories
>
Networking
>
Web
Edit Category
BruceDone/awesome-crawler
⭐
5,859
A collection of awesome web crawler,spider in different languages
dependent packages
0
total releases
0
most recent commit
over 2 years ago
hakluke/hakrawler
⭐
4,120
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
dependent packages
0
total releases
0
most recent commit
over 2 years ago
CrawlScript/WebCollector
⭐
2,974
WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
dependent packages
0
total releases
0
most recent commit
about 3 years ago
tholian-network/stealth
⭐
923
:rocket: Stealth - Secure, Peer-to-Peer, Private and Automateable Web Browser/Scraper/Proxy
dependent packages
0
total releases
0
most recent commit
over 2 years ago
postmodern/spidr
⭐
775
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
dependent packages
0
total releases
0
most recent commit
over 2 years ago
benibela/xidel
⭐
611
Command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3.0, XQuery 3.0, JSONiq or pattern matching. It can also create new or transformed XML/HTML/JSON documents.
dependent packages
0
total releases
0
most recent commit
over 2 years ago
rivermont/spidy
⭐
287
The simple, easy to use command line web crawler.
dependent packages
0
total releases
0
most recent commit
about 4 years ago
salimk/Rcrawler
⭐
240
An R web crawler and scraper
dependent packages
0
total releases
0
most recent commit
about 6 years ago
zntfdr/Selenops
⭐
215
A Swift Web Crawler 🕷
dependent packages
0
total releases
0
most recent commit
over 5 years ago
antchfx/antch
⭐
177
Antch, a fast, powerful and extensible web crawling & scraping framework for Go
dependent packages
0
total releases
0
most recent commit
about 6 years ago
Get A Weekly Email With Trending Web Projects
No Spam. Unsubscribe easily at any time.
Web
Webscraper
Subscribe
Javascript must be enabled to subscribe.
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2026 Awesome Open Source. All rights reserved.
