Project Name	Stars	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Wayback Machine Scraper	219	3 years ago	8	February 15, 2021	2	isc	Python
A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
Selenops	215	3 years ago				mit	Swift
A Swift Web Crawler 🕷
Weboptout	191	4 months ago	6	August 30, 2023	12	other	Python
Opt-Out tool to check Copyright reservations in a way that even machines can understand.
Gotor	150	5 months ago	3	November 10, 2022	3	gpl-3.0	Go
This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.
Cascadia	128	10 months ago	9	June 30, 2023	1	mit	Go
Go cascadia package command line CSS selector
Clauneck	57	10 months ago	2	July 10, 2023		mit	Ruby
A tool for scraping emails, social media accounts, and much more information from websites using Google Search Results.
Scrapy Bench	25	3 years ago			8	mit	Python
A CLI for benchmarking Scrapy.
Yast	23	a year ago			14	bsd-3-clause	Go
Yet Another Streaming Tool
Super Anime Downloader	17	3 years ago			9		Python
A program which takes an Anime name or URL and downloads the specified range of episodes.
Scrape	9	4 years ago			1	gpl-3.0	JavaScript
When you need those jobs hypersonic 🚀 scrape 🔪

Alternatives To Weboptout

Select To Compare

Wayback Machine Scraper ⭐ 219

A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.

total releases 8most recent commit 3 years ago

Selenops ⭐ 215

A Swift Web Crawler 🕷

most recent commit 3 years ago

Weboptout ⭐ 191

Opt-Out tool to check Copyright reservations in a way that even machines can understand.

total releases 6most recent commit 4 months ago

Gotor ⭐ 150

This program provides efficient web scraping services for Tor and non-Tor sites. The program has both a CLI and REST API.

total releases 3most recent commit 5 months ago

Cascadia ⭐ 128

Go cascadia package command line CSS selector

total releases 9most recent commit 10 months ago

Clauneck ⭐ 57

A tool for scraping emails, social media accounts, and much more information from websites using Google Search Results.

total releases 2most recent commit 10 months ago

Scrapy Bench ⭐ 25

A CLI for benchmarking Scrapy.

most recent commit 3 years ago

Yast ⭐ 23

Yet Another Streaming Tool

most recent commit a year ago

Super Anime Downloader ⭐ 17

A program which takes an Anime name or URL and downloads the specified range of episodes.

most recent commit 3 years ago

Scrape ⭐ 9

When you need those jobs hypersonic 🚀 scrape 🔪

most recent commit 4 years ago

Suggest An Alternative To weboptout

Alternative Project Comparisons

Weboptout vs Wayback Machine Scraper

Weboptout vs Selenops

Weboptout vs Gotor

Weboptout vs Cascadia

Weboptout vs Clauneck

Weboptout vs Scrapy Bench

Weboptout vs Yast

Weboptout vs Super Anime Downloader

Weboptout vs Scrape

Popular Command Line Tool Projects

Ripgrep ⭐ 44,855

ripgrep recursively searches directories for a regex pattern while respecting your gitignore

dependent packages 348total releases 37latest release November 26, 2023most recent commit 5 days ago

Pm2 ⭐ 40,603

Node.js Production Process Manager with a built-in Load Balancer.

dependent packages 1,872total releases 278latest release March 15, 2023most recent commit a month ago

The_silver_searcher ⭐ 25,423

A code-searching tool similar to ack, but faster.

total releases 2latest release August 25, 2018most recent commit 4 months ago

Fx ⭐ 17,717

Terminal JSON viewer & processor

dependent packages 21total releases 61latest release November 10, 2023most recent commit 6 months ago

Gitui ⭐ 16,965

Blazing 💥 fast terminal-ui for git written in rust 🦀

dependent packages 3total releases 3latest release January 06, 2023most recent commit 10 days ago

Popular Web Crawler Projects

Scrapy ⭐ 49,918

Scrapy, a fast high-level web crawling & scraping framework for Python.

dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months ago

Huginn ⭐ 41,465

Create agents that monitor and act on your behalf. Your agents are standing by!

dependent packages 52total releases 8latest release September 22, 2017most recent commit 20 days ago

Changedetection.io ⭐ 13,943

The best and simplest free open source website change detection, website watcher, restock monitor and notification service. Restock Monitor, change detection. Designed for simplicity - Simply monitor which websites had a text change for free. Free Open source web page change detection, Website defacement monitoring, Price change notification

most recent commit 3 months ago

Crawlee ⭐ 12,106

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

dependent packages 42total releases 747latest release December 10, 2023most recent commit 5 days ago

Crawlab ⭐ 10,521

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

total releases 1latest release March 03, 2019most recent commit 4 months ago

Popular Applications Categories