Project Name	Stars	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Hakrawler	4,120	3 months ago	11	February 22, 2021	9	gpl-3.0	Go
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
Spidersuite	447	7 months ago			3	gpl-3.0
Advance web spider/crawler for cyber security professionals
Stardox	166	2 years ago			1	gpl-3.0	Python
Github stargazers information gathering tool

Alternatives To Stardox

Select To Compare

Hakrawler ⭐ 4,120

Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application

total releases 11most recent commit 3 months ago

Spidersuite ⭐ 447

Advance web spider/crawler for cyber security professionals

most recent commit 7 months ago

Stardox ⭐ 166

Github stargazers information gathering tool

most recent commit 2 years ago

Suggest An Alternative To Stardox

Alternative Project Comparisons

Stardox vs Hakrawler

Stardox vs Spidersuite

Popular Web Crawler Projects

Scrapy ⭐ 49,918

Scrapy, a fast high-level web crawling & scraping framework for Python.

dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months ago

Huginn ⭐ 40,328

Create agents that monitor and act on your behalf. Your agents are standing by!

dependent packages 52total releases 8latest release September 22, 2017most recent commit 3 months ago

Changedetection.io ⭐ 13,943

The best and simplest free open source website change detection, website watcher, restock monitor and notification service. Restock Monitor, change detection. Designed for simplicity - Simply monitor which websites had a text change for free. Free Open source web page change detection, Website defacement monitoring, Price change notification

most recent commit 3 months ago

Crawlee ⭐ 11,957

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

dependent packages 42total releases 747latest release December 10, 2023most recent commit 5 days ago

Crawlab ⭐ 10,521

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

total releases 1latest release March 03, 2019most recent commit 3 months ago

Popular Recon Projects

Amass ⭐ 11,124

In-depth attack surface mapping and asset discovery

dependent packages 3total releases 116latest release June 20, 2023most recent commit 10 days ago

Spiderfoot ⭐ 11,035

SpiderFoot automates OSINT for threat intelligence and mapping your attack surface.

most recent commit 3 months ago

Theharvester ⭐ 10,249

E-mails, subdomains and names Harvester - OSINT

total releases 2latest release February 04, 2019most recent commit 8 days ago

Red Teaming Toolkit ⭐ 8,230

This repository contains cutting-edge open-source security tools (OST) for a red teamer and threat hunter.

most recent commit 3 months ago

Oneforall ⭐ 7,315

OneForAll是一款功能强大的子域收集工具

most recent commit 3 months ago

Popular Data Processing Categories