Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for crawler osint
crawler
x
osint
x
23 search results found
Photon
⭐
10,244
Incredibly fast crawler designed for OSINT.
Hakrawler
⭐
4,120
Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application
Torbot
⭐
2,338
Dark Web OSINT Tool
Cariddi
⭐
1,228
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more
Gosint
⭐
567
OSINT Swiss Army Knife
Vault
⭐
477
swiss army knife for hackers
Scavenger
⭐
384
Crawler (Bot) searching for credential leaks on paste sites.
Orbit
⭐
370
Blockchain Transactions Investigation Tool
Linkedindumper
⭐
337
Python 3 script to dump/scrape/extract company employees from LinkedIn API
Webpalm
⭐
295
WebPalm is a powerful command-line tool for website mapping and web scraping. With its recursive approach, it can generate a complete tree of all webpages and their links on a website. It can also extract data from the body of each page using regular expressions, making it an ideal tool for web scraping and data extraction.
Cc.py
⭐
226
Extracting URLs of a specific target based on the results of "commoncrawl.org"
Pryingdeep
⭐
196
Prying Deep - An OSINT tool to collect intelligence on the dark web.
Torcrawl.py
⭐
187
Crawl and extract (regular or onion) webpages through TOR network
D4n155
⭐
147
OWASP D4N155 - Intelligent and dynamic wordlist using OSINT
Metafinder
⭐
138
Search for documents in a domain through Search Engines (Google, Bing and Baidu). The objective is to extract metadata
Grawler
⭐
128
Grawler is a tool written in PHP which comes with a web interface that automates the task of using google dorks, scrapes the results, and stores them in a file.
Evine
⭐
117
Interactive CLI Web Crawler
Poopak
⭐
110
POOPAK - TOR Hidden Service Crawler
Dorkscout
⭐
78
DorkScout - Golang tool to automate google dork scan against the entiere internet or specific targets
Bucketlist
⭐
68
Amazon S3 bucket spelunking!
Emailfinder
⭐
65
Search emails from a domain through search engines
Web Iota
⭐
60
Iota is a web scraper which can find all of the images and links/suburls on a webpage
Harvester
⭐
59
Web crawling and document processing through a usable interface.
Xingdumper
⭐
24
Python 3 script to dump/scrape/extract company employees from XING API
Darkspider
⭐
20
Anatomy and Visualization of the Network structure of the Dark web using multi-threaded crawler
Frisbee
⭐
19
Collect email addresses by crawling search engine results.
Dorker
⭐
18
Better Google Dorking with Dorker.
Pasta
⭐
15
A PasteBin scrapper that doesnt rely on the PasteBin scrape API
Osintretasnohaypastebines
⭐
11
Trabajo de OSINT para búsqueda de patrones en pastebin.
Censys Certif Crawl
⭐
10
Crawl certificate information from censys
Arachnid
⭐
7
An OSINT tool to find data leaks on a targeted website
Recon Archy
⭐
5
Linkedin Tools (and maybe later other source) to reconstruct a company hierarchy from scraping relations and jobs title
Related Searches
Python Crawler (4,545)
Javascript Crawler (1,142)
Crawler Spider (1,106)
Crawler Scrapy (988)
Scraper Crawler (896)
Java Crawler (807)
Python Osint (666)
Golang Crawler (499)
1-23 of 23 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.