Metafinder
Search for documents in a domain through Search Engines (Google, Bing and Baidu). The objective is to extract metadata
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Photon | 10,244 | 5 | 4 months ago | 18 | January 25, 2019 | 52 | gpl-3.0 | Python | ||
| Incredibly fast crawler designed for OSINT. | ||||||||||
| Hakrawler | 4,120 | 3 months ago | 11 | February 22, 2021 | 9 | gpl-3.0 | Go | |||
| Simple, fast web crawler designed for easy, quick discovery of endpoints and assets within a web application | ||||||||||
| Torbot | 2,338 | 4 months ago | 6 | other | Python | |||||
| Dark Web OSINT Tool | ||||||||||
| Cariddi | 1,228 | 3 months ago | 15 | June 09, 2023 | 8 | gpl-3.0 | Go | |||
| Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more | ||||||||||
| Gosint | 567 | 3 years ago | 16 | gpl-3.0 | Go | |||||
| OSINT Swiss Army Knife | ||||||||||
| Vault | 477 | 9 months ago | 8 | mit | Python | |||||
| swiss army knife for hackers | ||||||||||
| Scavenger | 384 | 3 years ago | mit | Python | ||||||
| Crawler (Bot) searching for credential leaks on paste sites. | ||||||||||
| Orbit | 370 | 2 years ago | 6 | gpl-3.0 | Python | |||||
| Blockchain Transactions Investigation Tool | ||||||||||
| Linkedindumper | 337 | 4 months ago | Python | |||||||
| Python 3 script to dump/scrape/extract company employees from LinkedIn API | ||||||||||
| Webpalm | 295 | 2 | 6 months ago | 8 | June 19, 2023 | 1 | gpl-3.0 | Go | ||
| WebPalm is a powerful command-line tool for website mapping and web scraping. With its recursive approach, it can generate a complete tree of all webpages and their links on a website. It can also extract data from the body of each page using regular expressions, making it an ideal tool for web scraping and data extraction. | ||||||||||
Alternatives To MetafinderSelect To Compare
Alternative Project Comparisons
Popular Crawler Projects
Popular Osint Projects
Popular Data Processing Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Crawler
Osint