Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Laravel Sitemap | 2,122 | 69 | 32 | 4 months ago | 64 | October 24, 2023 | 2 | mit | PHP | |
Create and generate sitemaps with ease | ||||||||||
Domain_hunter | 658 | a year ago | 4 | mit | Java | |||||
A Burp Suite Extension that try to find all sub-domain, similar-domain and related-domain of an organization automatically! 基于流量自动收集整个企业或组织的子域名、相似域名、相关域名的burp插件 | ||||||||||
Sitemap Generator | 331 | 74 | 27 | a year ago | 61 | September 11, 2020 | 32 | mit | JavaScript | |
Easily create XML sitemaps for your website. | ||||||||||
Supercrawler | 324 | 1 | 3 | 2 years ago | 45 | November 24, 2019 | 19 | apache-2.0 | JavaScript | |
A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and concurrency limits. | ||||||||||
Python Sitemap | 287 | 2 years ago | 18 | gpl-3.0 | Python | |||||
Mini website crawler to make sitemap from a website. | ||||||||||
Seo Audits Toolkit | 284 | a year ago | 31 | Python | ||||||
SEO & Security Audit for Websites. Lighthouse & Security Headers crawler, Sitemap/Keywords/Images Extractor, Summarizer, etc ... | ||||||||||
Sitemap Generator Cli | 259 | 7 | 2 | a year ago | 30 | January 21, 2020 | 29 | mit | JavaScript | |
Creates an XML-Sitemap by crawling a given site. | ||||||||||
Crawler Commons | 217 | 26 | 7 | 6 months ago | 10 | July 13, 2023 | 30 | apache-2.0 | Java | |
A set of reusable Java components that implement functionality common to any web crawler | ||||||||||
Sitemap Generator Crawler | 208 | a year ago | 20 | mit | PHP | |||||
PHP script to recursively crawl websites and generate a sitemap. Zero dependencies. | ||||||||||
Rubyretriever | 139 | 6 | 1 | a year ago | 29 | April 12, 2016 | 6 | other | Ruby | |
Asynchronous Web Crawler & Scraper |