Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Arachni | 3,632 | a year ago | 134 | other | Ruby | |||||
Web Application Security Scanner Framework | ||||||||||
Skrape.it | 714 | 3 | 4 months ago | 14 | July 19, 2022 | 25 | mit | Kotlin | ||
A Kotlin-based testing/scraping/parsing library providing the ability to analyze and extract data from HTML (server & client-side rendered). It places particular emphasis on ease of use and a high level of readability by providing an intuitive DSL. It aims to be a testing lib, but can also be used to scrape websites in a convenient fashion. | ||||||||||
Crawljax | 493 | 28 | 6 | a year ago | 18 | June 01, 2023 | 67 | apache-2.0 | Java | |
Crawljax | ||||||||||
Domdig | 348 | 5 months ago | gpl-3.0 | JavaScript | ||||||
DOM XSS scanner for Single Page Applications | ||||||||||
Scraply | 114 | 2 years ago | 1 | July 07, 2022 | apache-2.0 | Go | ||||
Scraply a simple dom scraper to fetch information from any html based website | ||||||||||
Google Ajax Crawler | 58 | 1 | 9 years ago | 5 | July 13, 2013 | 2 | mit | Ruby | ||
Rack Middleware adhering to the Google Ajax Crawling Scheme, using a headless browser to render JS heavy pages and serve a dom snapshot of the rendered state to a requesting search engine. | ||||||||||
Dom Query | 46 | 7 years ago | November 24, 2023 | 4 | mit | PHP | ||||
A jQuery-like interface for DOM Crawling | ||||||||||
Html Query | 45 | 6 years ago | 1 | May 05, 2018 | bsd-2-clause | Go | ||||
A fluent and functional approach to querying HTML | ||||||||||
Burp Dom Scanner | 42 | a year ago | 2 | gpl-3.0 | Java | |||||
Burp Suite's extension to scan and crawl Single Page Applications | ||||||||||
Yurun Crawler | 28 | 1 | 4 years ago | 3 | September 01, 2020 | mit | PHP | |||
宇润爬虫框架(Yurun Crawler) 是一个低代码、高性能、分布式爬虫采集框架,基于 imi 框架开发,运行在 Swoole 常驻内存的协程环境。 |