Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Photon | 10,244 | 5 | 4 months ago | 18 | January 25, 2019 | 52 | gpl-3.0 | Python | ||
Incredibly fast crawler designed for OSINT. | ||||||||||
Manspider | 779 | 6 months ago | 5 | February 18, 2022 | 12 | gpl-3.0 | Python | |||
Spider entire networks for juicy files sitting on SMB shares. Search filenames or file content - regex supported! | ||||||||||
Huntsman | 349 | 3 | 5 | 4 years ago | 25 | September 21, 2015 | 6 | JavaScript | ||
Super configurable async web spider | ||||||||||
Scrapingspider | 73 | 11 years ago | 1 | C# | ||||||
业余时间开发的,支持多线程,支持关键字过滤,支持正文内容智能识别的爬虫。 | ||||||||||
Siren | 47 | 11 years ago | Python | |||||||
spider framework and utils written by python | ||||||||||
Simplespider | 20 | 4 years ago | 13 | March 24, 2020 | Python | |||||
A library of Spider which can simpify the code. | ||||||||||
Emailscraper | 9 | 7 years ago | mit | Python | ||||||
A Scrapy script to spider a website and scrape all emails using a regex. | ||||||||||
Matchers | 5 | 5 years ago | bsd-3-clause | Python | ||||||
打造最好用的万能解析神器/Create the Best Universal Resolution Artifact | ||||||||||
Spider | 5 | 7 years ago | Python | |||||||
Web Spider |