Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Avbook | 8,777 | a year ago | 85 | PHP | ||||||
AV 电影管理系统, avmoo , javbus , javlibrary 爬虫,线上 AV 影片图书馆,AV 磁力链接数据库,Japanese Adult Video Library,Adult Video Magnet Links - Japanese Adult Video Database | ||||||||||
Angrysearch | 866 | 2 years ago | 37 | gpl-2.0 | Python | |||||
Linux file search, instant results as you type | ||||||||||
Filemasta | 646 | 2 years ago | 4 | gpl-3.0 | C# | |||||
A search application to explore, discover and share online files | ||||||||||
Warcdb | 380 | 5 months ago | 4 | October 22, 2023 | 7 | apache-2.0 | Python | |||
WarcDB: Web crawl data as SQLite databases. | ||||||||||
Gospider | 354 | 1 | a year ago | 3 | April 24, 2019 | 13 | mit | Go | ||
golang实现的爬虫框架,使用者只需关心页面规则,提供web管理界面。基于colly开发。 | ||||||||||
Pycrawler | 201 | 11 years ago | 5 | Python | ||||||
A python web crawler | ||||||||||
Adstxtcrawler | 168 | 5 months ago | 12 | Python | ||||||
A reference implementation in python of a simple crawler for Ads.txt | ||||||||||
Eth Indexer | 139 | 2 years ago | 37 | March 07, 2019 | 9 | lgpl-3.0 | Go | |||
An Ethereum project to crawl blockchain states into database | ||||||||||
Od Database | 113 | 4 years ago | 5 | mit | Python | |||||
Distributed crawler, database and web frontend for public directories indexing | ||||||||||
Starfish Ql | 111 | 2 | 9 months ago | 2 | April 03, 2022 | 2 | agpl-3.0 | Rust | ||
✴️ An experimental graph database |