Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Chatweb | 573 | a year ago | 4 | Python | ||||||
ChatWeb can crawl web pages, read PDF, DOCX, TXT, and extract the main content, then answer your questions based on the content, or summarize the key points. | ||||||||||
Nodejs Stuff | 484 | 5 years ago | other | |||||||
Node.js libs I want to keep in mind. | ||||||||||
Holoapi | 106 | 3 years ago | 15 | gpl-3.0 | JavaScript | |||||
Platform to serve Hololive content to the community tools. | ||||||||||
Lcbo Api | 85 | 4 years ago | 24 | gpl-3.0 | JavaScript | |||||
A crawler and API server for Liquor Control Board of Ontario retail data | ||||||||||
Bucketlist | 68 | 7 years ago | 1 | mit | HTML | |||||
Amazon S3 bucket spelunking! | ||||||||||
Gocrawler | 60 | 3 years ago | mit | Go | ||||||
A distributed web crawler implemented using Go, Postgres, RabbitMQ and Docker | ||||||||||
Ayugespidertools | 46 | 4 months ago | 74 | September 15, 2023 | mit | Python | ||||
使 scrapy 开发不用在意 item,pipeline,middleware 等通用场景下模块的编写,解放开发者的双手。 | ||||||||||
Sequell | 40 | 4 months ago | 3 | Ruby | ||||||
##crawl bot Sequell; depends on https://github.com/crawl/go-sequell | ||||||||||
Relspider | 28 | 10 years ago | 6 | JavaScript | ||||||
A web crawler that indexes the identity/social graph of profiles on the web | ||||||||||
Crawld | 25 | 6 years ago | 1 | March 17, 2018 | 5 | bsd-3-clause | Go | |||
A data crawler and repositories fetcher |