Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Proxy_pool | 19,442 | 4 months ago | 273 | mit | Python | |||||
Python ProxyPool for web spider | ||||||||||
Scrapyd | 2,766 | 187 | 15 | 3 months ago | 11 | September 25, 2023 | 31 | bsd-3-clause | Python | |
A service daemon to run Scrapy spiders | ||||||||||
Crawler User Agents | 1,045 | 5 | 8 | 4 months ago | 118 | November 20, 2023 | 7 | mit | Python | |
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome :star: | ||||||||||
Scrapyrt | 793 | 5 | 6 months ago | 7 | September 20, 2023 | 31 | bsd-3-clause | Python | ||
HTTP API for Scrapy spiders | ||||||||||
Sasila | 264 | 5 years ago | 17 | November 02, 2017 | 1 | apache-2.0 | Python | |||
一个灵活、友好的爬虫框架 | ||||||||||
Ignareo Isml Auto Voter | 186 | 7 months ago | 20 | mit | Python | |||||
Ignareo the Carillon, a web crawler/spider template of ultimate high concurrency built for leprechauns. Carillons as the best web spiders; Long live the golden years of leprechauns! (ISML=international saimoe; 2022 ISML is last ISML) | ||||||||||
Fink | 168 | 2 | 3 years ago | 16 | January 28, 2021 | 22 | mit | PHP | ||
PHP Link Checker | ||||||||||
Ok_ip_proxy_pool | 123 | 4 years ago | 1 | mit | Python | |||||
🍿爬虫代理IP池(proxy pool) python🍟一个还ok的IP代理池 | ||||||||||
Autologin | 106 | 2 years ago | 5 | May 24, 2017 | 12 | apache-2.0 | Python | |||
A project to attempt to automatically login to a website given a single seed | ||||||||||
Scrapy_ipproxypool | 86 | 6 years ago | 4 | Python | ||||||
免费 IP 代理池。Scrapy 爬虫框架插件 |