Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Scrapy Examples | 2,550 | 6 years ago | 6 | Python | ||||||
Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc. | ||||||||||
Scrapy Proxies | 1,376 | 5 years ago | 17 | December 21, 2017 | 35 | mit | Python | |||
Random proxy middleware for Scrapy | ||||||||||
Faster Than Requests | 1,061 | 4 | 3 months ago | 18 | February 24, 2021 | mit | Nim | |||
Faster requests on Python 3 | ||||||||||
Scrapy Rotating Proxies | 474 | 8 | 1 | 3 years ago | 13 | May 25, 2019 | 40 | mit | Python | |
use multiple proxies with Scrapy | ||||||||||
Scrapy Zyte Smartproxy | 348 | 29 | 2 months ago | 16 | December 01, 2020 | 7 | bsd-3-clause | Python | ||
Zyte Smart Proxy Manager (formerly Crawlera) middleware for Scrapy | ||||||||||
Httpproxymiddleware | 318 | 6 years ago | mit | Python | ||||||
A middleware for scrapy. Used to change HTTP proxy from time to time. | ||||||||||
Smartproxy | 276 | 8 months ago | 2 | mit | C# | |||||
HTTP(S)/SOCKS5 Rotating Residential proxies - Code examples & General information | ||||||||||
Fp Server | 154 | 2 years ago | 7 | mit | Python | |||||
Free proxy server, continuously crawling and providing proxies, based on Tornado and Scrapy. 免费代理服务器,基于Tornado和Scrapy,在本地搭建属于自己的代理池 | ||||||||||
Aox_proxy_pool | 103 | 5 years ago | 4 | apache-2.0 | Python | |||||
本项目是为了解决在抓取代理ip后, 代理ip失效快, 不稳定的问题 以及代理ip使用不方便等问题。 | ||||||||||
Java Curl | 92 | 2 years ago | 5 | July 23, 2019 | 7 | apache-2.0 | Java | |||
Pure java CURL implementation |