Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Splash	3,860	9	1	9 months ago	30	June 16, 2020	397	bsd-3-clause	Python
Lightweight, scriptable browser as a service with an HTTP API
Scrapyd	2,766	187	15	3 months ago	11	September 25, 2023	31	bsd-3-clause	Python
A service daemon to run Scrapy spiders
Scrapyrt	793	5		6 months ago	7	September 20, 2023	31	bsd-3-clause	Python
HTTP API for Scrapy spiders
Arachnado	148	1		2 years ago	1	August 07, 2015	21		Python
Web Crawling UI and HTTP API, based on Scrapy and Tornado
Autologin	106			2 years ago	5	May 24, 2017	12	apache-2.0	Python
A project to attempt to automatically login to a website given a single seed
Docs	102			5 years ago			3
《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题；HTTP协议介绍； Requests使用；解析器Xpath介绍； MongoDB与MySQL；多线程爬虫； Scrapy介绍；Scrapy-redis介绍；使用docker部署；使用nomad管理docker集群；使用EFK查询docker日志
Scrapy_ipproxypool	86			6 years ago			4		Python
免费 IP 代理池。Scrapy 爬虫框架插件
Awesome Python Primer	78			2 years ago				mit	Python
自学入门 Python 优质中文资源索引，包含书籍 / 文档 / 视频，适用于爬虫 / Web / 数据分析 / 机器学习方向
Python Sdk	54		2	10 months ago	13	October 10, 2022		bsd-2-clause	Python
快代理API SDK Python和官方代码样例
Scrapyd Authenticated	39			2 years ago			4	mit	Dockerfile
Docker container running scrapyd with HTTP authentication

Alternatives To Scrapy_ipproxypool

Select To Compare

Splash ⭐ 3,860

Lightweight, scriptable browser as a service with an HTTP API

dependent packages 1total releases 30most recent commit 9 months ago

Scrapyd ⭐ 2,766

A service daemon to run Scrapy spiders

dependent packages 15total releases 11most recent commit 3 months ago

Scrapyrt ⭐ 793

HTTP API for Scrapy spiders

total releases 7most recent commit 6 months ago

Arachnado ⭐ 148

Web Crawling UI and HTTP API, based on Scrapy and Tornado

total releases 1most recent commit 2 years ago

Autologin ⭐ 106

A project to attempt to automatically login to a website given a single seed

total releases 5most recent commit 2 years ago

Docs ⭐ 102

《数据采集从入门到放弃》源码。内容简介：爬虫介绍、就业情况、爬虫工程师面试题；HTTP协议介绍； Requests使用；解析器Xpath介绍； MongoDB与MySQL；多线程爬虫； Scrapy介绍；Scrapy-redis介绍；使用docker部署；使用nomad管理docker集群；使用EFK查询docker日志

most recent commit 5 years ago

Scrapy_ipproxypool ⭐ 86

免费 IP 代理池。Scrapy 爬虫框架插件

most recent commit 6 years ago

Awesome Python Primer ⭐ 78

自学入门 Python 优质中文资源索引，包含书籍 / 文档 / 视频，适用于爬虫 / Web / 数据分析 / 机器学习方向

most recent commit 2 years ago

Python Sdk ⭐ 54

快代理API SDK Python和官方代码样例

dependent packages 2total releases 13most recent commit 10 months ago

Scrapyd Authenticated ⭐ 39

Docker container running scrapyd with HTTP authentication

most recent commit 2 years ago

Suggest An Alternative To Scrapy_IPProxyPool

Alternative Project Comparisons

Scrapy_ipproxypool vs Splash

Scrapy_ipproxypool vs Scrapyd

Scrapy_ipproxypool vs Scrapyrt

Scrapy_ipproxypool vs Arachnado

Scrapy_ipproxypool vs Autologin

Scrapy_ipproxypool vs Docs

Scrapy_ipproxypool vs Awesome Python Primer

Scrapy_ipproxypool vs Python Sdk

Scrapy_ipproxypool vs Scrapyd Authenticated

Popular Scrapy Projects

Scrapy ⭐ 49,918

Scrapy, a fast high-level web crawling & scraping framework for Python.

dependent packages 445total releases 96latest release September 18, 2023most recent commit 3 months ago

Learn_python3_spider ⭐ 14,425

python爬虫教程系列、从0到1学习python爬虫，包括浏览器抓包，手机APP抓包，如 fiddler、mitmproxy，各种爬虫涉及的模块的使用，如：requests、beautifu 爬虫加密逆向破解，JS爬虫逆向，分布式爬虫，爬虫项目实战实例等

total releases 2latest release August 07, 2019most recent commit 4 months ago

Cs Book ⭐ 11,024

计算机类常用电子书整理，并且附带下载链接，包括Java，Python，Linux，Go，C，C++，

most recent commit 9 months ago

Crawlab ⭐ 10,521

Distributed web crawler admin platform for spiders management regardless of languages and frameworks. 分布式爬虫管理平台，支持任何语言和框架

total releases 1latest release March 03, 2019most recent commit 3 months ago

Portia ⭐ 8,982

Visual scraping for Scrapy

dependent packages 2total releases 26latest release May 25, 2015most recent commit 8 months ago

Popular Http Projects

Frp ⭐ 76,428

A fast reverse proxy to help you expose a local server behind a NAT or firewall to the internet.

dependent packages 18total releases 93latest release October 24, 2023most recent commit 3 months ago

Hoppscotch ⭐ 59,845

👽 Open source API development ecosystem - https://hoppscotch.io

dependent packages 2total releases 11latest release October 14, 2023most recent commit 17 days ago

Caddy ⭐ 53,386

Fast and extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS

dependent packages 462total releases 383latest release December 07, 2023most recent commit 15 days ago

Requests ⭐ 51,284

A simple, yet elegant, HTTP library.

dependent packages 57,003total releases 151latest release July 20, 2023most recent commit 17 days ago

Okhttp ⭐ 44,954

Square’s meticulous HTTP client for the JVM, Android, and GraalVM.

dependent packages 3,974total releases 91latest release October 17, 2023most recent commit 3 months ago

Popular Data Processing Categories