Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Scrapyd Open Source Projects

Open source projects categorized as Python Scrapyd
Categories > Scrapyd
Gerapy ⭐ 3,144
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
total releases 49most recent commit 3 months ago
Scrapydweb ⭐ 2,839
Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI. DEMO 👉
total releases 18most recent commit 6 months ago
Scrapyd ⭐ 2,766
A service daemon to run Scrapy spiders
dependent packages 15total releases 11most recent commit 3 months agopypi scrapyd} Downloads
House Renting ⭐ 768
Possibly the best practice of Scrapy 🕷 and renting a house 🏡
most recent commit 2 years ago
Scrapyd Client ⭐ 719
Command line client for Scrapyd server
dependent packages 6total releases 8most recent commit a year agopypi scrapyd-client} Downloads
Scrapydouban ⭐ 646
豆瓣电影/豆瓣读书 Scarpy 爬虫
most recent commit 5 months ago
Timliu Python ⭐ 492
python资源集合与开源硬件
most recent commit 4 years ago
Awesome Scrapy ⭐ 450
A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
most recent commit a year ago
Newscrawl ⭐ 402
狠心开源企业级舆情新闻爬虫项目：支持任意数量爬虫一键运行、爬虫定时任务、爬虫批量删除；爬虫一键部署； 配置集群爬虫分配策略；👉 现成的docker一键部署文档已为大家踩坑
most recent commit 3 months ago
Spider ⭐ 356
爬虫实例：微博、b站、csdn、淘宝、今日头条、知乎、豆瓣、知乎APP、大众点评
most recent commit 5 years ago
Python Scrapyd Api ⭐ 253
A Python wrapper for working with Scrapyd's API.
dependent packages 5total releases 6most recent commit a year agopypi python-scrapyd-api} Downloads
Estela ⭐ 142
estela, an elastic web scraping cluster 🕸
most recent commit 3 months ago
Scrapyd Django Template ⭐ 103
Basic setup to run ScrapyD + Django and save it in Django Models. You can be up and running in just a few minutes
most recent commit 2 years ago
Scrapyd Cluster On Heroku ⭐ 90
Set up free and scalable Scrapyd cluster for distributed web-crawling with just a few clicks. DEMO 👉
most recent commit 4 years ago
Distributed Multi User Scrapy System With A Web Ui ⭐ 71
Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner
most recent commit 6 years ago
Argus ⭐ 67
ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of different websites. On the websites, ARGUS is able to perform tasks like scraping texts or collecting hyperlinks between websites. See: https://link.springer.com/article/10.1007/s11192-0
most recent commit 2 years ago
Scrapy Heroku ⭐ 61
total releases 8most recent commit 6 years ago
City58 ⭐ 56
58同城 (全国) 房屋信息爬虫
most recent commit 5 years ago
Steam Scraper ⭐ 55
A pair of spiders for scraping product data and reviews from Steam.
most recent commit 6 years ago
Opennem ⭐ 55
Energy market data access platform
most recent commit 3 months ago
Scrapyr ⭐ 50
a simple & tiny scrapy clustering solution, considered a drop-in replacement for scrapyd
most recent commit 8 months ago
Scrapybook 2nd Edition ⭐ 45
Scrapy Book 2nd Edition Code http://scrapybook.com/
most recent commit 2 years ago
Logparser ⭐ 43
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
dependent packages 1total releases 3most recent commit 4 years agopypi logparser} Downloads
The 4 Most Depended On Python Scrapyd Open Source Projects
Scrapyd ⭐ 2,766
A service daemon to run Scrapy spiders
dependent packages 15total releases 11latest release September 25, 2023most recent commit 3 months agopypi scrapyd} Downloads
Scrapyd Client ⭐ 719
Command line client for Scrapyd server
dependent packages 6total releases 8latest release May 03, 2022most recent commit a year agopypi scrapyd-client} Downloads
Python Scrapyd Api ⭐ 253
A Python wrapper for working with Scrapyd's API.
dependent packages 5total releases 6latest release April 01, 2018most recent commit a year agopypi python-scrapyd-api} Downloads
Logparser ⭐ 43
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
dependent packages 1total releases 3latest release August 04, 2019most recent commit 4 years agopypi logparser} Downloads
The 10 Latest Releases In Python Scrapyd Open Source Projects
Aio Scrapy ⭐ 43
Implement scrapy with asyncio
total releases 33latest release October 20, 2023most recent commit 3 months ago
Scrapyd ⭐ 2,766
A service daemon to run Scrapy spiders
dependent packages 15total releases 11latest release September 25, 2023most recent commit 3 months agopypi scrapyd} Downloads
Gerapy ⭐ 3,144
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Django and Vue.js
total releases 49latest release July 19, 2023most recent commit 3 months ago
Scrapyd Client ⭐ 719
Command line client for Scrapyd server
dependent packages 6total releases 8latest release May 03, 2022most recent commit a year agopypi scrapyd-client} Downloads
Scrapyd Heroku ⭐ 14
Wrapper for running Scrapyd in Heroku or locally as a service
total releases 5latest release November 28, 2020most recent commit 3 years ago
Logparser ⭐ 43
A tool for parsing Scrapy log files periodically and incrementally, extending the HTTP JSON API of Scrapyd.
dependent packages 1total releases 3latest release August 04, 2019most recent commit 4 years agopypi logparser} Downloads
Python Scrapyd Api ⭐ 253
A Python wrapper for working with Scrapyd's API.
dependent packages 5total releases 6latest release April 01, 2018most recent commit a year agopypi python-scrapyd-api} Downloads
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.