Scrapyz
"Scrape Easy" - an extension of the Scrapy framework.
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Scrapyz | 188 | 8 years ago | 6 | July 27, 2015 | Python | |||||
| "Scrape Easy" - an extension of the Scrapy framework. | ||||||||||
| Pythoncrawler Scrapy Mysql File Template | 153 | 7 years ago | 2 | mit | Python | |||||
| scrapy爬虫框架模板，将数据保存到Mysql数据库或者文件中。 | ||||||||||
| Scrapy_demo | 150 | a year ago | 2 | Python | ||||||
| all kinds of scrapy demo | ||||||||||
| Nscrapy | 82 | 2 years ago | 12 | apache-2.0 | C# | |||||
| NScrapy is a .net core corss platform Distributed Spider Framework which provide an easy way to write your own Spider | ||||||||||
| Asyncpy | 80 | 2 years ago | 14 | September 21, 2022 | 4 | Python | ||||
| 使用asyncio和aiohttp开发的轻量级异步协程web爬虫框架 | ||||||||||
| Scrapy S3pipeline | 66 | 1 | 2 years ago | 8 | January 31, 2021 | 1 | mit | Python | ||
| Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket. | ||||||||||
| Dotnetcrawler | 63 | 4 years ago | C# | |||||||
| DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c | ||||||||||
| Recruitment | 57 | 7 years ago | 4 | JavaScript | ||||||
| A project crawling online recruitment websites getting offer information | ||||||||||
| Scrapy Distributed | 40 | a year ago | 8 | February 20, 2021 | 10 | Python | ||||
| A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy. | ||||||||||
| Scrapy Jsonschema | 39 | 3 years ago | 12 | March 26, 2021 | bsd-3-clause | Python | ||||
| Scrapy schema validation pipeline and Item builder using JSON Schema | ||||||||||
Alternatives To ScrapyzSelect To Compare
Alternative Project Comparisons
Popular Scrapy Projects
Popular Pipeline Projects
Popular Data Processing Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Pipeline
Scraper
Scrapy