Cyborg

Python web scraping framework
Alternatives To Cyborg
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Cyborg300
6 years ago2Python
Python web scraping framework
Sasila264
4 years ago17November 02, 20171apache-2.0Python
一个灵活、友好的爬虫框架
Scrapyz188
8 years ago6July 27, 2015Python
"Scrape Easy" - an extension of the Scrapy framework.
Ayakashi17729 months ago40June 29, 20238otherTypeScript
:zap: Ayakashi.io - The next generation web scraping framework
Scrapy S3pipeline66
12 years ago8January 31, 20211mitPython
Scrapy pipeline to store chunked items into Amazon S3 or Google Cloud Storage bucket.
Dotnetcrawler63
4 years agoC#
DotnetCrawler is a straightforward, lightweight web crawling/scrapying library for Entity Framework Core output based on dotnet core. This library designed like other strong crawler libraries like WebMagic and Scrapy but for enabling extandable your custom requirements. Medium link : https://medium.com/@mehmetozkaya/creating-custom-web-crawler-with-dotnet-core-using-entity-framework-core-ec8d23f0ca7c
Scrapy Distributed40
a year ago8February 20, 202110Python
A series of distributed components for Scrapy. Including RabbitMQ-based components, Kafka-based components, and RedisBloom-based components for Scrapy.
Phoenix_pipeline39
7 years ago12mitPython
Turning news into events since 2014.
Nano Pipe3124 years ago7May 27, 2020JavaScript
A tiny library (<450 bytes gzipped) to create chainable functions/pipelines including support for async generators.
Scrapy Crawl Asp16
8 years ago1mitPython
heavy-duty scraping framework for crawling ASP.net pages
Alternatives To Cyborg
Select To Compare


Alternative Project Comparisons
Popular Scraper Projects
Popular Pipeline Projects
Popular Data Processing Categories

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Pipeline
Scraper