Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Dffml	235	1	22	3 months ago	17	February 05, 2022	396	mit	Python
The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.
Eventkit	119	6	6	4 months ago	12	August 24, 2023	3	bsd-2-clause	Python
Event-driven data pipelines
Asyncio Buffered Pipeline	107			3 years ago	8	November 09, 2020		mit	Python
Utility function to parallelise pipelines of Python asyncio iterators/generators
Asyncpy	80			a year ago	14	September 21, 2022	4		Python
使用asyncio和aiohttp开发的轻量级异步协程web爬虫框架
Magda	10			3 years ago	3	September 06, 2021	4	apache-2.0
Library for building Modular and Asynchronous Graphs with Directed and Acyclic edges (MAGDA)
Pydatatask	5			3 months ago			13	mit	Python
Library for constructing data-centric processing pipelines

Alternatives To Magda

Select To Compare

Dffml ⭐ 235

The easiest way to use Machine Learning. Mix and match underlying ML libraries and data set sources. Generate new datasets or modify existing ones with ease.

dependent packages 22total releases 17most recent commit 3 months ago

Eventkit ⭐ 119

Event-driven data pipelines

dependent packages 6total releases 12most recent commit 4 months ago

Asyncio Buffered Pipeline ⭐ 107

Utility function to parallelise pipelines of Python asyncio iterators/generators

total releases 8most recent commit 3 years ago

Asyncpy ⭐ 80

使用asyncio和aiohttp开发的轻量级异步协程web爬虫框架

total releases 14most recent commit a year ago

Magda ⭐ 10

Library for building Modular and Asynchronous Graphs with Directed and Acyclic edges (MAGDA)

total releases 3most recent commit 3 years ago

Pydatatask ⭐ 5

Library for constructing data-centric processing pipelines

most recent commit 3 months ago

Suggest An Alternative To magda

Alternative Project Comparisons

Magda vs Dffml

Magda vs Eventkit

Magda vs Asyncio Buffered Pipeline

Magda vs Asyncpy

Magda vs Pydatatask

Popular Pipeline Projects

Nushell ⭐ 28,304

A new type of shell

dependent packages 82total releases 77latest release November 20, 2023most recent commit 3 months ago

Jina ⭐ 19,573

☁️ Build multimodal AI applications with cloud-native stack

dependent packages 16total releases 2,453latest release December 01, 2023most recent commit 3 months ago

Luigi ⭐ 17,046

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

dependent packages 76total releases 80latest release October 05, 2023most recent commit 3 months ago

Vector ⭐ 16,326

A high-performance observability data pipeline.

total releases 3latest release March 13, 2021most recent commit 10 days ago

Argo Cd ⭐ 15,229

Declarative Continuous Deployment for Kubernetes

dependent packages 65total releases 359latest release December 01, 2023most recent commit 3 months ago

Popular Asyncio Projects

Core ⭐ 68,336

:house_with_garden: Open source home automation that puts local control and privacy first.

dependent packages 6total releases 1,169latest release December 08, 2023most recent commit 9 days ago

Fastapi ⭐ 67,331

FastAPI framework, high performance, easy to learn, fast to code, ready for production

dependent packages 2,959total releases 183latest release October 30, 2023most recent commit 3 months ago

Awesome Python Cn ⭐ 24,822

Python资源大全中文版，包括：Web框架、网络爬虫、模板引擎、数据库、数据可视化、图片处理等，由

most recent commit 2 years ago

Sanic ⭐ 17,697

Accelerate your web app development | Build fast. Run fast.

dependent packages 439total releases 75latest release July 25, 2023most recent commit 11 days ago

Aiohttp ⭐ 14,301

Asynchronous HTTP client/server framework for asyncio and Python

dependent packages 7,614total releases 228latest release November 26, 2023most recent commit 3 months ago

Popular Data Processing Categories