Luigi Alternatives

Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Alternatives To Luigi
Project NameStarsDownloadsRepos Using ThisPackages Using ThisMost Recent CommitTotal ReleasesLatest ReleaseOpen IssuesLicenseLanguage
Luigi17,04633876a year ago80October 05, 2023124apache-2.0Python
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
Digandburied645
9 years ago4GCC Machine Description
挖坑与填坑
Tez446
a year ago67apache-2.0Java
Apache Tez
Graphbuilder90
11 years ago1apache-2.0Java
The GraphBuilder library provides functions to construct large scale graphs. It is implemented on Apache Hadoop.
Smart Data Lake878a year ago26October 25, 202364gpl-3.0Scala
Smart Automation Tool for building modern Data Lakes and Data Pipelines
Briefly85
7 years ago2apache-2.0Python
Briefly - A Python Meta-programming Library for Job Flow Control
Ni81
2 years ago6mitPerl
Say "ni" to data of any size
Data Pipeline79
11 years ago2apache-2.0Python
Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs. Out of the box it will load files from a source, transform them and then output them (output might be writing to a file or loading them into a data analysis tool). It is designed to be modular and support various sources, transformation technologies and output types. The transformations can be chained together to form complex pipelines.
Til51
3 years ago173gpl-3.0DIGITAL Command Language
Today I Learned
Teraslice50631a year ago129September 27, 2023143apache-2.0TypeScript
Scalable data processing pipelines in JavaScript
Alternatives To Luigi
Select To Compare


Alternative Project Comparisons
Popular Hadoop Projects
Popular Pipeline Projects
Popular Data Processing Categories
Related Searches

Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Pipeline
Hadoop