Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
---|---|---|---|---|---|---|---|---|---|---|
Luigi | 17,046 | 338 | 76 | 3 months ago | 80 | October 05, 2023 | 124 | apache-2.0 | Python | |
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in. | ||||||||||
Digandburied | 645 | 8 years ago | 4 | GCC Machine Description | ||||||
挖坑与填坑 | ||||||||||
Tez | 446 | 3 months ago | 67 | apache-2.0 | Java | |||||
Apache Tez | ||||||||||
Shifu | 235 | 1 | 2 | a year ago | 9 | April 03, 2019 | 237 | apache-2.0 | Java | |
An end-to-end machine learning and data mining framework on Hadoop | ||||||||||
Graphbuilder | 90 | 10 years ago | 1 | apache-2.0 | Java | |||||
The GraphBuilder library provides functions to construct large scale graphs. It is implemented on Apache Hadoop. | ||||||||||
Smart Data Lake | 87 | 8 | 3 months ago | 26 | October 25, 2023 | 64 | gpl-3.0 | Scala | ||
Smart Automation Tool for building modern Data Lakes and Data Pipelines | ||||||||||
Briefly | 85 | 6 years ago | 2 | apache-2.0 | Python | |||||
Briefly - A Python Meta-programming Library for Job Flow Control | ||||||||||
Ni | 81 | a year ago | 6 | mit | Perl | |||||
Say "ni" to data of any size | ||||||||||
Data Pipeline | 79 | 10 years ago | 2 | apache-2.0 | Python | |||||
Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs. Out of the box it will load files from a source, transform them and then output them (output might be writing to a file or loading them into a data analysis tool). It is designed to be modular and support various sources, transformation technologies and output types. The transformations can be chained together to form complex pipelines. | ||||||||||
Til | 51 | a year ago | 173 | gpl-3.0 | DIGITAL Command Language | |||||
Today I Learned |