Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Data Science On Gcp	1,249			9 months ago			17	apache-2.0	Jupyter Notebook
Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017
Bytewax	957		3	3 months ago	34	October 05, 2023	15	apache-2.0	HTML
Python Stream Processing
Etl	327		15	3 months ago	16	November 30, 2023		mit	PHP
PHP - ETL (Extract Transform Load) data processing library
Substation	242			3 months ago	19	October 05, 2023	9	mit	Go
Substation is a cloud-native, event-driven data pipeline toolkit built for security teams.
Sayn	117			3 months ago	32	August 30, 2023	12	apache-2.0	Python
Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).
Stepist	16	1	1	4 years ago	9	November 10, 2019			Python
Framework for data processing
Online_store	15			a year ago			1	mit	Python
End to end data engineering project
Automated Data Preprocessing	14			5 years ago			2	mit	Python
A command-line utility program for automating the trivial, frequently occurring data preparation tasks: missing value interpolation, outlier removal, and encoding categorical variables.
Pippin	13			4 months ago				apache-2.0	Go
Go library to create and manage data pipelines on your machine
Data Paths	11			a year ago				mit	Python

Alternatives To Etl

Select To Compare

Data Science On Gcp ⭐ 1,249

Source code accompanying book: Data Science on the Google Cloud Platform, Valliappa Lakshmanan, O'Reilly 2017

most recent commit 9 months ago

Bytewax ⭐ 957

Python Stream Processing

dependent packages 3total releases 34most recent commit 3 months ago

Etl ⭐ 327

PHP - ETL (Extract Transform Load) data processing library

dependent packages 15total releases 16most recent commit 3 months ago

Substation ⭐ 242

Substation is a cloud-native, event-driven data pipeline toolkit built for security teams.

total releases 19most recent commit 3 months ago

Sayn ⭐ 117

Data processing and modelling framework for automating tasks (incl. Python & SQL transformations).

total releases 32most recent commit 3 months ago

Stepist ⭐ 16

Framework for data processing

dependent packages 1total releases 9most recent commit 4 years ago

Online_store ⭐ 15

End to end data engineering project

most recent commit a year ago

Automated Data Preprocessing ⭐ 14

A command-line utility program for automating the trivial, frequently occurring data preparation tasks: missing value interpolation, outlier removal, and encoding categorical variables.

most recent commit 5 years ago

Pippin ⭐ 13

Go library to create and manage data pipelines on your machine

most recent commit 4 months ago

Data Paths ⭐ 11

most recent commit a year ago

Suggest An Alternative To etl

Alternative Project Comparisons

Etl vs Data Science On Gcp

Etl vs Automated Data Preprocessing

Etl vs Pippin

Etl vs Data Paths

Popular Data Engineering Projects

Superset ⭐ 58,051

Apache Superset is a Data Visualization and Data Exploration Platform

dependent packages 21total releases 6latest release April 18, 2023most recent commit 20 days ago

Made With Ml ⭐ 35,496

Learn how to design, develop, deploy and iterate on production-grade ML applications.

total releases 5latest release May 15, 2019most recent commit 5 months ago

Airflow ⭐ 34,299

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

dependent packages 320total releases 169latest release November 27, 2023most recent commit 14 days ago

Applied Ml ⭐ 24,828

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

most recent commit 6 months ago

Data Engineering Zoomcamp ⭐ 19,461

Free Data Engineering course!

most recent commit 3 months ago

Popular Data Processing Projects

Miller ⭐ 8,397

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

total releases 65latest release November 26, 2022most recent commit 3 months ago

Bash Oneliner ⭐ 7,946

A collection of handy Bash One-Liners and terminal tricks for data processing and Linux system maintenance.

most recent commit 5 months ago

Awesome Web Scraping ⭐ 6,060

List of libraries, tools and APIs for web scraping and data processing.

most recent commit 5 months ago

Dasel ⭐ 4,845

Select, put and delete data from JSON, TOML, YAML, XML and CSV files with a single tool. Supports conversion between formats and can be used as a Go package.

dependent packages 14total releases 97latest release November 28, 2023most recent commit 16 days ago

Dali ⭐ 4,770

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

dependent packages 4total releases 19latest release December 06, 2023most recent commit 3 months ago

Popular Data Processing Categories