Project Name	Stars	Repos Using This	Packages Using This	Most Recent Commit	Total Releases	Latest Release	Open Issues	License	Language
Hamilton	1,538		2	6 days ago	116	December 05, 2023	136	bsd-3-clause-clear	Jupyter Notebook
Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.
Hamilton	877			a year ago	10	October 23, 2022	12	bsd-3-clause-clear	Python
A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton
Eland	588		3	5 months ago	30	November 22, 2023	88	apache-2.0	Python
Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch
Metorikku	536			a year ago	126	February 27, 2023	65	mit	Scala
A simplified, lightweight ETL Framework based on Apache Spark
Spark Excel	421	3	6	5 months ago	43	February 22, 2021	83	apache-2.0	Scala
A Spark plugin for reading and writing Excel files
Peaks Consolidation	102			6 months ago			4	mit	Go
The Peaks Consolidation is equipped with state-of-the-art algorithms and data structures that support high-performance databending exercises. It specializes in management accounting and consolidation, with some special topics in machine learning and bioinformatics.
Dflib	71			5 months ago			15	apache-2.0	Java
In-memory Java DataFrame library
Wikirepo	36			7 months ago	21	July 09, 2022	3	bsd-3-clause	Python
Python based Wikidata framework for easy dataframe extraction
Dagster Polars	32			5 months ago			10	apache-2.0	Python
Polars integration for Dagster
Sql_to_ibis	25			2 years ago	21	May 09, 2021	10	bsd-3-clause	Python
A Python package that parses sql and converts it to ibis expressions

Alternatives To Dagster Polars

Select To Compare

Hamilton ⭐ 1,538

Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does.

dependent packages 2total releases 116most recent commit 6 days ago

Hamilton ⭐ 877

A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton

total releases 10most recent commit a year ago

Eland ⭐ 588

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch

dependent packages 3total releases 30most recent commit 5 months ago

Metorikku ⭐ 536

A simplified, lightweight ETL Framework based on Apache Spark

total releases 126most recent commit a year ago

Spark Excel ⭐ 421

A Spark plugin for reading and writing Excel files

dependent packages 6total releases 43most recent commit 5 months ago

Peaks Consolidation ⭐ 102

The Peaks Consolidation is equipped with state-of-the-art algorithms and data structures that support high-performance databending exercises. It specializes in management accounting and consolidation, with some special topics in machine learning and bioinformatics.

most recent commit 6 months ago

Dflib ⭐ 71

In-memory Java DataFrame library

most recent commit 5 months ago

Wikirepo ⭐ 36

Python based Wikidata framework for easy dataframe extraction

total releases 21most recent commit 7 months ago

Dagster Polars ⭐ 32

Polars integration for Dagster

most recent commit 5 months ago

Sql_to_ibis ⭐ 25

A Python package that parses sql and converts it to ibis expressions

total releases 21most recent commit 2 years ago

Suggest An Alternative To dagster-polars

Alternative Project Comparisons

Dagster Polars vs Hamilton

Dagster Polars vs Eland

Dagster Polars vs Metorikku

Dagster Polars vs Spark Excel

Dagster Polars vs Peaks Consolidation

Dagster Polars vs Dflib

Dagster Polars vs Wikirepo

Dagster Polars vs Sql_to_ibis

Popular Dataframe Projects

Polars ⭐ 24,900

Dataframes powered by a multithreaded, vectorized query engine, written in Rust

dependent packages 346total releases 328latest release December 01, 2023most recent commit 4 months ago

Modin ⭐ 9,275

Modin: Scale your Pandas workflows by changing a single line of code

dependent packages 25total releases 89latest release November 17, 2023most recent commit 5 months ago

Pygwalker ⭐ 8,698

PyGWalker: Turn your pandas dataframe into an interactive UI for visual analysis

dependent packages 3total releases 124latest release December 10, 2023most recent commit 5 months ago

Vaex ⭐ 8,161

Out-of-Core hybrid Apache Arrow/NumPy DataFrame for Python, ML, visualization and exploration of big tabular data at a billion rows per second 🚀

dependent packages 29total releases 69latest release July 21, 2023most recent commit 4 months ago

Cudf ⭐ 6,936

cuDF - GPU DataFrame Library

dependent packages 3total releases 31latest release October 12, 2023most recent commit 5 months ago

Popular Etl Projects

Tidb ⭐ 35,604

TiDB is an open-source, cloud-native, distributed, MySQL-Compatible database for elastic scale and real-time analytics. Try AI-powered Chat2Query free at : https://tidbcloud.com/free-trial

dependent packages 149total releases 1,289latest release April 07, 2022most recent commit 5 months ago

Airflow ⭐ 34,468

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

dependent packages 320total releases 169latest release November 27, 2023most recent commit 2 months ago

Airbyte ⭐ 12,918

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

dependent packages 11total releases 311latest release December 08, 2023most recent commit 5 months ago

Doris ⭐ 11,243

Apache Doris is an easy-to-use, high performance and unified analytics database.

total releases 8latest release September 27, 2023most recent commit 3 months ago

Dagster ⭐ 9,467

An orchestration platform for the development, production, and observation of data assets.

dependent packages 133total releases 585latest release December 07, 2023most recent commit 5 months ago

Popular Control Flow Categories