Data Tools
Common Python tools and utilities for data engineering, ETL, Exploration, etc. made opensource and packaged, making it easy to use in any environment.
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Airflow | 34,468 |  | 320 | 9 days ago | 169 | November 27, 2023 | 890 | apache-2.0 | Python | |
| Apache Airflow - A platform to programmatically author, schedule, and monitor workflows | ||||||||||
| Dagster | 9,467 |  | 2 | 133 | 3 months ago | 585 | December 07, 2023 | 2,343 | apache-2.0 | Python |
| An orchestration platform for the development, production, and observation of data assets. | ||||||||||
| Mage Ai | 6,324 | 3 months ago | 314 | December 06, 2023 | 189 | apache-2.0 | Python | |||
| 🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data. | ||||||||||
| Orchest | 3,876 | a year ago | 19 | December 13, 2022 | 125 | apache-2.0 | TypeScript | |||
| Build data pipelines, the easy way 🛠️ | ||||||||||
| Aws Sdk Pandas | 3,779 |  | 65 | a month ago | 143 | November 13, 2023 | 34 | apache-2.0 | Python | |
| pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL). | ||||||||||
| Quadratic | 2,485 | 3 months ago | 124 | mit | Rust | |||||
| Quadratic | Data Science Spreadsheet with Python & SQL | ||||||||||
| Awesome Business Intelligence | 1,862 | 6 months ago | 11 | mit | ||||||
| Actively curated list of awesome BI tools. PRs welcome! | ||||||||||
| Hamilton | 1,272 |  | 2 | a month ago | 116 | December 05, 2023 | 136 | bsd-3-clause-clear | Jupyter Notebook | |
| Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage and metadata. Runs and scales everywhere python does. | ||||||||||
| Pyspark Example Project | 1,034 | a year ago | 11 | Python | ||||||
| Example project implementing best practices for PySpark ETL jobs and applications. | ||||||||||
| Hamilton | 877 | 10 months ago | 10 | October 23, 2022 | 12 | bsd-3-clause-clear | Python | |||
| A scalable general purpose micro-framework for defining dataflows. THIS REPOSITORY HAS BEEN MOVED TO www.github.com/dagworks-inc/hamilton | ||||||||||
Alternatives To Data ToolsSelect To Compare
Alternative Project Comparisons
Popular Etl Projects
Popular Data Science Projects
Popular Data Processing Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Google
Data Science
Dataframe
Etl