Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Data Infrastructure Open Source Projects

Open source projects categorized as Data Infrastructure
Categories > Data Infrastructure
Postgres Operator ⭐ 3,936
Postgres operator creates and manages PostgreSQL clusters running in Kubernetes
dependent packages 11total releases 32most recent commit a month ago
Postgres Operator ⭐ 3,602
Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service.
dependent packages 2total releases 250most recent commit 3 months ago
Spilo ⭐ 1,245
Highly available elephant herd: HA PostgreSQL cluster using Docker
most recent commit 3 months ago
Tensorbase ⭐ 1,217
TensorBase is a new big data warehousing with modern efforts.
most recent commit 2 years ago
Nakadi ⭐ 927
A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues
total releases 1most recent commit 4 months ago
Pgobserver ⭐ 297
A battle-tested, flexible & comprehensive monitoring solution for your PostgreSQL databases
total releases 1most recent commit 4 years ago
Stream Unzip ⭐ 234
Python function to stream unzip all the files in a ZIP archive on the fly
dependent packages 7total releases 89most recent commit 3 months agopypi stream-unzip} Downloads
Thedataengineeringbook ⭐ 96
The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย
most recent commit 6 months ago
Stream Zip ⭐ 65
Python function to construct a ZIP archive on the fly
dependent packages 5total releases 67most recent commit 3 months agopypi stream-zip} Downloads
Spark Json Schema ⭐ 50
JSON schema parser for Apache Spark
total releases 8most recent commit 3 years ago
Data Workspace ⭐ 42
An open source data analysis platform with features for users with a range of technical skills
most recent commit 3 months ago
Mobius3 ⭐ 42
Continuously sync folder to S3, using inotify under the hood
total releases 35most recent commit a year ago
Kanadi ⭐ 32
Kanadi is a Nakadi client for Scala
total releases 39most recent commit 4 months ago
Data Machinelearning The Boring Way ⭐ 31
Build & Learn Data Engineering,Machine Learning over Kubernetes. No Shortcut approach.
most recent commit a year ago
Darty ⭐ 20
Data dependency manager
most recent commit 4 years ago
Panda_patrol ⭐ 18
most recent commit 4 months ago
Stream Sqlite ⭐ 16
Python function to extract rows from a SQLite file while iterating over its bytes
dependent packages 2total releases 42most recent commit a year agopypi stream-sqlite} Downloads
Pg Bulk Ingest ⭐ 9
Python utility function to ingest data into a SQLAlchemy-defined PostgreSQL table
total releases 43most recent commit 3 months ago
Consent Api ⭐ 7
Service for sharing user consent to cookies across multiple domains
total releases 4most recent commit 3 months ago
Stream Read Xbrl ⭐ 6
Python package to parse Companies House accounts data in a streaming way
most recent commit 3 months ago
Streampq ⭐ 6
Python PostgreSQL adapter to stream results of multi-statement queries without a server-side cursor
total releases 49most recent commit a year ago
Iterable Subprocess ⭐ 6
Python context manager to communicate with a subprocess using iterables: for when data is too big to fit in memory and has to be streamed
total releases 17most recent commit 8 months ago
Data_infra_repo ⭐ 5
Collections of POC/dev data infrastructure. | #SE
most recent commit a year ago
The 5 Most Depended On Data Infrastructure Open Source Projects
Postgres Operator ⭐ 3,936
Postgres operator creates and manages PostgreSQL clusters running in Kubernetes
dependent packages 11total releases 32latest release September 07, 2023most recent commit a month ago
Stream Unzip ⭐ 234
Python function to stream unzip all the files in a ZIP archive on the fly
dependent packages 7total releases 89latest release November 26, 2023most recent commit 3 months agopypi stream-unzip} Downloads
Stream Zip ⭐ 65
Python function to construct a ZIP archive on the fly
dependent packages 5total releases 67latest release November 29, 2023most recent commit 3 months agopypi stream-zip} Downloads
Postgres Operator ⭐ 3,602
Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service.
dependent packages 2total releases 250latest release December 01, 2022most recent commit 3 months ago
Stream Sqlite ⭐ 16
Python function to extract rows from a SQLite file while iterating over its bytes
dependent packages 2total releases 42latest release December 28, 2022most recent commit a year agopypi stream-sqlite} Downloads
The 10 Latest Releases In Data Infrastructure Open Source Projects
Consent Api ⭐ 7
Service for sharing user consent to cookies across multiple domains
total releases 4latest release December 07, 2023most recent commit 3 months ago
Stream Zip ⭐ 65
Python function to construct a ZIP archive on the fly
dependent packages 5total releases 67latest release November 29, 2023most recent commit 3 months agopypi stream-zip} Downloads
Stream Unzip ⭐ 234
Python function to stream unzip all the files in a ZIP archive on the fly
dependent packages 7total releases 89latest release November 26, 2023most recent commit 3 months agopypi stream-unzip} Downloads
Pg Bulk Ingest ⭐ 9
Python utility function to ingest data into a SQLAlchemy-defined PostgreSQL table
total releases 43latest release September 25, 2023most recent commit 3 months ago
Kanadi ⭐ 32
Kanadi is a Nakadi client for Scala
total releases 39latest release September 15, 2023most recent commit 4 months ago
Postgres Operator ⭐ 3,936
Postgres operator creates and manages PostgreSQL clusters running in Kubernetes
dependent packages 11total releases 32latest release September 07, 2023most recent commit a month ago
Stream Sqlite ⭐ 16
Python function to extract rows from a SQLite file while iterating over its bytes
dependent packages 2total releases 42latest release December 28, 2022most recent commit a year agopypi stream-sqlite} Downloads
Mobius3 ⭐ 42
Continuously sync folder to S3, using inotify under the hood
total releases 35latest release December 06, 2022most recent commit a year ago
Postgres Operator ⭐ 3,602
Production PostgreSQL for Kubernetes, from high availability Postgres clusters to full-scale database-as-a-service.
dependent packages 2total releases 250latest release December 01, 2022most recent commit 3 months ago
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.