Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Data Ingestion Open Source Projects

Open source projects categorized as Data Ingestion
Categories > Data Ingestion
Seatunnel ⭐ 7,139
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
dependent packages 28total releases 4most recent commit a month ago
Broadway ⭐ 2,233
Concurrent and multi-stage data ingestion and data processing with Elixir
dependent packages 29total releases 18most recent commit 3 months agohex broadway} Downloads
Pravega ⭐ 1,945
Pravega - Streaming as a new software defined storage primitive
dependent packages 31total releases 24most recent commit 3 months ago
Incubator Paimon ⭐ 1,647
Apache Paimon(incubating) is a streaming data lake platform that supports high-speed data ingestion, change data tracking and efficient real-time analytics.
dependent packages 25total releases 2most recent commit 3 months ago
Squirrel Core ⭐ 271
A Python library that enables ML teams to share, load, and transform data in a collaborative, flexible, and efficient way 🌰
total releases 102most recent commit 3 months ago
Cuelake ⭐ 266
Use SQL to build ELT pipelines on a data lakehouse.
most recent commit 2 years ago
Orbital ⭐ 255
Orbital automates integration between data sources (APIs, Databases, Queues and Functions). BFF's, API Composition and ETL pipelines that adapt as your specs change.
most recent commit 5 months ago
Thedataengineeringbook ⭐ 96
The Data Engineering Book - หนังสือวิศวกรรมข้อมูล ของคนไทย เพื่อคนไทย
most recent commit 6 months ago
Net.jgp.labs.spark ⭐ 63
Apache Spark examples exclusively in Java
most recent commit 2 years ago
Data Ingestion Platform ⭐ 39
most recent commit 4 years ago
Squirrel Datasets Core ⭐ 37
Squirrel dataset hub
total releases 63most recent commit a year ago
Openkit Java ⭐ 33
OpenKit Java Reference Implementation
total releases 12most recent commit 5 months ago
Oneagent Sdk For Java ⭐ 29
Enables custom tracing of Java applications in Dynatrace
total releases 9most recent commit 10 months ago
Amazon Kinesis Data Processor Aws Fargate ⭐ 28
Sample code for the AWS Big Data Blog Post Building a scalable streaming data processor with Amazon Kinesis Data Streams on AWS Fargate
most recent commit 6 months ago
Oneagent Sdk For Python ⭐ 26
Enables custom tracing of Python applications in Dynatrace
dependent packages 2total releases 7most recent commit 4 months agopypi oneagent-sdk} Downloads
History ⭐ 26
Download and warehouse historical trading data
dependent packages 1total releases 23most recent commit a year agohex history} Downloads
Data Integration Library ⭐ 21
The Data Integration Library project provides a library of generic components based on a multi-stage architecture for data ingress and egress.
most recent commit a year ago
Oneagent Sdk ⭐ 18
Describes technical concepts of Dynatrace OneAgent SDK
most recent commit a year ago
Oneagent Sdk For C ⭐ 18
Enables custom tracing of native applications in Dynatrace
total releases 1most recent commit 10 months ago
Openkit Dotnet ⭐ 16
OpenKit .NET Reference Implementation
total releases 18most recent commit 3 months ago
Oneagent Sdk For Nodejs ⭐ 16
Enables custom tracing of Node.js applications in Dynatrace
total releases 9most recent commit 7 months ago
Oneagent Sdk For Dotnet ⭐ 15
Enables custom tracing of .NET applications in Dynatrace
most recent commit a year ago
Openkit Native ⭐ 14
most recent commit 5 months ago
The 7 Most Depended On Data Ingestion Open Source Projects
Pravega ⭐ 1,945
Pravega - Streaming as a new software defined storage primitive
dependent packages 31total releases 24latest release September 07, 2023most recent commit 3 months ago
Broadway ⭐ 2,233
Concurrent and multi-stage data ingestion and data processing with Elixir
dependent packages 29total releases 18latest release April 22, 2023most recent commit 3 months agohex broadway} Downloads
Seatunnel ⭐ 7,139
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
dependent packages 28total releases 4latest release August 18, 2023most recent commit a month ago
Agent Nodejs ⭐ 13
Dynatrace agent for PaaS environments
dependent packages 6total releases 174latest release November 06, 2023most recent commit 3 months agonpm @dynatrace/oneagent} Downloads
Oneagent Sdk For Python ⭐ 26
Enables custom tracing of Python applications in Dynatrace
dependent packages 2total releases 7latest release December 21, 2022most recent commit 4 months agopypi oneagent-sdk} Downloads
History ⭐ 26
Download and warehouse historical trading data
dependent packages 1total releases 23latest release December 03, 2021most recent commit a year agohex history} Downloads
The 10 Latest Releases In Data Ingestion Open Source Projects
Agent Nodejs ⭐ 13
Dynatrace agent for PaaS environments
dependent packages 6total releases 174latest release November 06, 2023most recent commit 3 months agonpm @dynatrace/oneagent} Downloads
Pravega ⭐ 1,945
Pravega - Streaming as a new software defined storage primitive
dependent packages 31total releases 24latest release September 07, 2023most recent commit 3 months ago
Seatunnel ⭐ 7,139
SeaTunnel is a next-generation super high-performance, distributed, massive data integration tool.
dependent packages 28total releases 4latest release August 18, 2023most recent commit a month ago
Openkit Dotnet ⭐ 16
OpenKit .NET Reference Implementation
total releases 18latest release June 06, 2023most recent commit 3 months ago
Openkit Java ⭐ 33
OpenKit Java Reference Implementation
total releases 12latest release June 02, 2023most recent commit 5 months ago
Broadway ⭐ 2,233
Concurrent and multi-stage data ingestion and data processing with Elixir
dependent packages 29total releases 18latest release April 22, 2023most recent commit 3 months agohex broadway} Downloads
Oneagent Sdk For Java ⭐ 29
Enables custom tracing of Java applications in Dynatrace
total releases 9latest release March 27, 2023most recent commit 10 months ago
Oneagent Sdk For Python ⭐ 26
Enables custom tracing of Python applications in Dynatrace
dependent packages 2total releases 7latest release December 21, 2022most recent commit 4 months agopypi oneagent-sdk} Downloads
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.