Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 S3 Parquet Open Source Projects

Open source projects categorized as S3 Parquet
Roapi ⭐ 2,969
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
total releases 17most recent commit 4 months ago
Rill ⭐ 1,145
Rill is a tool for effortlessly transforming data sets into powerful, opinionated dashboards using SQL. BI-as-code.
total releases 87most recent commit 3 months ago
Bigdata File Viewer ⭐ 269
A cross-platform (Windows, MAC, Linux) desktop application to view common bigdata binary format like Parquet, ORC, AVRO, etc. Support local file system, HDFS, AWS S3, Azure Blob Storage ,etc.
most recent commit 6 months ago
Amazon S3 Find And Forget ⭐ 223
Amazon S3 Find and Forget is a solution to handle data erasure requests from data lakes stored on Amazon S3, for example, pursuant to the European General Data Protection Regulation (GDPR)
most recent commit 3 months ago
Rumble ⭐ 194
⛈️ RumbleDB 1.21.0 "Hawthorn blossom" 🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more
total releases 4most recent commit a year ago
Parquet Tools ⭐ 135
easy install parquet-tools
total releases 19most recent commit 4 months ago
Parquet_s3_fdw ⭐ 126
ParquetS3 Foreign Data Wrapper for PostgresSQL
most recent commit 4 months ago
Streamx ⭐ 95
kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)
most recent commit 5 years ago
Monix Connect ⭐ 60
A set of connectors for Monix. 🔛
dependent packages 1total releases 14most recent commit a year ago
Quackpipe ⭐ 56
DuckDB for ClickHouse users. QuackPipe is an OLAP API built on top of DuckDB with a few extra ClickHouse compatibility bits.
most recent commit 4 months ago
Etl Light ⭐ 38
A light Kafka to HDFS/S3 ETL library based on Apache Spark
most recent commit 7 years ago
Aws Redshift Spectrum Poc ⭐ 27
Cloudformation and SQL scripts used to replicate a POC environment from the "Data Lake to Data Warehouse: Enhancing Customer 360 with Amazon Redshift Spectrum" post
most recent commit 4 years ago
Taar ⭐ 23
Telemetry-Aware Addon Recommender
most recent commit 2 years ago
Seekable S3 Stream ⭐ 23
Code library that uses S3's API to provide an efficient random-access (seekable) Stream implementation for use in code where efficient network I/O is paramount.
most recent commit 3 months ago
S3kit ⭐ 21
AWS S3 CLI tooklit
total releases 4most recent commit 3 years ago
Embulk Output S3_parquet ⭐ 13
Embulk (https://github.com/embulk/embulk/) output plugin to dump records as Apache Parquet (https://parquet.apache.org/) files on S3.
total releases 12most recent commit a year ago
S3logs Parquet ⭐ 12
A Rust implementation for Amazon S3 server access log aggregate and transform to parquet
most recent commit 4 months ago
Spark S3 ⭐ 11
Spark Plugin for Amazon S3
most recent commit 8 years ago
S3 Selectable ⭐ 10
S3 Select over Glue Table data on S3
dependent packages 2total releases 22most recent commit 9 months agonpm @dforsber/s3-selectable} Downloads
Flink Tools ⭐ 10
A collection of Flink applications for working with Pravega streams
most recent commit a year ago
Cloud Storage Extension ⭐ 8
Exasol Cloud Storage Extension for accessing formatted data Avro, Orc and Parquet, on public cloud storage systems
most recent commit 4 months ago
Apache_flink_and_iceberg ⭐ 5
Using Apache Flink to write to s3 in Apache Iceberg format
most recent commit 4 months ago
Tessellate ⭐ 5
A data engineering cli for reading and writing data to/from multiple locations across multiple formats.
most recent commit 4 months ago
The 2 Most Depended On S3 Parquet Open Source Projects
S3 Selectable ⭐ 10
S3 Select over Glue Table data on S3
dependent packages 2total releases 22latest release July 29, 2023most recent commit 9 months agonpm @dforsber/s3-selectable} Downloads
Monix Connect ⭐ 60
A set of connectors for Monix. 🔛
dependent packages 1total releases 14latest release November 07, 2022most recent commit a year ago
The 8 Latest Releases In S3 Parquet Open Source Projects
S3 Selectable ⭐ 10
S3 Select over Glue Table data on S3
dependent packages 2total releases 22latest release July 29, 2023most recent commit 9 months agonpm @dforsber/s3-selectable} Downloads
Parquet Tools ⭐ 135
easy install parquet-tools
total releases 19latest release January 18, 2023most recent commit 4 months ago
Monix Connect ⭐ 60
A set of connectors for Monix. 🔛
dependent packages 1total releases 14latest release November 07, 2022most recent commit a year ago
Roapi ⭐ 2,969
Create full-fledged APIs for slowly moving datasets without writing a single line of code.
total releases 17latest release March 20, 2022most recent commit 4 months ago
S3kit ⭐ 21
AWS S3 CLI tooklit
total releases 4latest release October 30, 2020most recent commit 3 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.