Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Parquet Open Source Projects

Open source projects categorized as Parquet
Categories > Data Processing > Parquet
Parquet Compatibility ⭐ 59
compatibility tests to make sur C and Java implementations can read each other
most recent commit 10 years ago
Overturemapsdownloader ⭐ 58
Overture Maps Downloader simplifies geospatial data manipulation by integrating the powerful DuckDB, Dask DataFrames, and GDAL/OGR open source tools.
most recent commit 7 months ago
Osm Parquetizer ⭐ 58
A converter for the OSM PBFs to Parquet files
most recent commit 4 years ago
Quackpipe ⭐ 56
DuckDB for ClickHouse users. QuackPipe is an OLAP API built on top of DuckDB with a few extra ClickHouse compatibility bits.
most recent commit 4 months ago
Spark ⭐ 55
Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .
most recent commit 2 years ago
Parquet Cli ⭐ 52
Command line (CLI) tool to inspect Apache Parquet files on the go
total releases 4most recent commit 4 years ago
Spark Compaction ⭐ 52
File compaction tool that runs on top of the Spark framework.
most recent commit 5 years ago
Parquetize ⭐ 51
R package that allows to convert databases of different formats to parquet format
total releases 4most recent commit 6 months ago
Spark Mail ⭐ 45
Tutorial on parsing Enron email to Avro and then explore the email set using Spark.
most recent commit 5 years ago
Node Parquet ⭐ 44
NodeJS module to access apache parquet format files
dependent packages 2total releases 10most recent commit 4 years agonpm node-parquet} Downloads
Spark Parquet Thrift Example ⭐ 44
Example Spark project using Parquet as a columnar store with Thrift objects.
most recent commit 10 years ago
Entrada ⭐ 44
Entrada - A tool for DNS big data analytics
most recent commit 3 months ago
Ibis ⭐ 44
IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.
most recent commit 5 years ago
Parquet Go ⭐ 43
Go library to work with PARQUET files
dependent packages 2total releases 1most recent commit 5 years ago
Sparkwiki ⭐ 42
most recent commit 2 years ago
Snowset ⭐ 41
Snowflake dataset containing statistics for 70 million queries over 14 day period
most recent commit 3 years ago
Sfarrow ⭐ 40
R package for reading/writing `sf` objects from/to parquet files with `arrow`.
total releases 1most recent commit 2 years ago
Intellij Avro Parquet Plugin ⭐ 40
A Tool Window plugin for IntelliJ that displays Avro and Parquet files and their schemas in JSON.
most recent commit a year ago
Etl Light ⭐ 38
A light Kafka to HDFS/S3 ETL library based on Apache Spark
most recent commit 7 years ago
Rasterly ⭐ 38
Rapidly generate raster images from large datasets in R with Plotly.js
total releases 2most recent commit 4 years ago
Records Mover ⭐ 37
Python library and CLI you can use to move relational data from one place to another - DBs/CSV/gsheets/dataframes/...
most recent commit 3 months ago
Php Parquet ⭐ 37
PHP implementation for reading and writing Apache Parquet files/streams
most recent commit 3 months ago
Parquet Testing ⭐ 37
Auxiliary files for compatibility and integration tests for Apache Parquet
most recent commit 3 months ago
The 10 Latest Releases In Parquet Open Source Projects
Parquet Go ⭐ 43
Go library to work with PARQUET files
dependent packages 2total releases 1latest release August 27, 2018most recent commit 5 years ago
D6tstack ⭐ 166
Quickly ingest messy CSV and XLS files. Export to clean pandas, SQL, parquet
dependent packages 2total releases 11latest release July 30, 2018most recent commit 2 years agopypi d6tstack} Downloads
Embulk Output Parquet ⭐ 20
total releases 6latest release June 10, 2018most recent commit 6 years ago
Node Parquet ⭐ 44
NodeJS module to access apache parquet format files
dependent packages 2total releases 10latest release April 30, 2018most recent commit 4 years agonpm node-parquet} Downloads
Parquet Dotnet ⭐ 319
🏐 Apache Parquet for modern .NET
total releases 4latest release January 10, 2018most recent commit 2 years ago
Skale ⭐ 398
High performance distributed data processing engine
dependent packages 2total releases 29latest release June 27, 2017most recent commit 3 years agonpm skale-engine} Downloads
Pucket ⭐ 29
Bucketing and partitioning system for Parquet
dependent packages 5total releases 7latest release September 05, 2016most recent commit 6 years ago
Pigpen ⭐ 513
Map-Reduce for Clojure
dependent packages 6total releases 34latest release May 19, 2016most recent commit 7 years ago
Microdrill ⭐ 7
Simple Apache Drill alternative using PySpark
total releases 3latest release March 01, 2016most recent commit 8 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.