Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Parquet Open Source Projects

Open source projects categorized as Parquet
Categories > Data Processing > Parquet
Spark Bigquery ⭐ 15
Google BigQuery data source for Apache Spark
most recent commit 4 years ago
Spark To Tableau ⭐ 14
Spark to Tableau Extractor library
most recent commit 7 years ago
Panel Geodashboard Twitter ⭐ 14
A simple Panel-based dashboard visualizing geotagged tweets with hvplot and Datashader.
most recent commit 10 months ago
Skar ⭐ 14
Ethereum (EVM) indexer using Apache Arrow/Parquet
most recent commit 8 months ago
Parquetfiles.jl ⭐ 14
FileIO.jl integration for Parquet files
most recent commit 4 years ago
Embulk Output S3_parquet ⭐ 13
Embulk (https://github.com/embulk/embulk/) output plugin to dump records as Apache Parquet (https://parquet.apache.org/) files on S3.
total releases 12most recent commit a year ago
Parquet Usql ⭐ 13
A custom extractor designed to read parquet for Azure Data Lake Analytics
most recent commit 6 years ago
Data Generator ⭐ 13
This repo is for generating data from existing dataset to a file or producing dataset rows as message to kafka in a streaming manner.
most recent commit 9 months ago
Experience Platform Etl Reference ⭐ 13
Examples for ETL Integrations with Adobe Experience Platform
most recent commit 2 years ago
Fileconvert ⭐ 13
Converts between file formats such as CSV and Parquet
most recent commit 7 years ago
Pyiterable ⭐ 13
Python library to read, write and convert data files with formats BSON, JSON, NDJSON, Parquet, ORC, XLS, XLSX and XML
total releases 1most recent commit 8 months ago
Pycon2016 ⭐ 13
Code and Presentation for PyCon2016
most recent commit 8 years ago
Pyspark S3 Parquet Example ⭐ 13
This repo demonstrates how to load a sample Parquet formatted file from an AWS S3 Bucket. A python job will then be submitted to a Apache Spark instance running on AWS EMR, which will run a SQLContext to create a temporary table using a DataFrame. SQL queries will then be possible against the temporary table.
most recent commit 8 years ago
Parquets ⭐ 13
dependent packages 3total releases 24most recent commit 4 years agonpm parquets} Downloads
Parquet ⭐ 13
Mechanics and models for queer 2D building, crafting, and narrative sandbox games.
most recent commit 2 years ago
Pudl Examples ⭐ 13
Example Jupyter notebooks hosted on Kaggle that demonstrate how to work with US energy data from PUDL.
most recent commit 4 months ago
Tableio.jl ⭐ 12
A glue package for reading and writing tabular data. It aims to provide a uniform api for reading and writing tabular data from and to multiple sources.
most recent commit 2 years ago
Parquet Floor ⭐ 12
A lightweight Java library that facilitates reading and writing Apache Parquet files without Hadoop dependencies
total releases 6most recent commit a year ago
Infoflow ⭐ 12
An Apache Spark implementation of the InfoMap community detection algorithm
most recent commit 4 years ago
Identity Matching ⭐ 12
source{d} extension to match Git signatures to real people.
total releases 1most recent commit 4 years ago
Kiauhoku ⭐ 12
Python utilities for stellar model grid interpolation
total releases 8most recent commit 7 months ago
S3logs Parquet ⭐ 12
A Rust implementation for Amazon S3 server access log aggregate and transform to parquet
most recent commit 4 months ago
Omicidx Parsers ⭐ 12
Exposing public genomics data via computable and searchable metadata
dependent packages 1total releases 49most recent commit 3 months agopypi omicidx} Downloads
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.