Awesome Open Source

Programming Languages

Search results for schema spark

40 search results found

Spark Csv ⭐ 1,009

CSV Data Source for Apache Spark 1.x

Marmaray ⭐ 444

Generic Data Ingestion & Dispersal Library for Hadoop

Nimdata ⭐ 276

DataFrame API written in Nim, enabling fast out-of-core data processing

Spark Tfrecord ⭐ 255

Read and write Tensorflow TFRecord data from Apache Spark.

Avro SerDe for Apache Spark structured APIs.

Pulsar Spark ⭐ 103

Spark Connector to read and write with Pulsar

Spark Dynamodb ⭐ 90

DynamoDB data source for Apache Spark

Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.

Graphiql Spark ⭐ 79

Demo a GraphQL schema without a GraphQL endpoint

Dataframecheatsheet ⭐ 74

Cheatsheet for Spark DataFrame

Spark Bigquery ⭐ 69

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

Avro Parquet Spark Example ⭐ 61

An example of using Avro and Parquet in Spark SQL

Carbondata_guide ⭐ 56

Apache CarbonData 源码阅读

Spark Tutorial ⭐ 55

This tutorial provides a quick introduction to using Spark

Spark Json Schema ⭐ 50

JSON schema parser for Apache Spark

Sagemaker Sparkml Serving Container ⭐ 46

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

Struct Type Encoder ⭐ 44

Deriving Spark DataFrame schemas from case classes

Hyperdrive ⭐ 41

Extensible streaming ingestion pipeline on top of Apache Spark

Spark Hadoopoffice Ds ⭐ 37

A Spark datasource for the HadoopOffice library

Spark Schema Registry ⭐ 32

Schema Registry integration for Apache Spark

Spark Hats ⭐ 29

Nested array transformation helper extensions for Apache Spark

Modelmatrix ⭐ 29

Sparse feature extraction with Spark

Graphql Starwars Kotlin ⭐ 26

GraphQL Server implemented in Kotlin.

Sparklyr.nested ⭐ 26

A sparklyr extension for nested data

Spark State Tools ⭐ 22

Spark Structured Streaming State Tools

Avro Schema Evolution made easy

Cdp Spark Datasource ⭐ 18

Spark data source for Cognite Data Fusion

Oci Cloudera ⭐ 18

Terraform module to deploy Cloudera on Oracle Cloud Infrastructure (OCI)

Confluent Spark Avro ⭐ 17

Spark UDFs to deserialize Avro messages with schemas stored in Schema Registry.

Sql Code Intelligence ⭐ 17

sql code autocomplete

Datasourcev2 ⭐ 13

Marshmallow Pyspark ⭐ 12

Marshmallow serializer integration with pyspark

Big Data Types ⭐ 12

A library to transform Scala product types and Schemas from different systems into other Schemas. Any implemented type gets automatically methods to convert it into the rest of the types and vice versa. For example, an Spark Schema can be transformed into a BigQuery table.

Oracle_to_cassandra ⭐ 11

A description of the processes and techniques required to migrate a relational schema to a Cassandra database using Spark and SparkSQL

Bigdata Profiler ⭐ 10

Profiles the data, validates the schema and runs data quality checks and produces a report

sparkql: Apache Spark SQL DataFrame schema management for sensible humans

SAMbA: Extending Apache Spark for Scientific Computational Experiments

Kinetica Connector Spark ⭐ 6

Spark connector for Kinetica (API and command-line tools)

Smartframes ⭐ 6

Enhanced Python Dataframes for Spark

Hdinsight Kafka Spark ⭐ 6

Tutorial for Avro with Kafka and Spark on HDInsight

Schema_evolution_exploration ⭐ 5

Explore schema evolution using parquet and Spark or Presto

Related Searches

Javascript Schema (3,675)

Scala Spark (3,279)

Json Schema (2,319)

Python Spark (2,053)

Python Schema (1,858)

Database Schema (1,613)

Java Spark (1,587)

Graphql Schema (1,376)

Typescript Schema (1,337)

Apache Spark (1,207)

1-40 of 40 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.