Awesome Open Source

Programming Languages

Search results for spark sql

171 search results found

Java_spark ⭐ 16

Spark 2.x 案例操作：Scala版本与 Java1.8lambda版代码示例。涵盖Spark核心技术操作SparkCore、SparkSql

Spark Vcf ⭐ 15

Spark VCF data source implementation for Dataframes

Spark Vector ⭐ 15

Repository for the Spark-Vector connector

Spark Fits ⭐ 15

FITS data source for Spark SQL and DataFrames

Tweet Analysis With Kafka And Spark ⭐ 15

A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.

Ne Spark Courseware ⭐ 14

NetEase Spark Courses

A Big Data Platform Prototype Project

Sparksql Scalapb Test ⭐ 14

Test for SparkSQL ScalaPB

Workshops ⭐ 13

CSCAR workshop material

Hivetophoenix ⭐ 13

An Apache Spark app for making data movement between Apache Hive and Apache Phoenix/HBase

Wow Spark ⭐ 13

🔆 spark自学手册，包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake，以及scala基础练习，还有一些例

Materials for Oxford Software Engineering Programme CLO course

Sparksql Formatter ⭐ 12

A SparkSQL formatter based on https://github.com/zeroturnaround/sql-formatter, with customizations and extra features.

Spark Druid Connector ⭐ 12

A library for querying Druid data sources with Apache Spark

Swimlane Graphs ⭐ 12

Swimlane graphs for Hive, SparkSQL, and Presto based on Ganglia resource graphs

Hive Jdbc Proxy ⭐ 11

Hive-JDBC-Proxy是一个高性能的HiveServer2和Spark ThriftServer的代理服务，具备负载均衡、基于规则转发Hive JDBC Client的请求给到HiveServer2和Spark ThriftServer的能力。

Oracle_to_cassandra ⭐ 11

A description of the processes and techniques required to migrate a relational schema to a Cassandra database using Spark and SparkSQL

Spark Example ⭐ 11

Spark1.6和spark2.2的示例，包含kafka,flume,structuredstrea

Python And Spark For Data Analysis ⭐ 11

A four-day course on Python, the Scientific Python stack and PySpark, adapted from a training course given by Patrick Varilly to one of our clients in December 2015

Imooc Sparksql ⭐ 10

SparkSQL慕课网日志分析及可视化展示

Sparksql Stats ⭐ 10

基于PySpark库，使用SparkSql连接MYSQL数据库并对数据进行统计分析的基础架构

Sparklearning_nodata ⭐ 10

SparkLearning_NoData, including code,pom and so on

Huemul Bigdatagovernance ⭐ 10

Huemul BigDataGovernance, es una framework que trabaja sobre Spark, Hive y HDFS. Permite la implementación de una estrategia corporativa de dato único, basada en buenas prácticas de Gobierno de Datos. Permite implementar tablas con control de Primary Key y Foreing Key al insertar y actualizar datos utilizando la librería, Validación de nulos, largos de textos, máximos/mínimos de números y fechas, valores únicos y valores por default. También permite clasificar los campos en aplicabilidad de der

Kyuubi Docker ⭐ 9

Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

Learning Spark ⭐ 9

学习Spark的代码，关于Spark Core、Spark SQL、Spark Streaming、Spark MLLib

Liga: Let Data Dance with ML Models

Finance And Risk Management Algorithms ⭐ 9

applications for risk management through computational portfolio construction methods

Yet Another SPark Framework

Bigdata Examples ⭐ 9

bigdata examples about spark and flink

Restaurantinspectionssparkmlnet ⭐ 9

ETL & Data Enrichment with Spark.NET and ML.NET Automated (Auto) ML

Retailanalytics ⭐ 9

Hortonworks Data Platform Retail Analytics Demo

Log Analysis System ⭐ 8

基于Spark的行为日志分析系统

Pyspark Template ⭐ 8

A Python PySpark Projet with Poetry

命令参数调优工具，可用于 sparkSql sqoop datax 机器学习算法等参数的调优，自动找到最佳参数组合

Run TPC-DS against different databases including Hive, Spark SQL and IBM BigSQL

Apache Spark Etl Pipeline Example ⭐ 8

Demonstration of using Apache Spark to build robust ETL pipelines while taking advantage of open source, general purpose cluster computing.

Sparksql Perf ⭐ 8

A performance benchmark for Spark SQL.

Haskell bindings to the Apache Livy REST API

Sparksql Dashboard ⭐ 7

Provides a cherrypy dashboard to bind access to Spark SQL.

Db2 Event Store Akka Streams ⭐ 7

Use Akka to implement a WebSockets endpoint and stream data to Db2 Event Store

spark sql parser

ScORe - Programmatic Schema On Read for Spark SQL, powered by Taboola

Spark Etl Framework ⭐ 7

A generic ETL framework with Spark_SQL for transforming data by constructing pipelines with Yaml/Json/Xml

Spark2 Template ⭐ 7

Intellij template to develop Apache Spark 2.x applications

Helthcare System ⭐ 6

Data cleaning, pre-processing, and Analytics on a Health care data using Spark and Python.

Gor Spark ⭐ 6

Relational query engine that unites SparkSQL and GORpipe into a single declarative query framework.

Data_visualization_and_analysis_tool_for_telemetry_data ⭐ 6

An naive anomaly detection and data visualization tool for F1 on board telemetry data.

Msc In Machine Learning And Artificial Intelligence ⭐ 6

Master of Science in Machine Learning & Artificial Intelligence - Indian Institute Technology Madras & Liverpool John Moores University

Insight18b Sparksql Array ⭐ 6

Repo of my Insight project. Extended SparkSQL functionality internally and tested its performance against UDFs. Additionally, implemented a batch pipeline HDFS->SparkSQL->MySQL->Flask and a streaming pipeline Kafka->Spark Streaming->MySQL->Flask to analyze Amazon User Data.

Python And Spark For Data Analysis ⭐ 6

A four-day course on Python, the Scientific Python stack and PySpark, adapted from a training course I gave to one of our clients in December 2015

Distributable_docker_sql_on_hadoop ⭐ 6

Toy Hadoop cluster combining various SQL-on-Hadoop variants

Loganalysis ⭐ 6

日志分析项目

Spark Slowly Changing Dimension ⭐ 6

Spark implementation of Slowly Changing Dimension type 2

Protobuf Dataframe ⭐ 6

A package that lets you run PySpark SQL on your Protobuf data

Jvm Magics ⭐ 6

A plugin system for magic function implementations across JVM kernels.

Spark Connector Test ⭐ 6

A tutorial on how to use pulsar-spark-connector

Pyspark Recipe Zhcn ⭐ 6

pyspark-recipes 中文

Easynotes ⭐ 6

EasyNotes（简记）- sync with gitbook.

Kotlin Apache Spark Example ⭐ 5

kotlin-apache-spark-example

Spark Streaming Kafka Demo ⭐ 5

spark streaming从kafka读取消息，offset写入Redis，spark计算单词出现频率，最后

Analytics For Iot Devices Using Spark ⭐ 5

Analytics for IoT devices using Apache Spark Structured Streaming 2.4.0

Sparknotes ⭐ 5

Spark 2.0学习笔记

Net.jgp.books.spark.ch11 ⭐ 5

Spark in Action, 2nd edition - chapter 11 - Working with SQL

Iceberg Intro Workshop ⭐ 5

Hands-on workshop with Apache Iceberg

Sparkdemo ⭐ 5

几个Spark入门用的小例子和代码段

Spark Streaming In Python ⭐ 5

Apache Spark 3 - Structured Streaming Course Material

Genomic Bigdata Spark ⭐ 5

Genomic BigData Warehousing with Apache Spark and LakeHouse Architecture

Spark Ais Multi ⭐ 5

Import, Partition and Query AIS Data using SparkSQL

101-171 of 171 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.