Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for scala spark sql
scala
x
spark-sql
x
41 search results found
Zio Quill
⭐
2,135
Compile-time Language Integrated Queries for Scala
Kyuubi
⭐
1,849
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Almond
⭐
1,560
A Scala kernel for Jupyter
Gluten
⭐
870
Gluten: Plugin to Double SparkSQL's Performance
Learningsparkv2
⭐
570
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
Sparta
⭐
526
Real Time Analytics and Data Pipelines based on Spark Streaming
Sparklens
⭐
520
Qubole Sparklens tool for performance tuning Apache Spark
Magellan
⭐
509
Geo Spatial Data Analytics on Spark
Learningspark
⭐
406
Scala examples for learning to use Spark
Spark Hbase Connector
⭐
287
Connect Spark to HBase for reading and writing data with ease
Spark Workshop
⭐
231
Apache Spark™ and Scala Workshops
Rasterframes
⭐
226
Geospatial Raster support for Spark DataFrames
Xsql
⭐
207
Unified SQL Analytics Engine Based on SparkSQL
Zio Protoquill
⭐
192
Quill for Scala 3
Emotional_analysis
⭐
190
[毕业设计]基于Spark网易云音乐数据分析【1.图计算 2.机器学习预测歌曲分类 3.评论词云 4.评论时间段 5.评论top榜 6.热歌top榜 7.用户性别比例 8.用户星座比例 9.用户年龄比例 10.用户全国地理分布 11.热评搜索等等..】
Opaque Sql
⭐
171
An encrypted data analytics platform
Qbeast Spark
⭐
171
Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
Spark Alchemy
⭐
169
Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
Bigdata Playground
⭐
154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Spark Structured Streaming Examples
⭐
153
Spark Structured Streaming / Kafka / Cassandra / Elastic
Pulsar Spark
⭐
103
Spark Connector to read and write with Pulsar
Sparksql Protobuf
⭐
73
Read SparkSQL parquet file as RDD[Protobuf]
Cleanframes
⭐
70
type-class based data cleansing library for Apache Spark SQL
Stratio Connector Sparksql
⭐
67
(DEPRECATED) A crossdata connector to Spark SQL
Spark Records
⭐
58
Bulletproof Apache Spark jobs with fast root cause analysis of failures.
Recommendmoteur
⭐
57
电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎
Spark
⭐
55
Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .
Spark Select
⭐
53
A library for Spark DataFrame using MinIO Select API
Sparkonkudu
⭐
48
Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.
Spark Google Spreadsheets
⭐
46
Google Spreadsheets datasource for SparkSQL and DataFrames
Struct Type Encoder
⭐
44
Deriving Spark DataFrame schemas from case classes
Datasource Receiver
⭐
41
Spark Receiver for SQL or NoSQL Databases like Cassandra, MongoDB, Elasticsearch or JDBC
Sparkoptics
⭐
40
Optics for Spark DataFrames
Spark Ranger
⭐
38
ACL Management for Apache Spark SQL with Apache Ranger. This library has been contributed to https://github.com/apache/submarine as a sub-module, and that module can still be used individually. The project here will no longer be updated. If you have any questions please go to https://github.com/apache/submarine/tree/master/do to learn how to use and give feedback to the apache submarine community by following https://submarine.apache.org/communit
Sope
⭐
37
Apache Spark ETL Utilities
Sparkgis
⭐
37
GIS extension for SparkSQL
Sharpetl
⭐
36
Write ETL using your favorite SQL dialects
Litemall Dw
⭐
36
基于开源Litemall电商项目的大数据项目,包含前端埋点(openresty+lua)、后端埋点;
Sparkdemo
⭐
34
spark全示例代码(java、scala) Spark most full instance code DEMO (java、scala)
Airbnb Spark Thrift
⭐
34
A library for loadling Thrift data into Spark SQL
Spark Postgres
⭐
33
PostgreSQL and GreenPlum Data Source for Apache Spark
Hadooplearning
⭐
25
全套大数据基础学习教程,包含最基础的centos、maven。大数据主要包含hdfs、mr、yarn
Spark Power Bi
⭐
25
Power BI API adapter for Apache Spark (deprecated)
Spark Structured Streaming Examples
⭐
25
Spark structured streaming examples with using of version 3.4.0
Movies Analytics In Spark And Scala
⭐
24
Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.
Recommendsystem
⭐
24
电影推荐系统
Spark Workshop
⭐
22
Code examples and docker environment for Spark
Sparkplug
⭐
20
Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
Pre Lt Raster Frames
⭐
19
Spark DataFrames for earth observation data
Spark Addb Connector
⭐
19
Implementation to connect SparkSQL and Redis in form of Relational Model
Sparkprogramminginscala
⭐
18
Apache Spark Course Material
Java_spark
⭐
16
Spark 2.x 案例操作:Scala版本与 Java1.8lambda版代码示例。涵盖Spark核心技术操作SparkCore、SparkSql
Spark2 Etl Examples
⭐
16
A project with examples of using few commonly used data manipulation/processing/transformation APIs in Apache Spark 2.0.0
Recsys_spark
⭐
16
Spark SQL 实现 ItemCF,UserCF,Swing,推荐系统,协同过滤
Spark Vector
⭐
15
Repository for the Spark-Vector connector
Spark Vcf
⭐
15
Spark VCF data source implementation for Dataframes
Spark Fits
⭐
15
FITS data source for Spark SQL and DataFrames
Sparksql Scalapb Test
⭐
14
Test for SparkSQL ScalaPB
Hivetophoenix
⭐
13
An Apache Spark app for making data movement between Apache Hive and Apache Phoenix/HBase
Wow Spark
⭐
13
🔆 spark自学手册,包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake,以及scala基础练习,还有一些例
Spark Druid Connector
⭐
12
A library for querying Druid data sources with Apache Spark
Spark Example
⭐
11
Spark1.6和spark2.2的示例,包含kafka,flume,structuredstrea
Hive Jdbc Proxy
⭐
11
Hive-JDBC-Proxy是一个高性能的HiveServer2和Spark ThriftServer的代理服务,具备负载均衡、基于规则转发Hive JDBC Client的请求给到HiveServer2和Spark ThriftServer的能力。
Sparklearning_nodata
⭐
10
SparkLearning_NoData, including code,pom and so on
Huemul Bigdatagovernance
⭐
10
Huemul BigDataGovernance, es una framework que trabaja sobre Spark, Hive y HDFS. Permite la implementación de una estrategia corporativa de dato único, basada en buenas prácticas de Gobierno de Datos. Permite implementar tablas con control de Primary Key y Foreing Key al insertar y actualizar datos utilizando la librería, Validación de nulos, largos de textos, máximos/mínimos de números y fechas, valores únicos y valores por default. También permite clasificar los campos en aplicabilidad de der
Imooc Sparksql
⭐
10
SparkSQL慕课网日志分析及可视化展示
Bigdata Examples
⭐
9
bigdata examples about spark and flink
Learning Spark
⭐
9
学习Spark的代码,关于Spark Core、Spark SQL、Spark Streaming、Spark MLLib
Yasp
⭐
9
Yet Another SPark Framework
Sparksql Perf
⭐
8
A performance benchmark for Spark SQL.
Spark Etl Framework
⭐
7
A generic ETL framework with Spark_SQL for transforming data by constructing pipelines with Yaml/Json/Xml
Spark2 Template
⭐
7
Intellij template to develop Apache Spark 2.x applications
Db2 Event Store Akka Streams
⭐
7
Use Akka to implement a WebSockets endpoint and stream data to Db2 Event Store
Spark Slowly Changing Dimension
⭐
6
Spark implementation of Slowly Changing Dimension type 2
Insight18b Sparksql Array
⭐
6
Repo of my Insight project. Extended SparkSQL functionality internally and tested its performance against UDFs. Additionally, implemented a batch pipeline HDFS->SparkSQL->MySQL->Flask and a streaming pipeline Kafka->Spark Streaming->MySQL->Flask to analyze Amazon User Data.
Spark Connector Test
⭐
6
A tutorial on how to use pulsar-spark-connector
Loganalysis
⭐
6
日志分析项目
Easynotes
⭐
6
EasyNotes(简记)- sync with gitbook.
Analytics For Iot Devices Using Spark
⭐
5
Analytics for IoT devices using Apache Spark Structured Streaming 2.4.0
Sparkdemo
⭐
5
几个Spark入门用的小例子和代码段
Net.jgp.books.spark.ch11
⭐
5
Spark in Action, 2nd edition - chapter 11 - Working with SQL
Related Searches
Scala Sbt (4,178)
Scala Spark (3,279)
Scala Akka (2,120)
Java Scala (1,794)
Scala Play Framework (1,309)
Plugin Scala (1,079)
Scala Kafka (969)
Scala Functional Programming (942)
Scala Scalajs (887)
Docker Scala (728)
1-41 of 41 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.