Awesome Open Source
Awesome Open Source
Combined Topics
spark-sql x

The Top 372 Spark Sql Open Source Projects

Categories > Data Processing > Spark Sql
Redash ⭐ 20,969
Make Your Company Data Driven. Connect to any data source, easily visualize, dashboard and share your data.
total releases 2most recent commit a month ago
Zio Quill ⭐ 2,046
Compile-time Language Integrated Queries for Scala
dependent packages 20total releases 86most recent commit 15 hours ago
Spark ⭐ 1,778
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
dependent packages 15total releases 19most recent commit a day agonuget Microsoft.Spark} Downloads
Almond ⭐ 1,425
A Scala kernel for Jupyter
dependent packages 17total releases 41most recent commit a day ago
Incubator Kyuubi ⭐ 1,069
Apache Kyuubi is a distributed multi-tenant JDBC server for large-scale data processing and analytics, built on top of Apache Spark
total releases 6most recent commit 14 hours ago
Hadoop_study ⭐ 817
定期更新Hadoop生态圈中常用大数据组件文档 重心依次为: Flink Solr Sparksql ES Scala Kafka Hbase/phoenix Redis Kerberos (项目包含hadoop思维导图 印象笔记 Scala版本简单demo 常用工具类 去敏后的train code 持续更新!!!)
most recent commit 17 days ago
Useractionanalyzeplatform ⭐ 581
电商用户行为分析大数据平台
most recent commit 2 years ago
Learningsparkv2 ⭐ 570
This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]
most recent commit 5 months ago
Sparta ⭐ 521
Real Time Analytics and Data Pipelines based on Spark Streaming
most recent commit 3 years ago
Yanagishima ⭐ 512
Web UI for Trino, Hive and SparkSQL
most recent commit 7 months ago
Magellan ⭐ 509
Geo Spatial Data Analytics on Spark
most recent commit 9 months ago
Sparklens ⭐ 454
Qubole Sparklens tool for performance tuning Apache Spark
most recent commit 6 months ago
Learningspark ⭐ 406
Scala examples for learning to use Spark
most recent commit 2 years ago
Spark Hbase Connector ⭐ 287
Connect Spark to HBase for reading and writing data with ease
total releases 9most recent commit 4 years ago
Spark Druid Olap ⭐ 283
Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit.ly/2oBJSpP) an Integrated BI platform on Apache Spark.
most recent commit 4 years ago
Iql ⭐ 276
An ad hoc query service based on the spark sql engine.(基于spark sql引擎的即席查询服务)
most recent commit 2 years ago
Cuelake ⭐ 266
Use SQL to build ELT pipelines on a data lakehouse.
most recent commit 2 months ago
Data Accelerator ⭐ 264
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
dependent packages 5total releases 26most recent commit 19 days agonpm datax-common} Downloads
Spark Workshop ⭐ 227
Apache Spark™ and Scala Workshops
most recent commit 4 months ago
Zeppelin Notebooks ⭐ 206
Gallery of Apache Zeppelin notebooks
most recent commit 3 years ago
Cc Pyspark ⭐ 201
Process Common Crawl data with Python and Spark
most recent commit a month ago
Emotional_analysis ⭐ 190
[毕业设计]基于Spark网易云音乐数据分析【1.图计算 2.机器学习预测歌曲分类 3.评论词云 4.评论时间段 5.评论top榜 6.热歌top榜 7.用户性别比例 8.用户星座比例 9.用户年龄比例 10.用户全国地理分布 11.热评搜索等等..】
most recent commit 9 months ago
Sequoiadb ⭐ 187
SequoiaDB 巨杉数据库是一款金融级分布式关系型数据库。 自研的原生分布式存储引擎支持完整 ACID，具备弹性扩展、高并发和高可用特性，支持 MySQL、PostgreSQL 和 SparkSQL 等多种 SQL 访问形式，适用于核心交易、数据中台、内容管理等应用场景。
dependent packages 9total releases 17most recent commit 2 years ago
Pyspark Cheatsheet ⭐ 176
🐍 Quick reference guide to common patterns & functions in PySpark.
most recent commit 2 months ago
Rasterframes ⭐ 175
Geospatial Raster support for Spark DataFrames
dependent packages 3total releases 16most recent commit 2 months ago
Mcw Big Data Analytics And Visualization ⭐ 175
MCW Big data analytics and visualization
most recent commit 2 months ago
Crossdata ⭐ 170
DISCONTINUED - Easy access to big things. Library for Apache Spark extending and improving its capabilities
dependent packages 11total releases 24most recent commit 3 years ago
Opaque Sql ⭐ 159
An encrypted data analytics platform
most recent commit 3 months ago
Bigdata Playground ⭐ 154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
most recent commit 3 years ago
Spark Structured Streaming Examples ⭐ 153
Spark Structured Streaming / Kafka / Cassandra / Elastic
most recent commit 4 years ago
Spark Alchemy ⭐ 151
Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive
total releases 3most recent commit 5 months ago
Xsql ⭐ 143
Unified SQL Analytics Engine Based on SparkSQL
most recent commit 2 years ago
Spring Shiro Spark ⭐ 112
Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试
most recent commit 4 years ago
Spark R Notebooks ⭐ 109
R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks
most recent commit 5 years ago
Qbeast Spark ⭐ 92
Qbeast-spark: DataSource enabling multi-dimensional indexing and efficient data sampling. Big Data, free from the unnecessary!
total releases 2most recent commit a month ago
Dt Sql Parser ⭐ 90
SQL Parsers for BigData, built with antlr4.
dependent packages 3total releases 36most recent commit 3 months agonpm dt-sql-parser} Downloads
Focusbigdata ⭐ 89
【大数据成神之路学习路径+面经+简历】
most recent commit a month ago
Pulsar Spark ⭐ 77
When Apache Pulsar meets Apache Spark
total releases 2most recent commit 2 months ago
Sparksql Protobuf ⭐ 73
Read SparkSQL parquet file as RDD[Protobuf]
most recent commit 4 years ago
Cleanframes ⭐ 70
type-class based data cleansing library for Apache Spark SQL
total releases 16most recent commit 3 years ago
Stratio Connector Sparksql ⭐ 67
(DEPRECATED) A crossdata connector to Spark SQL
most recent commit 6 years ago
Sqlflow ⭐ 61
SQLFlow is a bridge that connects a SQL engine, e.g. MySQL, Hive, SparkSQL or SQL Server, with TensorFlow and other machine learning toolkits. SQLFlow extends the SQL language to enable model training, prediction and inference.
most recent commit 3 years ago
Bigtable Sql ⭐ 59
分布式大数据SQL查询可视化界面！
most recent commit 7 years ago
Spark Records ⭐ 58
Bulletproof Apache Spark jobs with fast root cause analysis of failures.
most recent commit a year ago
Recommendmoteur ⭐ 57
电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎
most recent commit 4 years ago
Spark ⭐ 55
Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .
most recent commit 4 months ago
Spark Select ⭐ 53
A library for Spark DataFrame using MinIO Select API
total releases 5most recent commit 3 years ago
Awesome Pulsar ⭐ 53
A curated list of Pulsar tools, integrations and resources.
most recent commit a year ago
Sparkonkudu ⭐ 48
Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.
most recent commit 6 years ago
Spark Google Spreadsheets ⭐ 46
Google Spreadsheets datasource for SparkSQL and DataFrames
most recent commit 2 years ago
Geospark ⭐ 45
bring sf to spark in production
most recent commit 5 months ago
Datasource Receiver ⭐ 41
Spark Receiver for SQL or NoSQL Databases like Cassandra, MongoDB, Elasticsearch or JDBC
most recent commit 6 years ago
Struct Type Encoder ⭐ 41
Deriving Spark DataFrame schemas from case classes
most recent commit 3 months ago
Sparkoptics ⭐ 40
Optics for Spark DataFrames
most recent commit a year ago
Realtime Data Analytics Using Spark ⭐ 39
Realtime social media data analytics with Apache Spark, Python, Kafka, Pandas, etc
most recent commit 6 years ago
Spark Ranger ⭐ 38
ACL Management for Apache Spark SQL with Apache Ranger. This library has been contributed to https://github.com/apache/submarine as a sub-module, and that module can still be used individually. The project here will no longer be updated. If you have any questions please go to https://github.com/apache/submarine/tree/master/do to learn how to use and give feedback to the apache submarine community by following https://submarine.apache.org/communit
most recent commit 6 months ago
Sparkgis ⭐ 37
GIS extension for SparkSQL
most recent commit 6 years ago
Paraflow ⭐ 36
A real-time analytical system for ID-associated data
most recent commit 2 years ago
Litemall Dw ⭐ 36
基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；
most recent commit 10 days ago
Sparkdemo ⭐ 34
spark全示例代码(java、scala) Spark most full instance code DEMO (java、scala)
most recent commit 2 years ago
Airbnb Spark Thrift ⭐ 34
A library for loadling Thrift data into Spark SQL
most recent commit 4 years ago
Spark Twitter Sentiment Analysis ⭐ 33
Sentiment Analysis of a Twitter Topic with Spark Structured Streaming
most recent commit 3 years ago
Sope ⭐ 31
Apache Spark ETL Utilities
most recent commit 2 years ago
Real Time Data Warehouse ⭐ 29
Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi
most recent commit 3 months ago
Big_data ⭐ 27
A collection of tutorials on Hadoop, MapReduce, Spark, Docker
most recent commit 9 months ago
Vora ⭐ 27
SAP HANA Vora
most recent commit 5 years ago
Spark Power Bi ⭐ 25
Power BI API adapter for Apache Spark (deprecated)
most recent commit 5 years ago
Hadooplearning ⭐ 25
全套大数据基础学习教程，包含最基础的centos、maven。大数据主要包含hdfs、mr、yarn
most recent commit 2 years ago
Cloud Based Sql Engine Using Spark ⭐ 25
Cloud-based SQL engine using SPARK where data is accessible as JDBC/ODBC data source via Spark ThriftServer.
most recent commit 5 years ago
Recommendsystem ⭐ 24
电影推荐系统
most recent commit 2 years ago
Datalake Etl Pipeline ⭐ 24
Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations
most recent commit 10 months ago
Movies Analytics In Spark And Scala ⭐ 24
Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.
most recent commit a year ago
Spark Postgres ⭐ 24
PostgreSQL and GreenPlum Data Source for Apache Spark
most recent commit a year ago
Spark Data Sources ⭐ 22
Developing Spark External Data Sources using the V2 API
most recent commit 4 years ago
Spark_pot ⭐ 22
most recent commit 5 years ago
Spark Workshop ⭐ 22
Code examples and docker environment for Spark
most recent commit 6 years ago
Awesome Sparklyr ⭐ 22
An awesome sparklyr related package collection
most recent commit 2 years ago
Sparkplug ⭐ 20
Spark package to "plug" holes in data using SQL based rules ⚡️ 🔌
most recent commit 2 years ago
Pre Lt Raster Frames ⭐ 19
Spark DataFrames for earth observation data
most recent commit 4 years ago
Spark Addb Connector ⭐ 19
Implementation to connect SparkSQL and Redis in form of Relational Model
most recent commit 2 years ago
Spark Structured Streaming Examples ⭐ 18
Spark structured streaming examples with using of version 2.4.4
most recent commit 3 years ago
Sparkprogramminginscala ⭐ 18
Apache Spark Course Material
most recent commit 2 years ago
Bigdatatutorial ⭐ 18
bigdatatutorial
most recent commit 4 years ago
Spark And Mllib Projects ⭐ 18
This repository contains Spark, MLlib, PySpark and Dataframes projects
most recent commit 5 years ago
Resume Bjkonglu ⭐ 17
记录Spark、Flink研究经验
most recent commit 3 years ago
Albis ⭐ 17
Albis: High-Performance File Format for Big Data Systems
most recent commit 4 years ago
Java_spark ⭐ 16
Spark 2.x 案例操作：Scala版本与 Java1.8lambda版代码示例。涵盖Spark核心技术操作SparkCore、SparkSql
most recent commit 2 years ago
Recsys_spark ⭐ 16
Spark SQL 实现 ItemCF，UserCF，Swing，推荐系统，协同过滤
most recent commit 2 years ago
Spark2 Etl Examples ⭐ 16
A project with examples of using few commonly used data manipulation/processing/transformation APIs in Apache Spark 2.0.0
most recent commit 4 years ago
Spark Fits ⭐ 15
FITS data source for Spark SQL and DataFrames
most recent commit 9 days ago
Spark Vcf ⭐ 15
Spark VCF data source implementation for Dataframes
most recent commit a year ago
Tweet Analysis With Kafka And Spark ⭐ 15
A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.
most recent commit 2 years ago
Spark Vector ⭐ 15
Repository for the Spark-Vector connector
most recent commit a year ago
Bdp ⭐ 14
A Big Data Platform Prototype Project
most recent commit 2 years ago
Sparksql Scalapb Test ⭐ 14
Test for SparkSQL ScalaPB
most recent commit 5 days ago
Ne Spark Courseware ⭐ 14
NetEase Spark Courses
most recent commit 4 years ago
Wow Spark ⭐ 13
🔆 spark自学手册，包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake，以及scala基础练习，还有一些例
most recent commit 2 years ago
Spark Cassandra Bulkreader ⭐ 13
Spark-Cassandra Bulk Reader CASSANDRA-16222
most recent commit a month ago
Hivetophoenix ⭐ 13
An Apache Spark app for making data movement between Apache Hive and Apache Phoenix/HBase
most recent commit 6 years ago
Workshops ⭐ 13
CSCAR workshop material
most recent commit 2 years ago
1-100 of 372 projects
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,048,735)
Python  (796,103)
Java  (385,413)
Php  (284,589)
Typescript  (239,722)
C Plus Plus  (236,213)
Ruby  (221,696)
C  (180,396)
Shell  (169,594)
C Sharp  (162,015)
Golang  (156,089)
Swift  (64,698)
R  (57,248)
Objective C  (57,169)
Rust  (56,117)
Dart  (51,466)
Kotlin  (45,511)
Lua  (33,293)
Matlab  (30,891)
Perl  (30,483)
Language  (30,085)
Scala  (28,601)
Haskell  (20,260)
Clojure  (19,072)
Powershell  (18,797)
Bash  (18,606)
Coffeescript  (17,331)
Elixir  (16,565)
Assembly  (14,526)
Processing  (13,298)
Julia  (12,536)
Basic  (10,765)
Flow  (10,528)
Emacs Lisp  (10,368)
Erlang  (9,058)
Scheme  (8,437)
Groovy  (8,431)
Solidity  (7,611)
Ocaml  (6,668)
Pascal  (6,378)
Hack  (6,365)
Lisp  (6,340)
Fortran  (5,483)
Elm  (5,477)
Common Lisp  (5,277)
Dlang  (4,747)
Shell Script  (4,633)
Python Library  (4,446)
Crystal  (4,374)
Scripting  (4,203)
Top Projects
Freecodecamp ⭐ 346,432
996.icu ⭐ 262,320
Free Programming Books ⭐ 233,678
Coding Interview University ⭐ 220,499
Awesome ⭐ 202,578
Vue ⭐ 196,186
Developer Roadmap ⭐ 195,398
Public Apis ⭐ 193,925
React ⭐ 188,417
System Design Primer ⭐ 180,789
Tensorflow ⭐ 165,144
Bootstrap ⭐ 157,483
You Dont Know Js ⭐ 153,649
Cs Notes ⭐ 150,780
Ohmyzsh ⭐ 145,459
Build Your Own X ⭐ 142,246
Flutter ⭐ 140,926
Javascript Algorithms ⭐ 140,055
Python ⭐ 136,303
Gitignore ⭐ 133,450
Linux ⭐ 132,199
Vscode ⭐ 132,056
Awesome Python ⭐ 127,528
Javascript ⭐ 123,347
Javaguide ⭐ 121,667
Python 100 Days ⭐ 117,585
Computer Science ⭐ 113,544
Youtube Dl ⭐ 110,239
Fucking Algorithm ⭐ 106,048
The Art Of Command Line ⭐ 105,874
React Native ⭐ 102,862
Electron ⭐ 101,813
D3 ⭐ 100,901
Go ⭐ 99,493
30 Seconds Of Code ⭐ 95,528
Create React App ⭐ 95,174
Axios ⭐ 93,562
Awesome Selfhosted ⭐ 89,230
Kubernetes ⭐ 88,689
Free Programming Books Zh_cn ⭐ 88,386
Node ⭐ 87,823
Next.js ⭐ 87,114
Terminal ⭐ 83,251
Deno ⭐ 82,597
Three.js ⭐ 82,214
Angular ⭐ 81,516
Awesome Go ⭐ 81,089
Typescript ⭐ 80,876
Ant Design ⭐ 80,416
Material Ui ⭐ 78,638
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2022 Awesome Open Source.  All rights reserved.