Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Scala Spark Big Data Open Source Projects

Open source projects categorized as Scala Spark Big Data
Spark ⭐ 37,661
Apache Spark - A unified analytics engine for large-scale data processing
dependent packages 939total releases 46most recent commit 3 months ago
Bigdata Notes ⭐ 14,872
大数据入门指南 ⭐
most recent commit 4 months ago
Zeppelin ⭐ 6,259
Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
dependent packages 31total releases 2most recent commit 16 days agonpm zeppelin-vis} Downloads
Synapseml ⭐ 4,967
Simple and Distributed Machine Learning
dependent packages 6total releases 12most recent commit 2 days ago
Hudi ⭐ 4,901
Upserts, Deletes And Incremental Processing on Big Data.
dependent packages 58total releases 21most recent commit 3 months ago
Bigdataguide ⭐ 2,355
大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料
most recent commit 4 months ago
Carbondata ⭐ 1,401
High performance data store solution
total releases 1most recent commit 5 months ago
Utils4s ⭐ 1,033
scala、spark使用过程中，各种测试用例以及相关资料整理
most recent commit 5 years ago
Adam ⭐ 966
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
dependent packages 17total releases 14most recent commit 3 months ago
Sparkling Water ⭐ 957
Sparkling Water provides H2O functionality inside Spark cluster
dependent packages 6total releases 195most recent commit 4 months ago
Tispark ⭐ 872
TiSpark is built for running Apache Spark on top of TiDB/TiKV
dependent packages 10total releases 55most recent commit 3 months ago
Incubator Livy ⭐ 840
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
dependent packages 8total releases 6most recent commit 3 months ago
Delta Sharing ⭐ 654
An open protocol for secure data sharing
dependent packages 7total releases 33most recent commit 3 months agopypi delta-sharing} Downloads
Spark Rapids ⭐ 619
Spark RAPIDS plugin - accelerate Apache Spark with GPUs
dependent packages 1total releases 19most recent commit 3 months ago
Spline ⭐ 553
Data Lineage Tracking And Visualization Solution
dependent packages 6total releases 14most recent commit 5 months ago
Metorikku ⭐ 536
A simplified, lightweight ETL Framework based on Apache Spark
total releases 126most recent commit a year ago
Magellan ⭐ 509
Geo Spatial Data Analytics on Spark
most recent commit 3 years ago
Kotlin Spark Api ⭐ 425
This projects gives Kotlin bindings and several extensions for Apache Spark. We are looking to have this as a part of Apache Spark 3.x
dependent packages 15total releases 6most recent commit 4 months ago
Hyperspace ⭐ 334
An open source indexing subsystem that brings index-based query acceleration to Apache Spark™ and big data workloads.
total releases 5most recent commit 2 years ago
Every Single Day I Tldr ⭐ 311
A daily digest of the articles or videos I've found interesting, that I want to share with you.
most recent commit 3 months ago
Mist ⭐ 303
Serverless proxy for Spark cluster
dependent packages 4total releases 3most recent commit 3 years ago
Big Data Rosetta Code ⭐ 283
Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code
most recent commit 5 months ago
Geni ⭐ 268
A Clojure dataframe library that runs on Spark
total releases 33most recent commit 5 months ago
The 10 Most Depended On Scala Spark Big Data Open Source Projects
Spark ⭐ 37,661
Apache Spark - A unified analytics engine for large-scale data processing
dependent packages 939total releases 46latest release May 09, 2021most recent commit 3 months ago
Hudi ⭐ 4,901
Upserts, Deletes And Incremental Processing on Big Data.
dependent packages 58total releases 21latest release November 11, 2023most recent commit 3 months ago
Incubator Wayang ⭐ 162
Apache Wayang(incubating) is the first cross-platform data processing system.
dependent packages 13total releases 2latest release September 03, 2023most recent commit 3 months ago
Tispark ⭐ 872
TiSpark is built for running Apache Spark on top of TiDB/TiKV
dependent packages 10total releases 55latest release August 08, 2023most recent commit 3 months ago
Incubator Livy ⭐ 840
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
dependent packages 8total releases 6latest release September 25, 2023most recent commit 3 months ago
Delta Sharing ⭐ 654
An open protocol for secure data sharing
dependent packages 7total releases 33latest release December 02, 2023most recent commit 3 months agopypi delta-sharing} Downloads
The 10 Latest Releases In Scala Spark Big Data Open Source Projects
Delta Sharing ⭐ 654
An open protocol for secure data sharing
dependent packages 7total releases 33latest release December 02, 2023most recent commit 3 months agopypi delta-sharing} Downloads
Synapseml ⭐ 4,967
Simple and Distributed Machine Learning
dependent packages 6total releases 12latest release November 27, 2023most recent commit 2 days ago
Hudi ⭐ 4,901
Upserts, Deletes And Incremental Processing on Big Data.
dependent packages 58total releases 21latest release November 11, 2023most recent commit 3 months ago
Pramen ⭐ 20
Resilient data pipeline framework running on Apache Spark
dependent packages 2total releases 19latest release November 10, 2023most recent commit 3 months ago
Sparkling Water ⭐ 957
Sparkling Water provides H2O functionality inside Spark cluster
dependent packages 6total releases 195latest release October 26, 2023most recent commit 4 months ago
Spark Rapids ⭐ 619
Spark RAPIDS plugin - accelerate Apache Spark with GPUs
dependent packages 1total releases 19latest release October 24, 2023most recent commit 3 months ago
Incubator Livy ⭐ 840
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
dependent packages 8total releases 6latest release September 25, 2023most recent commit 3 months ago
Incubator Wayang ⭐ 162
Apache Wayang(incubating) is the first cross-platform data processing system.
dependent packages 13total releases 2latest release September 03, 2023most recent commit 3 months ago
Tispark ⭐ 872
TiSpark is built for running Apache Spark on top of TiDB/TiKV
dependent packages 10total releases 55latest release August 08, 2023most recent commit 3 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.