Awesome Open Source

Programming Languages

The Top 23 Scala Big Data Open Source Projects

Open source projects categorized as Scala Big Data

Categories > Data Processing > Big Data

Categories > Programming Languages > Scala

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46most recent commit 3 months ago

Flink ⭐ 22,747

dependent packages 413total releases 119most recent commit 3 months ago

Bigdata Notes ⭐ 14,872

大数据入门指南 ⭐

most recent commit 4 months ago

Predictionio ⭐ 12,548

PredictionIO, a machine learning server for developers and ML engineers.

dependent packages 8total releases 5most recent commit 3 years ago

Cmak ⭐ 11,670

CMAK is a tool for managing Apache Kafka clusters

most recent commit 9 months ago

Zeppelin ⭐ 6,259

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

dependent packages 31total releases 2most recent commit 16 days ago

npm zeppelin-vis} Downloads

Synapseml ⭐ 4,967

Simple and Distributed Machine Learning

dependent packages 6total releases 12most recent commit 3 days ago

Upserts, Deletes And Incremental Processing on Big Data.

dependent packages 58total releases 21most recent commit 3 months ago

Bigdataguide ⭐ 2,355

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

most recent commit 4 months ago

Carbondata ⭐ 1,401

High performance data store solution

total releases 1most recent commit 5 months ago

Utils4s ⭐ 1,033

scala、spark使用过程中，各种测试用例以及相关资料整理

most recent commit 5 years ago

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

dependent packages 17total releases 14most recent commit 3 months ago

Sparkling Water ⭐ 957

Sparkling Water provides H2O functionality inside Spark cluster

dependent packages 6total releases 195most recent commit 4 months ago

Tispark ⭐ 872

TiSpark is built for running Apache Spark on top of TiDB/TiKV

dependent packages 10total releases 55most recent commit 3 months ago

Incubator Livy ⭐ 840

Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

dependent packages 8total releases 6most recent commit 3 months ago

Mirror of Apache Samza

most recent commit 3 months ago

Gearpump ⭐ 758

Lightweight real-time big data streaming engine over Akka

dependent packages 16total releases 21most recent commit 2 years ago

Delta Sharing ⭐ 654

An open protocol for secure data sharing

dependent packages 7total releases 33most recent commit 3 months ago

pypi delta-sharing} Downloads

Spark Rapids ⭐ 619

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

dependent packages 1total releases 19most recent commit 3 months ago

Nussknacker ⭐ 564

Low-code tool for automating actions on real time data | Stream processing for the users.

dependent packages 31total releases 31most recent commit 3 months ago

Data Lineage Tracking And Visualization Solution

dependent packages 6total releases 14most recent commit 5 months ago

Metorikku ⭐ 536

A simplified, lightweight ETL Framework based on Apache Spark

total releases 126most recent commit a year ago

Magellan ⭐ 509

Geo Spatial Data Analytics on Spark

most recent commit 3 years ago

The 10 Most Depended On Scala Big Data Open Source Projects

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46latest release May 09, 2021most recent commit 3 months ago

Flink ⭐ 22,747

dependent packages 413total releases 119latest release November 10, 2023most recent commit 3 months ago

Flink Shaded ⭐ 130

Apache Flink shaded artifacts repository

dependent packages 84total releases 18latest release November 13, 2023most recent commit 3 months ago

Upserts, Deletes And Incremental Processing on Big Data.

dependent packages 58total releases 21latest release November 11, 2023most recent commit 3 months ago

Zeppelin ⭐ 6,259

Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.

dependent packages 31total releases 2latest release June 21, 2017most recent commit 16 days ago

npm zeppelin-vis} Downloads

Nussknacker ⭐ 564

Low-code tool for automating actions on real time data | Stream processing for the users.

dependent packages 31total releases 31latest release November 13, 2023most recent commit 3 months ago

Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pipelines.

dependent packages 24total releases 65latest release October 16, 2023most recent commit 5 months ago

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

dependent packages 17total releases 14latest release December 16, 2020most recent commit 3 months ago

Eel Sdk ⭐ 140

Big Data Toolkit for the JVM

dependent packages 17total releases 103latest release February 11, 2019most recent commit 3 years ago

Gearpump ⭐ 758

Lightweight real-time big data streaming engine over Akka

dependent packages 16total releases 21latest release April 04, 2016most recent commit 2 years ago

The 10 Latest Releases In Scala Big Data Open Source Projects

Delta Sharing ⭐ 654

An open protocol for secure data sharing

dependent packages 7total releases 33latest release December 02, 2023most recent commit 3 months ago

pypi delta-sharing} Downloads

Synapseml ⭐ 4,967

Simple and Distributed Machine Learning

dependent packages 6total releases 12latest release November 27, 2023most recent commit 3 days ago

Nussknacker ⭐ 564

Low-code tool for automating actions on real time data | Stream processing for the users.

dependent packages 31total releases 31latest release November 13, 2023most recent commit 3 months ago

Flink Shaded ⭐ 130

Apache Flink shaded artifacts repository

dependent packages 84total releases 18latest release November 13, 2023most recent commit 3 months ago

Parquet4s ⭐ 267

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

dependent packages 6total releases 57latest release November 12, 2023most recent commit 3 months ago

Upserts, Deletes And Incremental Processing on Big Data.

dependent packages 58total releases 21latest release November 11, 2023most recent commit 3 months ago

Resilient data pipeline framework running on Apache Spark

dependent packages 2total releases 19latest release November 10, 2023most recent commit 3 months ago

Flink ⭐ 22,747

dependent packages 413total releases 119latest release November 10, 2023most recent commit 3 months ago

Sparkling Water ⭐ 957

Sparkling Water provides H2O functionality inside Spark cluster

dependent packages 6total releases 195latest release October 26, 2023most recent commit 4 months ago

Spark Rapids ⭐ 619

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

dependent packages 1total releases 19latest release October 24, 2023most recent commit 3 months ago

Popular Data Processing Categories

Jupyter Notebook

Categories

Application Programming Interfaces

Artificial Intelligence

Cloud Computing

Command Line Interface

Computer Science

Configuration Management

Content Management

Data Processing

Integrated Development Environments

Learning Resources

Lists Of Projects

Machine Learning

Operating Systems

Package Managers

Programming Languages

Runtime Environments

Software Architecture

Software Development

Software Performance

Software Quality

Text Processing

User Interface Components

Version Control

Web User Interface

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.