Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Scala Spark Open Source Projects

Open source projects categorized as Scala Spark
Spark ⭐ 37,661
Apache Spark - A unified analytics engine for large-scale data processing
dependent packages 939total releases 46most recent commit 3 months ago
Bigdata Notes ⭐ 14,872
大数据入门指南 ⭐
most recent commit 4 months ago
Deeplearning4j ⭐ 13,397
Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.
dependent packages 119total releases 54most recent commit a month ago
It_book ⭐ 8,543
本项目收藏这些年来看过或者听过的一些不错的常用的上千本书籍，没准你想找的书就在这里呢，包含了互联网行
most recent commit 3 years ago
Angel ⭐ 6,690
A Flexible and Powerful Parameter Server for large-scale machine learning
dependent packages 7total releases 23most recent commit 3 months ago
Zeppelin ⭐ 6,259
Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
dependent packages 31total releases 2most recent commit 16 days agonpm zeppelin-vis} Downloads
Synapseml ⭐ 4,967
Simple and Distributed Machine Learning
dependent packages 6total releases 12most recent commit 3 days ago
Hudi ⭐ 4,901
Upserts, Deletes And Incremental Processing on Big Data.
dependent packages 58total releases 21most recent commit 3 months ago
Bigdl ⭐ 4,728
Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm
dependent packages 10total releases 16most recent commit 3 months ago
Tensorflowonspark ⭐ 3,851
TensorFlowOnSpark brings TensorFlow programs to Apache Spark clusters.
total releases 32most recent commit 10 months ago
Learning Spark ⭐ 3,804
Example code from Learning Spark book
most recent commit a year ago
Spark Nlp ⭐ 3,578
State of the Art Natural Language Processing
dependent packages 30total releases 134most recent commit 3 months agopypi spark-nlp} Downloads
Spark Notebook ⭐ 3,147
Interactive and Reactive Data Science using Scala and Spark.
most recent commit a year ago
Deequ ⭐ 3,044
Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.
dependent packages 6total releases 37most recent commit 3 months ago
Spark Jobserver ⭐ 2,837
REST job server for Apache Spark
most recent commit 4 months ago
Analytics Zoo ⭐ 2,592
Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray
dependent packages 3total releases 1most recent commit 4 months agopypi bigdl-orca-spark321} Downloads
Scio ⭐ 2,505
A Scala API for Apache Beam and Google Cloud Dataflow.
dependent packages 37total releases 96most recent commit 3 months ago
Bigdataguide ⭐ 2,355
大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料
most recent commit 4 months ago
Ballista ⭐ 2,244
Distributed compute platform implemented in Rust, and powered by Apache Arrow.
dependent packages 13total releases 4most recent commit 3 years ago
Zio Quill ⭐ 2,135
Compile-time Language Integrated Queries for Scala
dependent packages 20total releases 98most recent commit a month ago
Transmogrifai ⭐ 2,099
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
dependent packages 3total releases 9most recent commit 2 years ago
Szt Bigdata ⭐ 2,055
深圳地铁大数据客流分析系统🚇🚄🌟
most recent commit 3 months ago
Spark Cassandra Connector ⭐ 1,929
DataStax Connector for Apache Spark to Apache Cassandra
dependent packages 22total releases 81most recent commit 3 months ago
The 10 Most Depended On Scala Spark Open Source Projects
Spark ⭐ 37,661
Apache Spark - A unified analytics engine for large-scale data processing
dependent packages 939total releases 46latest release May 09, 2021most recent commit 3 months ago
Hudi ⭐ 4,901
Upserts, Deletes And Incremental Processing on Big Data.
dependent packages 58total releases 21latest release November 11, 2023most recent commit 3 months ago
Spark Testing Base ⭐ 1,475
Base classes to use when writing tests with Spark
dependent packages 52total releases 295latest release October 10, 2023most recent commit 3 months ago
Spark Avro ⭐ 535
Avro Data Source for Apache Spark
dependent packages 39total releases 8latest release October 30, 2017most recent commit 5 years ago
Scio ⭐ 2,505
A Scala API for Apache Beam and Google Cloud Dataflow.
dependent packages 37total releases 96latest release November 21, 2023most recent commit 3 months ago
Freestyle ⭐ 615
A cohesive & pragmatic framework of FP centric Scala libraries
dependent packages 34total releases 19latest release June 07, 2018most recent commit 5 years ago
Spark Nlp ⭐ 3,578
State of the Art Natural Language Processing
dependent packages 30total releases 134latest release December 08, 2023most recent commit 3 months agopypi spark-nlp} Downloads
Spark Csv ⭐ 1,009
CSV Data Source for Apache Spark 1.x
dependent packages 24total releases 13latest release September 05, 2016most recent commit 5 years ago
The 10 Latest Releases In Scala Spark Open Source Projects
Spark Nlp ⭐ 3,578
State of the Art Natural Language Processing
dependent packages 30total releases 134latest release December 08, 2023most recent commit 3 months agopypi spark-nlp} Downloads
Delta Sharing ⭐ 654
An open protocol for secure data sharing
dependent packages 7total releases 33latest release December 02, 2023most recent commit 3 months agopypi delta-sharing} Downloads
Feature Store Api ⭐ 51
Python - Java/Scala API for the Hopsworks feature store
dependent packages 1total releases 136latest release November 28, 2023most recent commit 3 months agopypi hsfs} Downloads
Synapseml ⭐ 4,967
Simple and Distributed Machine Learning
dependent packages 6total releases 12latest release November 27, 2023most recent commit 3 days ago
Scio ⭐ 2,505
A Scala API for Apache Beam and Google Cloud Dataflow.
dependent packages 37total releases 96latest release November 21, 2023most recent commit 3 months ago
Couchbase Spark Connector ⭐ 119
The Official Couchbase Spark Connector
total releases 12latest release November 21, 2023most recent commit 3 months ago
Spark Connector ⭐ 32
Weaviate connector for Apache Spark
dependent packages 1total releases 17latest release November 20, 2023most recent commit 4 months ago
Atum ⭐ 29
A dynamic data completeness and accuracy library at enterprise scale for Apache Spark
dependent packages 5total releases 12latest release November 17, 2023most recent commit a year ago
Epitweetr ⭐ 54
ECDC Early warning tool using Twitter data
total releases 6latest release November 15, 2023most recent commit 5 months ago
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.