Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Spark Distributed Computing Open Source Projects

Open source projects categorized as Spark Distributed Computing
Categories > Software Architecture > Distributed Computing
Fugue ⭐ 1,821
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
dependent packages 23total releases 125most recent commit 3 months agopypi fugue} Downloads
Elephas ⭐ 1,548
Distributed Deep learning with Keras & Spark
total releases 2most recent commit 2 years ago
Data Algorithms Book ⭐ 973
MapReduce, Spark, Java, and Scala for Data Algorithms Book
most recent commit 2 years ago
Metorikku ⭐ 536
A simplified, lightweight ETL Framework based on Apache Spark
total releases 126most recent commit a year ago
Sparktorch ⭐ 297
Train and run Pytorch models on Apache Spark.
total releases 11most recent commit a year ago
Geni ⭐ 268
A Clojure dataframe library that runs on Spark
total releases 33most recent commit 5 months ago
Js Spark ⭐ 186
Realtime calculation distributed system. AKA distributed lodash
dependent packages 5total releases 16most recent commit 6 years agonpm js-spark} Downloads
Sansa Stack ⭐ 139
Big Data RDF Processing and Analytics Stack built on Apache Spark and Apache Jena http://sansa-stack.github.io/SANSA-Stack/
most recent commit 5 months ago
Dizk ⭐ 117
Java library for distributed zero knowledge proof systems
most recent commit 4 years ago
Spark With Python ⭐ 98
Fundamentals of Spark with Python (using PySpark), code examples
most recent commit 4 years ago
Mltoolkits ⭐ 65
learningOrchestra is a distributed Machine Learning integration tool that facilitates and streamlines iterative processes in a Data Science project.
most recent commit 2 years ago
Spark Lp ⭐ 64
Distributed Linear Programming Solver on top of Apache Spark
most recent commit 3 years ago
Frovedis ⭐ 62
Framework of vectorized and distributed data analytics
most recent commit a year ago
Dcf ⭐ 51
Yet another distributed compute framework
dependent packages 5total releases 3most recent commit 4 years agonpm @dcfjs/common} Downloads
Lstm Tensorspark ⭐ 35
Implementation of a LSTM with TensorFlow and distributed on Apache Spark
most recent commit 6 years ago
Dlsa ⭐ 33
Distributed least squares approximation (dlsa) implemented with Apache Spark
most recent commit 6 months ago
Pyspark Algorithms ⭐ 33
PySpark Algorithms Book: https://www.amazon.com/dp/B07X4B2218/ref=sr_1_2
most recent commit 4 years ago
Archived Sansa Query ⭐ 31
SANSA Query Layer
most recent commit 4 years ago
Spark Ray Data Science ⭐ 29
Supporting content (slides and exercises) for the Pearson video series covering best practices for developing scalable applications with Spark and Ray in the context of a data scientist's standard workflow.
most recent commit 2 years ago
Archived Sansa Inference ⭐ 27
A general Inference API based on two of the most popular Big Data processing engines: Apache Spark and Apache Flink
most recent commit 4 years ago
Archived Sansa Owl ⭐ 25
SANSA Stack OWL (Web Ontology Language) API
most recent commit 4 years ago
Open Stream Processing Benchmark ⭐ 24
This repository contains the code base for the Open Stream Processing Benchmark.
most recent commit 3 years ago
Darima ⭐ 23
Distributed ARIMA Models
most recent commit 2 years ago
The 3 Most Depended On Spark Distributed Computing Open Source Projects
Dcf ⭐ 51
Yet another distributed compute framework
dependent packages 5total releases 3latest release March 16, 2021most recent commit 4 years agonpm @dcfjs/common} Downloads
Js Spark ⭐ 186
Realtime calculation distributed system. AKA distributed lodash
dependent packages 5total releases 16latest release July 14, 2015most recent commit 6 years agonpm js-spark} Downloads
The 10 Latest Releases In Spark Distributed Computing Open Source Projects
Spark Utils ⭐ 6
Comfy Utilities for Spark Job Authoring
total releases 17latest release August 24, 2023most recent commit 3 months ago
Metorikku ⭐ 536
A simplified, lightweight ETL Framework based on Apache Spark
total releases 126latest release February 27, 2023most recent commit a year ago
Elephas ⭐ 1,548
Distributed Deep learning with Keras & Spark
total releases 2latest release June 02, 2021most recent commit 2 years ago
Dcf ⭐ 51
Yet another distributed compute framework
dependent packages 5total releases 3latest release March 16, 2021most recent commit 4 years agonpm @dcfjs/common} Downloads
Geni ⭐ 268
A Clojure dataframe library that runs on Spark
total releases 33latest release October 14, 2020most recent commit 5 months ago
Sparktorch ⭐ 297
Train and run Pytorch models on Apache Spark.
total releases 11latest release December 07, 2019most recent commit a year ago
Js Spark ⭐ 186
Realtime calculation distributed system. AKA distributed lodash
dependent packages 5total releases 16latest release July 14, 2015most recent commit 6 years agonpm js-spark} Downloads
Popular Software Architecture Categories
Mvc
Dependency Injection
Mvvm
Domain Driven Design
Flux
Mvp
Design Pattern
Distributed Systems
Cqrs
Viewmodel
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.