Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Spark Big Data Open Source Projects

Open source projects categorized as Spark Big Data
Sift ⭐ 91
Knowledge extraction from web data
most recent commit 6 years ago
Big Data Engineering Coursera Yandex ⭐ 91
Big Data for Data Engineers Coursera Specialization from Yandex
most recent commit a year ago
Splash ⭐ 86
Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange
most recent commit 4 years ago
Flowman ⭐ 85
Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pipelines.
dependent packages 24total releases 65most recent commit 5 months ago
Spark Acid ⭐ 79
ACID Data Source for Apache Spark based on Hive ACID
most recent commit 3 years ago
Cqu_bigdata ⭐ 77
重庆大学计算机学院“大数据课程群”实验及PPT
most recent commit a year ago
Labs ⭐ 73
Research on distributed system
most recent commit 3 years ago
Doric ⭐ 73
Type safety for spark columns
total releases 4most recent commit 5 months ago
Mynote ⭐ 72
本项目已废弃，笔记收藏整理参考：
most recent commit 3 years ago
The Apache Ignite Book ⭐ 72
All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above
most recent commit 5 months ago
Cleanframes ⭐ 70
type-class based data cleansing library for Apache Spark SQL
total releases 16most recent commit 5 years ago
Bigdatarstrata2017 ⭐ 66
All material for "Modeling big data with R, sparklyr, and Apache Spark" Strata Hadoop 2017.
most recent commit 7 years ago
Spark Crowd ⭐ 66
A package for dealing with crowdsourced big data. Website: https://enriquegrodrigo.github.io/spark-crowd/
total releases 8most recent commit 5 years ago
Udacity Data Engineer Nanodegree ⭐ 64
Classwork projects and home works done through Udacity data engineering nano degree
most recent commit 4 months ago
Apache Spark Hands On ⭐ 64
Educational notes,Hands on problems w/ solutions for hadoop ecosystem
most recent commit 5 years ago
Awesome Ai Kubernetes ⭐ 62
❄️ 🐳 Awesome tools and libs for AI, Deep Learning, Machine Learning, Computer Vision, Data Science, Data Analytics and Cognitive Computing that are baked in the oven to be Native on Kubernetes and Docker with Python, R, Scala, Java, C#, Go, Julia, C++ etc
most recent commit 6 years ago
Salt Core ⭐ 60
Looking at big data? Add a little salt.
total releases 11most recent commit a year ago
Spark Records ⭐ 58
Bulletproof Apache Spark jobs with fast root cause analysis of failures.
total releases 1most recent commit 3 years ago
Serverless Spark Workshop ⭐ 56
Solution Accelerators for Serverless Spark on GCP, the industry's first auto-scaling and serverless Spark as a service
most recent commit 5 months ago
Big_data ⭐ 55
Tutorials on Big Data essentials: Hadoop, MapReduce, Spark.
most recent commit 4 months ago
Bigdataparty ⭐ 54
大数据组件 All-in-One 的 Dockerfile
most recent commit 3 years ago
Data_processing_course ⭐ 53
Some class materials for a data processing course using PySpark
most recent commit a year ago
Spark Docker ⭐ 53
Official Dockerfile for Apache Spark
most recent commit 5 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.