Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Spark Data Analysis Open Source Projects

Open source projects categorized as Spark Data Analysis
Categories > Data Processing > Data Analysis
Alluxio ⭐ 6,612
Alluxio, data orchestration for analytics and machine learning in the cloud
dependent packages 53total releases 73most recent commit a month ago
Spark Py Notebooks ⭐ 1,515
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
most recent commit a year ago
Optimus ⭐ 1,446
🚚 Agile Data Preparation Workflows made easy with Pandas, Dask, cuDF, Dask-cuDF, Vaex and PySpark
total releases 32most recent commit 11 days ago
Scriptis ⭐ 767
Scriptis is for interactive data analysis with script development(SQL, Pyspark, HiveQL), task submission(Spark, Hive), UDF, function, resource management and intelligent diagnosis.
most recent commit 2 years ago
Data Science With Ruby ⭐ 664
Practical Data Science with Ruby based tools.
most recent commit 9 months ago
Wedatasphere ⭐ 624
WeDataSphere is a financial grade, one-stop big data platform suite.
most recent commit 3 months ago
Onedal ⭐ 584
oneAPI Data Analytics Library (oneDAL)
dependent packages 4total releases 9most recent commit 3 months ago
Complete Life Cycle Of A Data Science Project ⭐ 499
Complete-Life-Cycle-of-a-Data-Science-Project
most recent commit 4 months ago
Popmon ⭐ 461
Monitor the stability of a Pandas or Spark dataframe ⚙︎
dependent packages 2total releases 36most recent commit 9 months agopypi popmon} Downloads
Zat ⭐ 414
Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark
dependent packages 1total releases 11most recent commit 3 months agopypi zat} Downloads
Data Science ⭐ 269
Projects and awesome list for all Data Science fields
most recent commit 7 months ago
Setl ⭐ 173
A simple Spark-powered ETL framework that just works 🍺
total releases 4most recent commit 5 months ago
Visions ⭐ 166
Type System for Data Analysis in Python
dependent packages 8total releases 27most recent commit a year agopypi visions} Downloads
Big Data Mapreduce Course ⭐ 135
Big Data Modeling, MapReduce, Spark, PySpark @ Santa Clara University
most recent commit 5 months ago
Ml Resource ⭐ 110
A concise resource repository for machine learning
most recent commit 4 months ago
Spark R Notebooks ⭐ 109
R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks
most recent commit 7 years ago
Udacity Data Engineer Nanodegree ⭐ 64
Classwork projects and home works done through Udacity data engineering nano degree
most recent commit 4 months ago
Apachespark ⭐ 59
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
most recent commit 2 years ago
Spotify Song Recommendation Ml ⭐ 52
UC Berkeley team's submission for RecSys Challenge 2018
most recent commit 6 years ago
Learning Spark Lightning Fast Big Data Analysis ⭐ 47
Learning Spark: Lightning-Fast Big Data Analysis reading notes
most recent commit 9 years ago
Big Data Analysis With Scala And Spark ⭐ 45
My submissions for the Coursera MOOC "Big Data Analysis with Scala and Spark" given by EPFL.
most recent commit 7 years ago
Architect_big_data_solutions_with_spark ⭐ 42
code, labs and lectures for the course
most recent commit a year ago
Ides ⭐ 32
智能数据探索服务(Intelligent Data Exploration Service)，一站式Data + AI数据解决方案！
most recent commit 10 months ago
The 5 Most Depended On Spark Data Analysis Open Source Projects
Alluxio ⭐ 6,612
Alluxio, data orchestration for analytics and machine learning in the cloud
dependent packages 53total releases 73latest release November 29, 2023most recent commit a month ago
Visions ⭐ 166
Type System for Data Analysis in Python
dependent packages 8total releases 27latest release December 05, 2021most recent commit a year agopypi visions} Downloads
Onedal ⭐ 584
oneAPI Data Analytics Library (oneDAL)
dependent packages 4total releases 9latest release April 18, 2023most recent commit 3 months ago
Popmon ⭐ 461
Monitor the stability of a Pandas or Spark dataframe ⚙︎
dependent packages 2total releases 36latest release July 18, 2023most recent commit 9 months agopypi popmon} Downloads
Zat ⭐ 414
Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark
dependent packages 1total releases 11latest release January 26, 2023most recent commit 3 months agopypi zat} Downloads
The 10 Latest Releases In Spark Data Analysis Open Source Projects
Alluxio ⭐ 6,612
Alluxio, data orchestration for analytics and machine learning in the cloud
dependent packages 53total releases 73latest release November 29, 2023most recent commit a month ago
Python_moztelemetry ⭐ 13
Spark bindings for Mozilla Telemetry
total releases 114latest release November 21, 2023most recent commit 6 months ago
Popmon ⭐ 461
Monitor the stability of a Pandas or Spark dataframe ⚙︎
dependent packages 2total releases 36latest release July 18, 2023most recent commit 9 months agopypi popmon} Downloads
Onedal ⭐ 584
oneAPI Data Analytics Library (oneDAL)
dependent packages 4total releases 9latest release April 18, 2023most recent commit 3 months ago
Zat ⭐ 414
Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark
dependent packages 1total releases 11latest release January 26, 2023most recent commit 3 months agopypi zat} Downloads
Visions ⭐ 166
Type System for Data Analysis in Python
dependent packages 8total releases 27latest release December 05, 2021most recent commit a year agopypi visions} Downloads
Sparkdataset ⭐ 28
Instant search for and access to many datasets in Pyspark.
total releases 3latest release November 01, 2021most recent commit 2 years ago
Setl ⭐ 173
A simple Spark-powered ETL framework that just works 🍺
total releases 4latest release August 21, 2020most recent commit 5 months ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.