Awesome Open Source
Awesome Open Source
Combined Topics
jupyter-notebook x
spark x

The Top 758 Jupyter Notebook Spark Open Source Projects

Categories > Data Processing > Jupyter Notebook
Data Engineering Zoomcamp ⭐ 12,015
Free Data Engineering course!
most recent commit a day ago
Ds Cheatsheets ⭐ 11,535
List of Data Science Cheatsheets to rule the world
most recent commit 3 months ago
H2o 3 ⭐ 6,130
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
dependent packages 30total releases 232most recent commit a day ago
Bigdl ⭐ 4,142
Fast, distributed, secure AI for Big Data
dependent packages 10total releases 16most recent commit 18 hours ago
Helk ⭐ 2,861
The Hunting ELK
most recent commit 2 years ago
Analytics Zoo ⭐ 2,545
Distributed Tensorflow, Keras and PyTorch on Apache Spark/Flink & Ray
dependent packages 3total releases 302most recent commit 2 months agopypi bigdl-orca} Downloads
Almond ⭐ 1,480
A Scala kernel for Jupyter
dependent packages 17total releases 41most recent commit 7 days ago
Caffeonspark ⭐ 1,272
Distributed deep learning on Hadoop and Spark clusters.
most recent commit 3 years ago
Spark Py Notebooks ⭐ 1,227
Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks
most recent commit 5 years ago
Sparkmagic ⭐ 1,198
Jupyter magics and kernels for working with remote Spark clusters
dependent packages 5total releases 47most recent commit 10 days agopypi hdijupyterutils} Downloads
Pixiedust ⭐ 1,030
Python Helper library for Jupyter Notebooks
dependent packages 7total releases 92most recent commit 2 years agopypi pixiedust} Downloads
Pyspark Tutorial ⭐ 959
PySpark-Tutorial provides basic algorithms using PySpark
most recent commit 19 days ago
Cube Studio ⭐ 950
云原生一站式机器学习平台，多租户，数据资产，notebook在线开发，拖拉拽任务流编排，多机多卡分布 ai应用商店
most recent commit 3 days ago
Spark Scala Tutorial ⭐ 922
A free tutorial for Apache Spark.
most recent commit 2 years ago
Spark Nlp Workshop ⭐ 824
Public runnable examples of using John Snow Labs' NLP for Apache Spark.
most recent commit 19 hours ago
Spark Movie Lens ⭐ 757
An on-line movie recommender using Spark, Python Flask, and the MovieLens dataset
most recent commit 2 years ago
Incubator Toree ⭐ 705
Mirror of Apache Toree (Incubating)
most recent commit 2 months ago
Justenoughscalaforspark ⭐ 643
A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.
most recent commit 7 months ago
Elasticsearch Spark Recommender ⭐ 603
Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch
most recent commit 3 years ago
Streaming Benchmarks ⭐ 560
Benchmarks for Low Latency (Streaming) solutions including Apache Storm, Apache Spark, Apache Flink, ...
most recent commit a year ago
Enterprise_gateway ⭐ 545
A lightweight, multi-tenant, scalable and secure gateway that enables Jupyter Notebooks to share resources across distributed clusters such as Apache Spark, Kubernetes and others.
most recent commit a day ago
Agile_data_code_2 ⭐ 423
Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition
most recent commit a year ago
Popmon ⭐ 414
Monitor the stability of a Pandas or Spark dataframe ⚙︎
dependent packages 2total releases 32most recent commit 8 days agopypi popmon} Downloads
Learningpyspark ⭐ 409
Code base for the Learning PySpark book (in preparation)
most recent commit 4 years ago
Machinelearning ⭐ 406
Machine Learning
most recent commit 6 years ago
Spark Syntax ⭐ 391
This is a repo documenting the best practices in PySpark.
most recent commit 4 years ago
Miscellaneous ⭐ 332
Includes notes on Apache Spark, Spark for Physics, Jupyter notebook examples for Spark, Oracle and other DB systems.
total releases 3most recent commit 13 days ago
Synapse ⭐ 324
Samples for Azure Synapse Analytics
most recent commit a month ago
Data Engineering Projects ⭐ 316
Personal Data Engineering Projects
most recent commit a day ago
Spark Standalone Cluster On Docker ⭐ 311
Learn Apache Spark in Scala, Python (PySpark) and R (SparkR) by building your own cluster with a JupyterLab interface on Docker. ⚡️
most recent commit 2 months ago
Learning Pyspark ⭐ 294
Code repository for Learning PySpark by Packt
most recent commit 10 days ago
Spark Jupyter Aws ⭐ 255
A guide on how to set up Jupyter with Pyspark painlessly on AWS EC2 clusters, with S3 I/O support
most recent commit 5 years ago
Installations_mac_ubuntu_windows ⭐ 233
Installations for Data Science. Anaconda, RStudio, Spark, TensorFlow, AWS (Amazon Web Services).
most recent commit 15 days ago
Data_science_blogs ⭐ 232
A repository to keep track of all the code that I end up writing for my blog posts.
most recent commit 2 months ago
Bigdata_docker ⭐ 226
Big Data Ecosystem Docker
most recent commit a year ago
Ngods Stocks ⭐ 217
New Generation Opensource Data Stack Demo
most recent commit 3 days ago
Spark Fm Parallelsgd ⭐ 212
Implementation of Factorization Machines on Spark using parallel stochastic gradient descent (python and scala)
most recent commit 7 years ago
Bigdl Tutorials ⭐ 201
Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL
most recent commit a month ago
Rasterframes ⭐ 201
Geospatial Raster support for Spark DataFrames
dependent packages 3total releases 16most recent commit 20 days ago
Jupyter Spark ⭐ 192
Jupyter Notebook extension for Apache Spark integration
most recent commit 2 years ago
Kamu Cli ⭐ 189
New generation decentralized data warehouse and streaming data pipeline
most recent commit 4 days ago
Rumble ⭐ 183
⛈️ RumbleDB 1.20.0 "Honeylocust" 🌳 for Apache Spark | Run queries on your large-scale, messy JSON-like data (JSON, text, CSV, Parquet, ROOT, AVRO, SVM...) | No install required (just a jar to download) | Declarative Machine Learning and more
total releases 4most recent commit 23 days ago
Book Resources ⭐ 181
most recent commit 5 years ago
Azure Cosmosdb Spark ⭐ 179
Apache Spark Connector for Azure Cosmos DB
dependent packages 1total releases 45most recent commit a year ago
Cloud Dataproc ⭐ 173
Cloud Dataproc: Samples and Utils
most recent commit 2 months ago
Mydatascienceportfolio ⭐ 172
Applying Data Science and Machine Learning to Solve Real World Business Problems
most recent commit 3 years ago
Spark On Kubernetes Helm ⭐ 166
Spark on Kubernetes infrastructure Helm charts repo
most recent commit 4 months ago
Sparkmonitor ⭐ 164
Monitor Apache Spark from Jupyter Notebook
total releases 49most recent commit 9 months ago
Scalable Data Science Platform ⭐ 153
Content for architecting a data science platform for products using Luigi, Spark & Flask.
most recent commit 3 years ago
Spark Practice ⭐ 153
Apache Spark (PySpark) Practice on Real Data
most recent commit 3 years ago
Geopyspark ⭐ 151
GeoTrellis for PySpark
most recent commit 3 years ago
Spark Style Guide ⭐ 145
Spark style guide
most recent commit 22 days ago
Sparknotebook ⭐ 142
An example of running Apache Spark using Scala in ipython notebook
most recent commit 7 years ago
Csdn Code ⭐ 138
停止维护 -->移步 https://github.com/vbay/tutorials
most recent commit 5 years ago
Data Science ⭐ 138
Projects and awesome list for all Data Science fields
most recent commit a day ago
Mastering Apache Spark ⭐ 130
This is repository of my YouTube Course on End to End Apache Spark in AIEngineering YouTube Channel
most recent commit 2 years ago
Handyspark ⭐ 129
HandySpark - bringing pandas-like capabilities to Spark dataframes
total releases 7most recent commit 4 years ago
Rikai ⭐ 127
Parquet-based ML data format optimized for working with unstructured data
dependent packages 5total releases 36most recent commit 2 months agopypi rikai} Downloads
Beymani ⭐ 126
Hadoop, Spark and Storm based anomaly detection implementations for data quality, cyber security, fraud detection etc.
most recent commit 9 months ago
Data Science Tutorials ⭐ 124
Python Tutorials for Data Science
most recent commit 9 days ago
Mastering Big Data Analytics With Pyspark ⭐ 118
Mastering Big Data Analytics with PySpark, Published by Packt
most recent commit 16 days ago
Data_engineer_should_know ⭐ 117
데이터 엔지니어가 알아야 하는 것들
most recent commit 2 days ago
Spark Df Profiling ⭐ 115
Create HTML profiling reports from Apache Spark DataFrames
total releases 13most recent commit 3 years ago
Spark R Notebooks ⭐ 109
R on Apache Spark (SparkR) tutorials for Big Data analysis and Machine Learning as IPython / Jupyter notebooks
most recent commit 5 years ago
Hops Examples ⭐ 109
Examples for Deep Learning/Feature Store/Spark/Flink/Hive/Kafka jobs and Jupyter notebooks on Hops
most recent commit 2 months ago
Spark Tpc Ds Performance Test ⭐ 104
Use the TPC-DS benchmark to test Spark SQL performance
most recent commit 3 years ago
Python Bigdata ⭐ 104
Data science and Big Data with Python
most recent commit 2 years ago
Spark Nlp Models ⭐ 100
Models and Pipelines for the Spark NLP library
most recent commit a year ago
Spark With Python ⭐ 98
Fundamentals of Spark with Python (using PySpark), code examples
most recent commit 3 years ago
Medium Articles ⭐ 97
Repo for all my code on the articles I post on medium
most recent commit 4 months ago
Eclairjs Nashorn ⭐ 94
JavaScript API for Apache Spark
total releases 10most recent commit 6 years ago
Distributed Statistical Computing ⭐ 91
Teaching Materials for Distributed Statistical Computing (大数据分布式计算教学材料)
most recent commit 2 months ago
Kafka Sparkstreaming Cassandra ⭐ 86
Docker container for Kafka - Spark Streaming - Cassandra
most recent commit 4 years ago
Pyspark Predictive Maintenance ⭐ 85
Predictive Maintenance using Pyspark
most recent commit 4 years ago
Spark.samples ⭐ 81
tutorials and samples that show you how get the most out of IBM Analytics for Apache Spark
most recent commit 5 years ago
Data Engineering Nanodegree ⭐ 76
Projects done in the Data Engineering Nanodegree by Udacity.com
most recent commit 4 years ago
Python Spark Streaming ⭐ 73
most recent commit 5 years ago
Jupyterlab Sparkmonitor ⭐ 72
JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
total releases 29most recent commit 10 months ago
Jupyterlab Integration ⭐ 72
DEPRECATED: Integrating Jupyter with Databricks via SSH
dependent packages 1total releases 2most recent commit 7 months agopypi databrickslabs-jupyterlab-status} Downloads
Sit742 ⭐ 68
SIT742: Modern Data Science
most recent commit 4 months ago
Learning Deep ⭐ 65
All my deep learning notes: contains v1 of machine learning with Jeremy Howard, and v1 of Fastai Deep Learning 2018 part 1
most recent commit 5 years ago
Taxiprediction ⭐ 65
most recent commit 7 years ago
Airflow Spark ⭐ 64
Docker with Airflow and Spark standalone cluster
most recent commit a year ago
Ammonium ⭐ 64
Impatient fork of Ammonite
dependent packages 22total releases 8most recent commit 5 years ago
Big Data Engineering Coursera Yandex ⭐ 63
Big Data for Data Engineers Coursera Specialization from Yandex
most recent commit 4 years ago
Building Spark Applications Live Lessons ⭐ 63
Supporting content (slides and exercises) for the Addison-Wesley (Pearson) video series covering best practices for developing scalable Spark applications for predictive analytics in the context of a data scientist's standard workflow.
most recent commit 7 years ago
W2v ⭐ 62
Word2Vec models with Twitter data using Spark. Blog:
most recent commit 4 years ago
W261 Environment ⭐ 61
most recent commit 15 days ago
Spark ⭐ 60
Apache Spark (Scala, PySpark, SparkR) Code, Tricks, and References
most recent commit 4 years ago
Visualize Data With Python ⭐ 60
A Jupyter notebook using some standard techniques for data science and data engineering to analyze data for the 2017 flooding in Houston, TX.
most recent commit a month ago
Pysparkgeoanalysis ⭐ 60
🌐 Interactive Workshop on GeoAnalysis using PySpark
most recent commit 6 years ago
Clinical Notes Diagnosis Dl Nlp ⭐ 59
most recent commit a year ago
Spark Ocr Workshop ⭐ 59
Public runnable examples of using John Snow Labs' OCR for Apache Spark.
most recent commit 17 days ago
Nlp_spark ⭐ 58
Natural Language Processing with Spark's MLlib
most recent commit 5 years ago
Jupyter Extensions ⭐ 58
Jupyter extensions for SWAN
dependent packages 2total releases 2most recent commit 2 months agopypi swanportallocator} Downloads
Bigdataanalytics_infoh515 ⭐ 56
Material for the Big Data Analytics exercise classes - INFOH515 - Big Data : Distributed Data Management and Scalable Analytics - Université Libre de Bruxelles
most recent commit a year ago
Kafka Streaming Click Analysis ⭐ 56
Use Kafka and Apache Spark streaming to perform click stream analytics
most recent commit 3 years ago
Machine Learning With Spark ⭐ 56
Create scalable machine learning applications to power a modern data-driven business using Spark
most recent commit 10 days ago
Bigbio ⭐ 54
most recent commit 6 years ago
Pyspark Setup Guide ⭐ 54
A guide for setting up Spark + PySpark under Ubuntu linux
most recent commit 6 years ago
1-100 of 758 projects
Related Awesome Lists
Python Jupyter Notebook Projects (12,976)
Jupyter Notebook Machine Learning Projects (10,674)
Jupyter Notebook Deep Learning Projects (9,422)
Jupyter Notebook Learning Projects (8,038)
Jupyter Notebook Dataset Projects (6,824)
Jupyter Notebook Tensorflow Projects (4,771)
Jupyter Notebook Data Science Projects (4,053)
Jupyter Notebook Neural Projects (3,926)
Jupyter Notebook Pytorch Projects (3,877)
Jupyter Notebook Natural Language Processing Projects (3,720)
Jupyter Notebook Neural Network Projects (3,677)
Jupyter Notebook Network Projects (3,562)
Jupyter Notebook Keras Projects (3,399)
Jupyter Notebook Pandas Projects (2,851)
Jupyter Notebook Convolutional Neural Networks Projects (2,784)
Jupyter Notebook Tutorials Projects (2,714)
Jupyter Notebook Algorithms Projects (2,326)
Jupyter Notebook Kaggle Projects (2,131)
Jupyter Notebook Computer Vision Projects (1,952)
Python Spark Projects (1,930)
Jupyter Notebook Paper Projects (1,878)
Jupyter Notebook Numpy Projects (1,747)
Jupyter Notebook Visualization Projects (1,698)
Jupyter Notebook Lstm Projects (1,686)
Jupyter Notebook Artificial Intelligence Projects (1,645)
Jupyter Notebook Data Analysis Projects (1,645)
Jupyter Notebook Docker Projects (1,480)
Jupyter Notebook Matplotlib Projects (1,362)
Jupyter Notebook Generative Adversarial Network Projects (1,215)
Jupyter Notebook Data Visualization Projects (1,116)
Jupyter Notebook Text Projects (1,107)
Jupyter Notebook Series Projects (1,018)
Spark Kafka Projects (985)
Jupyter Notebook Book Projects (925)
Jupyter Notebook Statistics Projects (867)
Jupyter Notebook Google Projects (834)
Jupyter Notebook Classification Projects (831)
Jupyter Notebook Gpu Projects (782)
Jupyter Notebook Recommendation System Projects (763)
Jupyter Notebook Eda Projects (762)
Jupyter Notebook Embeddings Projects (707)
Docker Spark Projects (683)
Jupyter Notebook Image Classification Projects (675)
Jupyter Notebook Video Game Projects (665)
Jupyter Notebook Forecasting Projects (653)
Jupyter Notebook Programming Projects (617)
Jupyter Notebook Bayesian Projects (598)
Jupyter Notebook Adversarial Projects (596)
Jupyter Notebook Word2vec Projects (564)
Categories
Advertising 📦 8
All Projects
Application Programming Interfaces 📦 107
Applications 📦 174
Artificial Intelligence 📦 69
Blockchain 📦 66
Build Tools 📦 105
Cloud Computing 📦 68
Code Quality 📦 24
Collaboration 📦 27
Command Line Interface 📦 38
Community 📦 79
Companies 📦 60
Compilers 📦 59
Computer Science 📦 73
Configuration Management 📦 37
Content Management 📦 153
Control Flow 📦 187
Data Formats 📦 72
Data Processing 📦 249
Data Storage 📦 116
Economics 📦 56
Frameworks 📦 178
Games 📦 110
Graphics 📦 92
Hardware 📦 137
Integrated Development Environments 📦 43
Learning Resources 📦 139
Legal 📦 24
Libraries 📦 117
Lists Of Projects 📦 19
Machine Learning 📦 313
Mapping 📦 57
Marketing 📦 15
Mathematics 📦 54
Media 📦 214
Messaging 📦 96
Networking 📦 292
Operating Systems 📦 72
Operations 📦 114
Package Managers 📦 50
Programming Languages 📦 173
Runtime Environments 📦 90
Science 📦 42
Security 📦 342
Social Media 📦 23
Software Architecture 📦 65
Software Development 📦 60
Software Performance 📦 53
Software Quality 📦 116
Text Editors 📦 40
Text Processing 📦 118
User Interface 📦 291
User Interface Components 📦 440
Version Control 📦 26
Virtualization 📦 63
Web Browsers 📦 35
Web Servers 📦 23
Web User Interface 📦 167
Top Programming Languages
Javascript  (1,161,997)
Python  (894,644)
Java  (413,360)
Typescript  (309,234)
Php  (298,628)
C Plus Plus  (259,057)
Ruby  (225,255)
C  (194,474)
Shell  (183,095)
C Sharp  (179,238)
Golang  (172,740)
Rust  (69,269)
Swift  (69,228)
Dart  (62,483)
R  (62,395)
Objective C  (57,061)
Kotlin  (53,812)
Lua  (38,640)
Matlab  (32,965)
Perl  (30,860)
Language  (29,927)
Scala  (29,402)
Haskell  (20,963)
Powershell  (20,493)
Clojure  (19,582)
Bash  (19,245)
Elixir  (17,497)
Coffeescript  (17,131)
Assembly  (15,728)
Julia  (14,089)
Processing  (13,333)
Emacs Lisp  (10,889)
Basic  (10,672)
Flow  (10,516)
Solidity  (10,157)
Erlang  (9,127)
Groovy  (8,622)
Scheme  (8,445)
Ocaml  (6,962)
Pascal  (6,827)
Hack  (6,599)
Lisp  (6,357)
Fortran  (5,814)
Elm  (5,566)
Common Lisp  (5,472)
Shell Script  (4,857)
Dlang  (4,800)
Python Library  (4,522)
Crystal  (4,451)
F Sharp  (4,273)
Privacy | About | Terms | Follow Us On Twitter | Top Projects

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2023 Awesome Open Source.  All rights reserved.