Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Pyspark Open Source Projects

Open source projects categorized as Pyspark
Categories > Data Processing > Pyspark
Anovos ⭐ 78
Anovos - An Open Source Library for Scalable feature engineering Using Apache-Spark
total releases 8most recent commit a year ago
Pyspark Cookbook ⭐ 76
PySpark Cookbook, published by Packt
most recent commit a year ago
Python Spark Streaming ⭐ 73
most recent commit 6 years ago
Jupyterlab Sparkmonitor ⭐ 72
JupyterLab extension that enables monitoring launched Apache Spark jobs from within a notebook
dependent packages 2total releases 29most recent commit 2 years agonpm jupyterlab_sparkmonitor-s} Downloads
Learn By Examples ⭐ 72
Real-world Spark pipelines examples
most recent commit 6 years ago
Jgit Spark Connector ⭐ 67
jgit-spark-connector is a library for running scalable data retrieval pipelines that process any number of Git repositories for source code analysis.
dependent packages 1total releases 40most recent commit 5 years agopypi sourced-engine} Downloads
Pyspark Cassandra ⭐ 67
pyspark-cassandra is a Python port of the awesome @datastax Spark Cassandra connector. Compatible w/ Spark 2.0, 2.1, 2.2, 2.3 and 2.4
most recent commit 2 years ago
Delta Architecture ⭐ 66
Streaming data changes to a Data Lake with Debezium and Delta Lake pipeline
most recent commit a year ago
Pypmml ⭐ 64
Python PMML scoring library
dependent packages 6total releases 15most recent commit a year agopypi pypmml} Downloads
Mmtf Pyspark ⭐ 64
Methods for the parallel and distributed analysis and mining of the Protein Data Bank using MMTF and Apache Spark.
total releases 14most recent commit a year ago
Pyspark_dist_explore ⭐ 64
Data Exploration in PySpark made easy - Pyspark_dist_explore provides methods to get fast insights in your Spark DataFrames.
most recent commit 5 years ago
Pyspark Twitter Stream Mining ⭐ 63
Real-time Machine Learning with Apache Spark on Twitter Public Stream
most recent commit 7 years ago
Nsl Kdd ⭐ 63
PySpark solution to the NSL-KDD dataset: https://www.unb.ca/cic/datasets/nsl.html
most recent commit 4 years ago
W2v ⭐ 62
Word2Vec models with Twitter data using Spark. Blog:
most recent commit 5 years ago
Sparkml ⭐ 61
Spark ML with pyspark
most recent commit a year ago
Sparkly ⭐ 60
Helpers & syntactic sugar for PySpark.
total releases 21most recent commit 10 months ago
Spark ⭐ 60
Apache Spark (Scala, PySpark, SparkR) Code, Tricks, and References
most recent commit 5 years ago
Pysparkgeoanalysis ⭐ 60
🌐 Interactive Workshop on GeoAnalysis using PySpark
most recent commit 7 years ago
Apachespark ⭐ 59
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
most recent commit 2 years ago
Cuallee ⭐ 56
A data quality acceleration library to get data sets verified in a friendly interface
dependent packages 1total releases 54most recent commit 3 months agopypi cuallee} Downloads
Big_data ⭐ 55
Tutorials on Big Data essentials: Hadoop, MapReduce, Spark.
most recent commit 4 months ago
Pyspark Setup Guide ⭐ 54
A guide for setting up Spark + PySpark under Ubuntu linux
most recent commit 7 years ago
Replay ⭐ 53
RecSys Library
most recent commit 2 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.