Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Python Spark Open Source Projects

Open source projects categorized as Python Spark
Flytekit ⭐ 175
Extensible Python SDK for developing Flyte tasks and workflows. Simple to get started and learn and highly extensible.
dependent packages 55total releases 350most recent commit 3 months agopypi flytekit} Downloads
Spark Ml Streaming ⭐ 175
Visualize streaming machine learning in Spark
total releases 1most recent commit 7 years ago
Visions ⭐ 166
Type System for Data Analysis in Python
dependent packages 8total releases 27most recent commit a year agopypi visions} Downloads
Avenir ⭐ 164
Set of Machine Learning and Stochastic Optimazion tools based on Hadoop, Spark and Storm https://pkghosh.wordpress.com/
most recent commit 2 years ago
Cape Dataframes ⭐ 162
Privacy transformations on Spark and Pandas dataframes backed by a simple policy language.
total releases 6most recent commit a year ago
Juicy Bigdata ⭐ 162
🎉🎉🐳 Datawhale大数据处理导论教程 | 大数据技术方向的开篇课程🎉🎉
most recent commit a year ago
Qb ⭐ 160
QANTA Quiz Bowl AI
most recent commit 2 years ago
Seqr ⭐ 158
web-based analysis tool for rare disease genomics
most recent commit 3 months ago
Lakehouse Engine ⭐ 154
The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for several lakehouse algorithms, data flows and utilities for Data Products.
most recent commit 3 months ago
Aztk ⭐ 152
AZTK powered by Azure Batch: On-demand, Dockerized, Spark Jobs on Azure
total releases 24most recent commit 3 years ago
Spark Extension ⭐ 152
A library that provides useful extensions to Apache Spark and PySpark.
total releases 65most recent commit 3 months ago
Ipython Spark Docker ⭐ 151
most recent commit 8 years ago
Data Algorithms With Spark ⭐ 151
O'Reilly Book: [Data Algorithms with Spark] by Mahmoud Parsian
most recent commit 10 months ago
Geopyspark ⭐ 151
GeoTrellis for PySpark
most recent commit 4 years ago
Tuhi ⭐ 144
An application to access Wacom SmartPad devices
most recent commit a year ago
Albedo ⭐ 142
A recommender system for discovering GitHub repos, built with Apache Spark
most recent commit 4 years ago
Sparknotebook ⭐ 142
An example of running Apache Spark using Scala in ipython notebook
most recent commit 9 years ago
Pyspark Cheatsheet ⭐ 140
PySpark Cheat Sheet - example code to help you learn PySpark and develop apps faster
most recent commit 2 years ago
Sqlflow ⭐ 132
SQLflow based on python development, support to Spark, as the underlying distributed computing engine, through a set of unified configuration file to complete the batch, flow calculation, the Rest service development.
total releases 1most recent commit 2 years ago
Spark Ar Creators ⭐ 130
List of 9500 (and counting) Spark AR Creators. Open an issue or contact me if you want to be added.❤️
most recent commit 5 months ago
Handyspark ⭐ 129
HandySpark - bringing pandas-like capabilities to Spark dataframes
total releases 7most recent commit 5 years ago
Aut ⭐ 128
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
total releases 27most recent commit 9 months ago
Trace Analysis ⭐ 128
Scripts to analyze Spark's performance
most recent commit 6 years ago
The 10 Latest Releases In Python Spark Open Source Projects
Dataset_loader ⭐ 9
total releases 10latest release February 12, 2020most recent commit 4 years ago
Sparktorch ⭐ 297
Train and run Pytorch models on Apache Spark.
total releases 11latest release December 07, 2019most recent commit a year ago
Smv ⭐ 41
Spark Modularized View
total releases 10latest release September 19, 2019most recent commit 4 years ago
Python Spark ⭐ 44
An Earley-Algorithm Context-free grammar Parser Toolkit
dependent packages 6total releases 28latest release July 29, 2019most recent commit 3 months agopypi spark-parser} Downloads
Featuretoolsonspark ⭐ 16
A simplified version of featuretools for Spark
total releases 4latest release June 13, 2019most recent commit 5 years ago
Handyspark ⭐ 129
HandySpark - bringing pandas-like capabilities to Spark dataframes
total releases 7latest release May 19, 2019most recent commit 5 years ago
Sparkflow ⭐ 301
Easy to use library to bring Tensorflow on Apache Spark
total releases 13latest release May 18, 2019most recent commit 6 months ago
Jupyterlab Spark Ui Tab ⭐ 6
a JupyterLab extension to show spark-ui as console tab
dependent packages 2total releases 8latest release May 13, 2019most recent commit 4 years agonpm @liorbaber/jupyterlab-spark-ui-tab} Downloads
Pyoptree ⭐ 15
Python Implementation of Bertsimas's "Optimal classification trees".
total releases 11latest release May 03, 2019most recent commit 4 years ago
Pyspark2pmml ⭐ 93
Python library for converting Apache Spark ML pipelines to PMML
dependent packages 2total releases 2latest release April 08, 2019most recent commit 4 months agopypi pyspark2pmml} Downloads
Popular Programming Languages Categories
Python
Javascript
Java
Typescript
C Plus Plus
Php
Golang
C
C Sharp
Shell
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.