Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 20 Python Scala Big Data Open Source Projects

Open source projects categorized as Python Scala Big Data
Spark ⭐ 37,661
Apache Spark - A unified analytics engine for large-scale data processing
dependent packages 939total releases 46most recent commit 3 months ago
Flink ⭐ 22,747
Apache Flink
dependent packages 413total releases 119most recent commit 3 months ago
Adam ⭐ 966
ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.
dependent packages 17total releases 14most recent commit 3 months ago
Incubator Livy ⭐ 840
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
dependent packages 8total releases 6most recent commit 3 months ago
Gimel ⭐ 230
Big Data Processing Framework - Unified Data API or SQL on Any Storage
most recent commit a year ago
Predictionio Sdk Python ⭐ 198
PredictionIO Python SDK
most recent commit 6 years ago
Bigdata Playground ⭐ 154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
most recent commit 5 years ago
Griffon Vm ⭐ 129
Griffon Data Science Virtual Machine
most recent commit 2 years ago
Aut ⭐ 128
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
total releases 27most recent commit 10 months ago
Spark Website ⭐ 109
Apache Spark Website
most recent commit 3 months ago
Spark Docker ⭐ 53
Official Dockerfile for Apache Spark
most recent commit 5 months ago
Yuzhouwan ⭐ 42
Code Library for My Blog
most recent commit 3 months ago
Books ⭐ 39
整理一些书籍 ,包含 C&C++ 、git 、Java、Keras 、Linux 、NLP 、Python 、Scala 、TensorFlow 、大数据 、推荐系统、数据库、数据挖掘 、机器学习 、深度学习 、算法等。
most recent commit 5 years ago
Spark Root ⭐ 24
Apache Spark Data Source for ROOT File Format
total releases 15most recent commit 5 years ago
Pyspark ⭐ 15
spark (scala and python)
most recent commit 4 years ago
Bigkube ⭐ 14
Minikube for big data with Scala and Spark
most recent commit 4 years ago
Bigdata_docker ⭐ 13
Big Data Docker Data Science Spark Spark3 Hadoop HDFS Scala Python Artificial Intelligence Machine Learning Jupyter Lab Notebook
most recent commit 3 months ago
Pygmql ⭐ 9
Python Library for data analysis based on GMQL
total releases 16most recent commit 2 years ago
Bigdata Examples ⭐ 9
bigdata examples about spark and flink
most recent commit 6 years ago
Data Engineer Portfolio ⭐ 6
This is a repository to demonstrate my details, skills, projects and to keep track of my progression in Data Analytics and Data Science topics.
most recent commit 5 months ago
The 4 Most Depended On Python Scala Big Data Open Source Projects
Spark ⭐ 37,661
Apache Spark - A unified analytics engine for large-scale data processing
dependent packages 939total releases 46latest release May 09, 2021most recent commit 3 months ago
Flink ⭐ 22,747
Apache Flink
dependent packages 413total releases 119latest release November 10, 2023most recent commit 3 months ago
Incubator Livy ⭐ 840
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
dependent packages 8total releases 6latest release September 25, 2023most recent commit 3 months ago
The 7 Latest Releases In Python Scala Big Data Open Source Projects
Flink ⭐ 22,747
Apache Flink
dependent packages 413total releases 119latest release November 10, 2023most recent commit 3 months ago
Incubator Livy ⭐ 840
Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.
dependent packages 8total releases 6latest release September 25, 2023most recent commit 3 months ago
Aut ⭐ 128
The Archives Unleashed Toolkit is an open-source toolkit for analyzing web archives.
total releases 27latest release November 17, 2022most recent commit 10 months ago
Spark ⭐ 37,661
Apache Spark - A unified analytics engine for large-scale data processing
dependent packages 939total releases 46latest release May 09, 2021most recent commit 3 months ago
Pygmql ⭐ 9
Python Library for data analysis based on GMQL
total releases 16latest release June 19, 2019most recent commit 2 years ago
Spark Root ⭐ 24
Apache Spark Data Source for ROOT File Format
total releases 15latest release January 10, 2018most recent commit 5 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.