Awesome Open Source

Programming Languages

The Top 23 Python Java Big Data Open Source Projects

Open source projects categorized as Python Java Big Data

Categories > Data Processing > Big Data

Categories > Programming Languages > Java

Categories > Programming Languages > Python

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46most recent commit 3 months ago

Flink ⭐ 22,747

dependent packages 413total releases 119most recent commit 3 months ago

Apache Beam is a unified programming model for Batch and Streaming data processing.

dependent packages 14total releases 568most recent commit 3 months ago

H2o 3 ⭐ 6,618

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

dependent packages 33total releases 49most recent commit 3 months ago

Apache Avro is a data serialization system.

dependent packages 1,481total releases 151most recent commit 3 months ago

Lakesoul ⭐ 2,248

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

dependent packages 1total releases 7most recent commit 3 months ago

Ambari ⭐ 2,030

Apache Ambari simplifies provisioning, managing, and monitoring of Apache Hadoop clusters.

total releases 4most recent commit 3 months ago

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

dependent packages 17total releases 14most recent commit 3 months ago

Coding Now ⭐ 925

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、

most recent commit 2 years ago

Courses ⭐ 590

Answers for Quizzes & Assignments that I have taken

most recent commit a year ago

Flink Ml ⭐ 270

Machine learning library of Apache Flink

dependent packages 10total releases 1most recent commit 6 months ago

TipDM建模平台，开源的数据挖掘工具。

most recent commit 2 years ago

Notebook ⭐ 140

✍ 记录一路走来学习的计算机专业知识，力求构建 AI & CS & SE 知识体系

most recent commit 2 years ago

Spark Website ⭐ 109

Apache Spark Website

most recent commit 3 months ago

Spark Docker ⭐ 53

Official Dockerfile for Apache Spark

most recent commit 5 months ago

🔥 Latest computer science e-books。提供最新技术类电子书下载， “我无非就是想卷死各位，或者被各位卷死！”

most recent commit a year ago

Yuzhouwan ⭐ 42

Code Library for My Blog

most recent commit 3 months ago

Phoenix Queryserver ⭐ 41

Apache Phoenix Query Server

most recent commit 3 months ago

整理一些书籍 ,包含 C&C++ 、git 、Java、Keras 、Linux 、NLP 、Python 、Scala 、TensorFlow 、大数据、推荐系统、数据库、数据挖掘、机器学习、深度学习、算法等。

most recent commit 5 years ago

Ambari Metrics ⭐ 34

Apache Ambari Metrics is a sub project of Apache Ambari.

most recent commit 5 months ago

Neo4j Arrow ⭐ 29

High-performance data retrieval from Neo4j with Apache Arrow 🏹

most recent commit 2 years ago

Timehash ⭐ 27

An algorithm for creating user configurable, variable-precision sliding windows of time. Useful for binning time values in large collections of data.

total releases 3most recent commit a year ago

Airavata Django Portal ⭐ 27

Apache Airavata Django Portal Framework

dependent packages 4total releases 3most recent commit 7 months ago

npm django-airavata-api} Downloads

The 9 Most Depended On Python Java Big Data Open Source Projects

Apache Avro is a data serialization system.

dependent packages 1,481total releases 151latest release September 17, 2023most recent commit 3 months ago

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46latest release May 09, 2021most recent commit 3 months ago

Flink ⭐ 22,747

dependent packages 413total releases 119latest release November 10, 2023most recent commit 3 months ago

H2o 3 ⭐ 6,618

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

dependent packages 33total releases 49latest release August 09, 2023most recent commit 3 months ago

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

dependent packages 17total releases 14latest release December 16, 2020most recent commit 3 months ago

Apache Beam is a unified programming model for Batch and Streaming data processing.

dependent packages 14total releases 568latest release November 13, 2023most recent commit 3 months ago

Flink Ml ⭐ 270

Machine learning library of Apache Flink

dependent packages 10total releases 1latest release June 26, 2023most recent commit 6 months ago

Airavata Django Portal ⭐ 27

Apache Airavata Django Portal Framework

dependent packages 4total releases 3latest release August 02, 2018most recent commit 7 months ago

npm django-airavata-api} Downloads

Lakesoul ⭐ 2,248

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

dependent packages 1total releases 7latest release October 12, 2023most recent commit 3 months ago

The 10 Latest Releases In Python Java Big Data Open Source Projects

Apache Beam is a unified programming model for Batch and Streaming data processing.

dependent packages 14total releases 568latest release November 13, 2023most recent commit 3 months ago

Flink ⭐ 22,747

dependent packages 413total releases 119latest release November 10, 2023most recent commit 3 months ago

Lakesoul ⭐ 2,248

LakeSoul is an end-to-end, realtime and cloud native Lakehouse framework with fast data ingestion, concurrent update and incremental data analytics on cloud storages for both BI and AI applications.

dependent packages 1total releases 7latest release October 12, 2023most recent commit 3 months ago

Apache Avro is a data serialization system.

dependent packages 1,481total releases 151latest release September 17, 2023most recent commit 3 months ago

H2o 3 ⭐ 6,618

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

dependent packages 33total releases 49latest release August 09, 2023most recent commit 3 months ago

Flink Ml ⭐ 270

Machine learning library of Apache Flink

dependent packages 10total releases 1latest release June 26, 2023most recent commit 6 months ago

Timehash ⭐ 27

An algorithm for creating user configurable, variable-precision sliding windows of time. Useful for binning time values in large collections of data.

total releases 3latest release January 07, 2022most recent commit a year ago

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46latest release May 09, 2021most recent commit 3 months ago

ADAM is a genomics analysis platform with specialized file formats built using Apache Avro, Apache Spark, and Apache Parquet. Apache 2 licensed.

dependent packages 17total releases 14latest release December 16, 2020most recent commit 3 months ago

Python Library for data analysis based on GMQL

total releases 16latest release June 19, 2019most recent commit 2 years ago

Popular Data Processing Categories

Jupyter Notebook

Categories

Application Programming Interfaces

Artificial Intelligence

Cloud Computing

Command Line Interface

Computer Science

Configuration Management

Content Management

Data Processing

Integrated Development Environments

Learning Resources

Lists Of Projects

Machine Learning

Operating Systems

Package Managers

Programming Languages

Runtime Environments

Software Architecture

Software Development

Software Performance

Software Quality

Text Processing

User Interface Components

Version Control

Web User Interface

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.