Awesome Open Source

Programming Languages

The Top 23 Java Spark Hadoop Open Source Projects

Open source projects categorized as Java Spark Hadoop

Categories > Data Processing > Hadoop

Categories > Programming Languages > Java

Categories > Data Processing > Spark

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46most recent commit 3 months ago

Bigdata Notes ⭐ 14,872

大数据入门指南 ⭐

most recent commit 3 months ago

Deeplearning4j ⭐ 13,397

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.

dependent packages 119total releases 54most recent commit 25 days ago

It_book ⭐ 8,543

本项目收藏这些年来看过或者听过的一些不错的常用的上千本书籍，没准你想找的书就在这里呢，包含了互联网行

most recent commit 2 years ago

God Of Bigdata ⭐ 8,483

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive.

most recent commit 8 months ago

H2o 3 ⭐ 6,618

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

dependent packages 33total releases 49most recent commit 3 months ago

Dataspherestudio ⭐ 2,860

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

dependent packages 39total releases 7most recent commit 3 months ago

Bigdataguide ⭐ 2,355

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

most recent commit 4 months ago

Elasticsearch Hadoop ⭐ 1,914

🐘 Elasticsearch real-time search and analytics natively integrated with Hadoop

dependent packages 15total releases 295most recent commit 3 months ago

Gaffer ⭐ 1,724

A large-scale entity and relation database supporting aggregation of properties

dependent packages 31total releases 101most recent commit 3 months ago

Movie_recommend ⭐ 1,441

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

most recent commit 5 years ago

Carbondata ⭐ 1,401

High performance data store solution

total releases 1most recent commit 4 months ago

Dr Elephant ⭐ 1,301

Dr. Elephant is a job and flow-level performance monitoring and tuning tool for Apache Hadoop and Apache Spark

most recent commit a year ago

Taier ⭐ 1,220

Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display

total releases 2most recent commit 3 months ago

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

dependent packages 15total releases 10most recent commit a year ago

Data Algorithms Book ⭐ 973

MapReduce, Spark, Java, and Scala for Data Algorithms Book

most recent commit 2 years ago

Coding Now ⭐ 925

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、

most recent commit 2 years ago

Livy is an open source REST interface for interacting with Apache Spark from anywhere

dependent packages 5total releases 4most recent commit 4 years ago

Hadoop_study ⭐ 817

定期更新Hadoop生态圈中常用大数据组件文档重心依次为: Flink Solr Sparksql ES Scala Kafka Hbase/phoenix Redis Kerberos (项目包含hadoop思维导图印象笔记 Scala版本简单demo 常用工具类去敏后的train code 持续更新!!!)

most recent commit 2 years ago

Useractionanalyzeplatform ⭐ 810

电商用户行为分析大数据平台

most recent commit a year ago

An open source framework for building data analytic applications.

dependent packages 56total releases 23most recent commit 3 months ago

Marmaray ⭐ 444

Generic Data Ingestion & Dispersal Library for Hadoop

most recent commit 2 years ago

Iceberg ⭐ 409

Iceberg is a table format for large, slow-moving tabular data

most recent commit 3 years ago

The 10 Most Depended On Java Spark Hadoop Open Source Projects

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

dependent packages 939total releases 46latest release May 09, 2021most recent commit 3 months ago

Deeplearning4j ⭐ 13,397

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.

dependent packages 119total releases 54latest release August 10, 2022most recent commit 25 days ago

An open source framework for building data analytic applications.

dependent packages 56total releases 23latest release September 01, 2023most recent commit 3 months ago

Dataspherestudio ⭐ 2,860

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

dependent packages 39total releases 7latest release August 07, 2023most recent commit 3 months ago

Logisland ⭐ 106

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

dependent packages 34total releases 12latest release January 24, 2023most recent commit a year ago

H2o 3 ⭐ 6,618

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

dependent packages 33total releases 49latest release August 09, 2023most recent commit 3 months ago

Gaffer ⭐ 1,724

A large-scale entity and relation database supporting aggregation of properties

dependent packages 31total releases 101latest release November 14, 2023most recent commit 3 months ago

Elasticsearch Hadoop ⭐ 1,914

:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop

dependent packages 15total releases 295latest release November 11, 2023most recent commit 3 months ago

Kylo is a data lake management software platform and framework for enabling scalable enterprise-class data lakes on big data technologies such as Teradata, Apache Spark and/or Hadoop. Kylo is licensed under Apache 2.0. Contributed by Teradata Inc.

dependent packages 15total releases 10latest release December 05, 2018most recent commit a year ago

This repository is ReadOnly now. please go to https://github.com/apache/incubator-iotdb

dependent packages 14total releases 26latest release October 11, 2023most recent commit 5 years ago

The 10 Latest Releases In Java Spark Hadoop Open Source Projects

Gaffer ⭐ 1,724

A large-scale entity and relation database supporting aggregation of properties

dependent packages 31total releases 101latest release November 14, 2023most recent commit 3 months ago

Elasticsearch Hadoop ⭐ 1,914

:elephant: Elasticsearch real-time search and analytics natively integrated with Hadoop

dependent packages 15total releases 295latest release November 11, 2023most recent commit 3 months ago

This repository is ReadOnly now. please go to https://github.com/apache/incubator-iotdb

dependent packages 14total releases 26latest release October 11, 2023most recent commit 5 years ago

Incubator Wayang ⭐ 162

Apache Wayang(incubating) is the first cross-platform data processing system.

dependent packages 13total releases 2latest release September 03, 2023most recent commit 3 months ago

An open source framework for building data analytic applications.

dependent packages 56total releases 23latest release September 01, 2023most recent commit 3 months ago

H2o 3 ⭐ 6,618

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

dependent packages 33total releases 49latest release August 09, 2023most recent commit 3 months ago

Dataspherestudio ⭐ 2,860

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

dependent packages 39total releases 7latest release August 07, 2023most recent commit 3 months ago

Logisland ⭐ 106

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

dependent packages 34total releases 12latest release January 24, 2023most recent commit a year ago

Deeplearning4j ⭐ 13,397

Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.

dependent packages 119total releases 54latest release August 10, 2022most recent commit 25 days ago

Taier ⭐ 1,220

Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display

total releases 2latest release February 25, 2022most recent commit 3 months ago

Popular Data Processing Categories

Jupyter Notebook

Categories

Application Programming Interfaces

Artificial Intelligence

Cloud Computing

Command Line Interface

Computer Science

Configuration Management

Content Management

Data Processing

Integrated Development Environments

Learning Resources

Lists Of Projects

Machine Learning

Operating Systems

Package Managers

Programming Languages

Runtime Environments

Software Architecture

Software Development

Software Performance

Software Quality

Text Processing

User Interface Components

Version Control

Web User Interface

Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source. All rights reserved.