Awesome Open Source

Programming Languages

Search results for hadoop big data

100 search results found

Spark ⭐ 37,661

Apache Spark - A unified analytics engine for large-scale data processing

Data Science Ipython Notebooks ⭐ 25,668

Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

Bigdata Notes ⭐ 14,872

大数据入门指南 ⭐

Cookbook ⭐ 12,557

The Data Engineering Cookbook

Trino ⭐ 9,118

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

God Of Bigdata ⭐ 8,483

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive.

Ignite ⭐ 4,626

Calcite ⭐ 4,578

Bigdataguide ⭐ 2,355

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Drill ⭐ 1,856

Apache Drill is a distributed MPP query layer for self describing data

Gaffer ⭐ 1,724

A large-scale entity and relation database supporting aggregation of properties

Carbondata ⭐ 1,401

High performance data store solution

Bigdata Interview ⭐ 1,397

🎯 🌟[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop

Bigdata Growth ⭐ 1,256

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

Coding Now ⭐ 925

学习记录的一些笔记，以及所看得一些电子书eBooks、视频资源和平常收纳的一些自己认为比较好的博客、

Scalable, reliable, distributed storage system optimized for data analytics and object store workloads.

Mirror of Apache Sqoop

Mirror of Apache Oozie

Apache ORC - the smallest, fastest columnar storage for Hadoop workloads

Wedatasphere ⭐ 624

WeDataSphere is a financial grade, one-stop big data platform suite.

Mirror of Apache Giraph

Data Lineage Tracking And Visualization Solution

Bigtop is an Apache Foundation project for Infrastructure Engineers and Data Scientists looking for comprehensive packaging, testing, and configuration of the leading open source big data components.

Bigdata Ecosystem ⭐ 536

BigData Ecosystem Dataset

Kafka Connect Hdfs ⭐ 473

Kafka Connect HDFS connector

Stream computing platform for bigdata

Big_data_architect_skills ⭐ 353

一个大数据架构师应该掌握的技能

Cloudbreak ⭐ 348

CDP Public Cloud is an integrated analytics and data management platform deployed on cloud services. It offers broad data analytics and artificial intelligence functionality along with secure user access and data governance features.

Apex Core ⭐ 346

Mirror of Apache Apex core

Cloudeon ⭐ 345

CloudEon uses Kubernetes to install and deploy open-source big data components, enabling the containerized operation of an open-source big data platform. This allows you to reduce your focus on underlying resource management and maintenance.

Compass ⭐ 284

Compass is a task diagnosis platform for bigdata

Parquet4s ⭐ 267

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

Trafodion ⭐ 243

Apache Trafodion

Node Hbase ⭐ 232

Asynchronous HBase client for NodeJs using REST

Bigdata_docker ⭐ 226

Big Data Ecosystem Docker

Calcite Avatica ⭐ 225

Apache Calcite Avatica

Bigdata ⭐ 219

大数据处理相关技术学习之路(持续更新中...)。 Bigdata整理 --> 慢慢滴~ 大数据相关技术包括离线处理，实时处理，OLAP等，如hadoop、spark、flink、hive、

Sparkrdma ⭐ 191

RDMA accelerated, high-performance, scalable and efficient ShuffleManager plugin for Apache Spark

Bigdata Hub ⭐ 187

数据建设与大数据技术知识体系，包含hadoop、hive、spark、flink主流框架和系列框架，

Juicy Bigdata ⭐ 162

🎉🎉🐳 Datawhale大数据处理导论教程 | 大数据技术方向的开篇课程🎉🎉

Bigdata Playground ⭐ 154

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Bigdata ⭐ 142

hadoop,hbase,storm,spark,etc..

Eel Sdk ⭐ 140

Big Data Toolkit for the JVM

Bigdata Learning ⭐ 136

大数据学习记录

Hdfs Shell ⭐ 129

HDFS Shell is a HDFS manipulation tool to work with functions integrated in Hadoop DFS

Mirror of Apache Tajo

Xichuan_note ⭐ 114

xichuan的学习总结笔记,覆盖了java、spring、java其他常用框架,以及大数据相关组件

Asakusafw ⭐ 113

Asakusa Framework

The Apache Gora open source framework provides an in-memory data model and persistence for big data.

Calcite Avatica Go ⭐ 110

Mirror of Apache Calcite - Avatica Go SQL Driver

Logisland ⭐ 106

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Spark With Python ⭐ 98

Fundamentals of Spark with Python (using PySpark), code examples

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

Mirror of Apache REEF

Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pipelines.

Say "ni" to data of any size

本项目已废弃，笔记收藏整理参考：

The Apache Ignite Book ⭐ 72

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

Apache Spark Hands On ⭐ 64

Educational notes,Hands on problems w/ solutions for hadoop ecosystem

Incubator Tez ⭐ 60

Mirror of Apache Tez (Incubating)

Big_data ⭐ 55

Tutorials on Big Data essentials: Hadoop, MapReduce, Spark.

Bigdataparty ⭐ 54

大数据组件 All-in-One 的 Dockerfile

Doris Website ⭐ 51

Apache Doris Website

Datapipelines Essentials Python ⭐ 45

Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validation, Column extensions, SQL functions, and DataFrame transformations

Docker Spark Cluster ⭐ 44

A Spark cluster setup running on Docker containers

Docker Hadoop Workbench ⭐ 44

A Hadoop cluster based on Docker, including Hive and Spark.

Yuzhouwan ⭐ 42

Code Library for My Blog

Big Data ⭐ 37

Python tools for big data

Sparkdemo ⭐ 34

spark全示例代码(java、scala) Spark most full instance code DEMO (java、scala)

Ambari Metrics ⭐ 34

Apache Ambari Metrics is a sub project of Apache Ambari.

Awesome Tools ⭐ 32

curated list of awesome tools and libraries for specific domains

Bigdata Docker ⭐ 30

docker构建大数据开发学习环境

Learning Spark ⭐ 29

Tidy up Spark and Hadoop tutorials.

Documentation placeholder and utilities for all the other containers.

Enceladus ⭐ 28

Dynamic Conformance Engine

Bigdatas ⭐ 27

this is a db-hdfs tools used to transfer big database datas to hadoop hdfs like sqoop,but bboss bigdata tool is very nice monitor and event drivered model,and high perfermance,support Distributed executor tasks Ability.

Rzf.github.io ⭐ 27

✏️[计算机基础+java基础+大数据基础及进阶+面试指南] 一份涵盖计算机基础，java，大数据，面试宝典，大部分核心知识的项目，学习，面试，共同进步！

Clusterdock ⭐ 26

clusterdock is a framework for creating Docker-based container clusters

Doris Thirdparty ⭐ 26

Self-managed thirdparty dependencies for Apache Doris

Bigdata Docker ⭐ 26

Docker images for Open Source bigdata/hadoop projects

Twitter Sentiment Analysis Using Hadoop ⭐ 26

A Project where one can fetch and read tweets and show the analysis like who is most influential

Wifiprobe ⭐ 25

Commercial big-data analysis system based on WIFI probe

Bigdata Doc ⭐ 25

大数据学习笔记，学习路线，技术案例整理。

Movies Analytics In Spark And Scala ⭐ 24

Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Sparkucx ⭐ 23

A high-performance, scalable and efficient ShuffleManager plugin for Apache Spark, utilizing UCX communication layer

Learn Hadoop And Spark ⭐ 22

This repository focuses on gathering and making a curated list resources to learn Hadoop for FREE.

Incubator Tajo ⭐ 21

Mirror of Apache Tajo

Bigdata_platform ⭐ 20

大数据建模分析平台

Mmtf Spark ⭐ 19

Methods for the parallel and distributed analysis and mining of the Protein Data Bank using MMTF and Apache Spark.

Bigdatatutorial ⭐ 18

bigdatatutorial

Jun_bigdata ⭐ 18

jun_bigdata大数据平台服务框架。实现了Kafka实时数据过滤、清洗、转换、消费，实现了Sp SQL对Redis、MongoDB等非关系型数据库的数据的读写；集成了规则引擎，可基于规则引擎实现客

Information Inference Service of the OpenAIRE system

Javaframework ⭐ 18

Spring based Simple Java Framework, with JPA and mybatis or plus ORM supported(can use mix),dhtmlXSuite webui example web project,Hadoop resource access tool support most Hadoop file format,distributed etl process(in progress)

Bigdata Practice ⭐ 18

🤘 常用大数据工具学习实战，包含Hadoop、HBase、Kafka、ClickHouse、Hive、R

Qs Hadoop ⭐ 17

大数据生态圈学习

Hpg Bigdata ⭐ 17

This repository implements converters and tools for working with NGS data in HPC or Hadoop cluster

Awesome Big Data ⭐ 17

大数据&&分布式系统学习过程中一些经验总结

Related Searches

Java Hadoop (2,117)

Spark Hadoop (1,188)

Hadoop Hdfs (1,082)

Hadoop Mapreduce (851)

Shell Hadoop (772)

Python Hadoop (761)

Hadoop Hive (703)

Python Big Data (588)

Spark Big Data (570)

Java Big Data (533)

1-100 of 100 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2025 Awesome Open Source. All rights reserved.