Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About

The Top 23 Spark Hadoop Open Source Projects

Open source projects categorized as Spark Hadoop
Distributed Statistical Computing ⭐ 99
Teaching Materials for Distributed Statistical Computing (大数据分布式计算教学材料)
most recent commit 5 months ago
Ros_hadoop ⭐ 98
Hadoop splittable InputFormat for ROS. Process rosbag with Hadoop Spark and other HDFS compatible systems.
most recent commit 3 years ago
Spark With Python ⭐ 98
Fundamentals of Spark with Python (using PySpark), code examples
most recent commit 4 years ago
Mongo Spark ⭐ 93
Example application on how to use mongo-hadoop connector with Spark
most recent commit 10 years ago
Flink Spark Submiter ⭐ 92
从本地IDEA提交Flink/Spark任务到Yarn/k8s集群
most recent commit 3 years ago
Correlation Approximation ⭐ 90
Spark implementation of the Google Correlate algorithm to quickly find highly correlated vectors in huge datasets
most recent commit 8 years ago
Focusbigdata ⭐ 89
【大数据成神之路学习路径+面经+简历】
most recent commit 2 years ago
Druid Spark Batch ⭐ 89
Druid indexing plugin for using Spark in batch jobs
most recent commit 5 years ago
Smart Data Lake ⭐ 87
Smart Automation Tool for building modern Data Lakes and Data Pipelines
dependent packages 8total releases 26most recent commit 3 months ago
Guacamole ⭐ 86
Spark-based variant calling, with experimental support for multi-sample somatic calling (including RNA) and local assembly
total releases 1most recent commit 6 years ago
Flowman ⭐ 85
Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pipelines.
dependent packages 24total releases 65most recent commit 5 months ago
Scalding Example Project ⭐ 85
The Scalding WordCountJob example as a standalone SBT project with Specs2 tests, runnable on Amazon EMR
most recent commit 10 years ago
Spork ⭐ 84
Pig on Apache Spark
most recent commit 9 years ago
Dlflow ⭐ 84
DLFlow is a deep learning framework.
most recent commit 4 years ago
Caochong ⭐ 80
Set up a Hadoop and/or Spark cluster running within Docker containers on a single physical machine
most recent commit 4 years ago
Hadoop_cookbook ⭐ 80
Cookbook to install Hadoop 2.0+ using Chef
most recent commit a year ago
Vagrant Hadoop 2.4.1 Spark 1.0.1 ⭐ 79
Vagrant project to spin up a cluster virtual machines with Hadoop v2.4.1 and Spark v1.0.1
most recent commit 9 years ago
Docker Spark ⭐ 77
🚢 Docker image for Apache Spark
most recent commit 4 years ago
Cqu_bigdata ⭐ 77
重庆大学计算机学院“大数据课程群”实验及PPT
most recent commit a year ago
Resilient Ml Research Platform ⭐ 76
most recent commit 2 years ago
Waimak ⭐ 73
Waimak is an open-source framework that makes it easier to create complex data flows in Apache Spark.
dependent packages 1total releases 31most recent commit a year ago
The Apache Ignite Book ⭐ 72
All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above
most recent commit 5 months ago
Kafka_spark_hbase_demo ⭐ 72
kafka spark hbase 日志统计
most recent commit 7 years ago
Popular Data Processing Categories
Jupyter Notebook
Dataset
Sql
Validation
Pipeline
Translation
Data Science
Classification
Transaction
Scraper
Categories
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2024 Awesome Open Source.  All rights reserved.