Awesome Open Source

Programming Languages

Search results for java mapreduce

243 search results found

Redisson ⭐ 22,647

Redisson - Easy Redis Java client with features of In-Memory Data Grid. Sync/Async/RxJava/Reactive API. Over 50 Redis based Java objects and services: Set, Multimap, SortedSet, Map, List, Queue, Deque, Semaphore, Lock, AtomicLong, Map Reduce, Bloom filter, Spring Cache, Tomcat, Scheduler, JCache API, Hibernate, RPC, local cache ...

Bigdata Notes ⭐ 14,872

大数据入门指南 ⭐

Powerjob ⭐ 6,249

Enterprise job scheduling middleware with distributed computing ability.

Mongo Hadoop ⭐ 1,511

MongoDB Connector for Hadoop

Data Algorithms Book ⭐ 973

MapReduce, Spark, Java, and Scala for Data Algorithms Book

An open source framework for building data analytic applications.

Elephantdb ⭐ 540

Distributed database specialized in exporting key/value data from Hadoop

Bigdata ⭐ 358

💎🔥大数据学习笔记

Cascading ⭐ 337

Cascading is a feature rich API for defining and executing complex and fault tolerant data processing flows locally or on a cluster.

Incubator Uniffle ⭐ 332

Uniffle is a high performance, general purpose Remote Shuffle Service.

Compass ⭐ 284

Compass is a task diagnosis platform for bigdata

Behemoth ⭐ 284

Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.

Firestorm ⭐ 240

Firestorm is a Remote Shuffle Service, and provides the capability for Apache Spark and Apache Hadoop MapReduce applications to store shuffle data on remote servers

Commoncrawl Crawler ⭐ 208

The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)

Hadoop Pcap ⭐ 202

Hadoop library to read packet capture (PCAP) files

Wonderdog ⭐ 193

Bulk loading for elastic search

Sharding Method ⭐ 169

分表分库的新思路——服务层Sharding框架，全SQL、全数据库兼容，ACID特性与原生数据库一致

Terrapin ⭐ 168

Serving system for batch generated data sets

Bigdata In Practice ⭐ 154

大数据实践项目 Hadoop、Spark、Kafka、Hbase、Flink.....

Scalable Topic Modeling using Variational Inference in MapReduce

Spatialhadoop2 ⭐ 148

The second generation of SpatialHadoop that ships as an extension

Hadoopdemo ⭐ 128

Hadoop简单应用案例，包括MapReduce、单词统计、HDFS基本操作、web日志分析、Zoo

HIPI: Hadoop Image Processing Interface

Ctenopharyngodon Idella ⭐ 125

Hadoop, MapReduce Distributed Crawling of Data Information from All Chinese Universities. （Hadoop,mapreduce分布式爬取掌上高考的所有中国大学数据）

Aliyun Emapreduce Demo ⭐ 123

Sequenceiq Samples ⭐ 119

SequenceIQ Hadoop examples

Hackathon ⭐ 114

Library and resources for hack/reduce Hackathon events

Asakusafw ⭐ 113

Asakusa Framework

The Apache Gora open source framework provides an in-memory data model and persistence for big data.

Avro Hadoop Starter ⭐ 111

Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.

Dynamometer ⭐ 110

A tool for scale and performance testing of HDFS with a specific focus on the NameNode.

Introtohadoopandmr__udacity_course ⭐ 103

🐘 Source code for assignments of Udacity course "Introduction to Hadoop and MapReduce"

Profiler for large-scale distributed java applications (Spark, Scalding, MapReduce, Hive,...) on YARN.

Mirror of Apache Crunch (Incubating)

A Simple and Efficient Distributed Multidimensional BI Analysis Engine.

Mapreduce ⭐ 83

MapReduce by examples

Mirror of Apache Chukwa

Reference implementations of data-intensive algorithms in MapReduce and Spark

Hbase Orm ⭐ 72

A production-grade HBase ORM library that makes accessing HBase clean, fast and fun (Can also be used as Bigtable ORM)

An iterative computing framework for both Hadoop MapReduce and Hadoop YARN.

Hadoop Map Reduce Patterns ⭐ 71

Hadoop Map-Reduce Design Patterns

Hadoop Bam ⭐ 66

Hadoop-BAM is a Java library for the manipulation of files in common bioinformatics formats using the Hadoop MapReduce framework

Hadoop Java Example ⭐ 66

A very simple example of using Hadoop's MapReduce functionality in Java.

K-Means Clustering using MapReduce

Hive Io Experimental ⭐ 62

Hive I/O Library

:octocat:This is a learning note | Java基础，JVM，源码，大数据，面经

Odps_book ⭐ 54

source code for my book on odps

Clickhouse Hdfs Loader ⭐ 54

loading hdfs data to clickhouse

Mlhadoop ⭐ 53

This repository contains Machine-Learning MapReduce codes for Hadoop which are written from scratch (without using any package or library). E.g. Prediction (Linear and Logistic Regression), Clustering (K-Means), Classification (KNN) etc.

Mapreduce Demo ⭐ 53

Hadoop，MapReduce编程学习练手实例

Json Mapreduce ⭐ 48

InputFormat that can split multi-line JSON

Hadoop Sstable ⭐ 47

Splittable Input Format for Reading Cassandra SSTables Directly

A Hanborq optimized Hadoop Distribution, especially with high performance of MapReduce. It's the core part of HDH (Hanborq Distribution with Hadoop for Big Data Engineering).

Spark In MapReduce (SIMR) - launching Spark applications on existing Hadoop MapReduce infrastructure

An open source pcap packet and NetFlow file analysis tool using Hadoop MapReduce and Hive.

A compiler and runtime for Google's Sawzall language, optimized for Hadoop

Pattern Matching ⭐ 39

Hadoop MapReduce over Hive based implementation of attributed network pattern matching.

Csds Material ⭐ 38

Course material for the Computer Systems for Data Science class at Columbia

Unoexample ⭐ 38

MapReduce/Hadoop example that uses regular playing cards to show mapping and reducing.

163 Bigdate Note ⭐ 38

Intellij Hadoop ⭐ 35

Run Hadoop program using Intellij

Cc Warc Examples ⭐ 35

CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop

Kassandramrhelper ⭐ 35

Library for processing Cassandra SSTables with Hadoop MapReduce.

Combining datasets with MapReduce on NFL play by play data.

Accumulo Examples ⭐ 34

Apache Accumulo Examples

Cc Helloworld ⭐ 33

CommonCrawl Hello World example

Avro2parquet ⭐ 33

Hadoop MapReduce tool to convert Avro data files to Parquet format.

Mossrose ⭐ 32

Light Distributed Job Framework

Marklogic Contentpump ⭐ 32

MarkLogic Contentpump (mlcp)

Bigfatlm ⭐ 30

Hadoop MapReduce training of modified Kneser-Ney smoothed language models

Emr S3 Io ⭐ 29

Hadoop IO for Amazon S3

Mongoreduce ⭐ 29

Hadoop Input and Ouput formats for MongoDB

Hive Mr3 ⭐ 29

Cloudsimex ⭐ 28

A set of extensions for the CloudSim simulator

Mongo Deep Mapreduce ⭐ 28

Use Hadoop MapReduce directly on Mongo data

Nyyellowtaxiproject ⭐ 27

Big Data project using Hadoop (MapReduce, spark, Hive)

Sculptor ⭐ 26

Interview Refresher Java Bigdata ⭐ 26

a one-stop repo to lookup for code snippets of core java concepts, sql, data structures as well as big data. It also consists of interview questions asked in real-life.

Kiji Bento ⭐ 26

Kiji BentoBox: Developer SDK for Kiji including a standalone zero-configuration HBase micro-cluster

Flink Mongodb Test ⭐ 25

Flink 0.7 MongoDB example (for Hadoop2)

Maven Archetype Hadoop ⭐ 24

Provides a simple archetype to create MapReduce jobs with Maven.

Real_time_social_media_mining ⭐ 24

DevOps pipeline for Real Time Social/Web Mining

Azure Documentdb Hadoop ⭐ 22

Ffmpeg Mr ⭐ 22

MapReduce FFmpeg

Cascading.multitool ⭐ 21

Cascading.Multitool is a sed and grep command line tool for Apache Hadoop.

Hiveunit Mr2 ⭐ 21

A library to test Hive scripts with YARN and MR2

Zephyr is a big data, platform agnostic ETL API, with Hadoop MapReduce, Storm, and other big data bindings.

Book Examples ⭐ 21

Examples from Learning Hadoop 2 (Packt Publishing, 2015)

Hadoopcv ⭐ 21

HadoopCV Hadoop,Spark Reader Video!

Cdh Maven Archetype ⭐ 20

Cloudera Maven Archetypes

Spring Data Mongodb ⭐ 20

spring-data-mongodb 操作示例

Hadoop Binary Analysis ⭐ 20

Framework that makes processing arbitrary binary data in Hadoop easier

Bigdata Project ⭐ 19

Analyzing Uber Movement Dataset

Weatherpipe ⭐ 19

A MapReduce pipeline for the analysis of the NEXRAD data set in S3 - Purdue CS307 Project

Java library for running Serverless MapReduce jobs

Bigdata Practice ⭐ 18

🤘 常用大数据工具学习实战，包含Hadoop、HBase、Kafka、ClickHouse、Hive、R

Data Pipeline Project ⭐ 18

Data pipeline project

Twitter Sentimental Analysis ⭐ 17

Sentimental Analysis using LingPipe, Mogodb and MapReduce

Related Searches

Java Spring (21,929)

Java Spring Boot (11,982)

Java Video Game (8,093)

Java Gradle (8,072)

Java Docker (6,180)

Java Sdk (5,864)

Javascript Java (5,468)

Java Rest (4,956)

Java Mysql (4,593)

Java Algorithms (4,524)

1-100 of 243 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.