Awesome Open Source

Programming Languages

Search results for java hdfs

279 search results found

Datatear ⭐ 25

Split into data blocks,In this format, efficient reading can be realized,Avoid unnecessary data reading operations.

Oci Hdfs Connector ⭐ 24

HDFS Connector for Oracle Cloud Infrastructure

Csv To Orc ⭐ 24

Convert a CSV fle to ORCFile

Cobol To Hive ⭐ 24

Serde for Cobol Layout to Hive table

Real_time_social_media_mining ⭐ 24

DevOps pipeline for Real Time Social/Web Mining

Heterogeneity-incorporating Workflow ApplicationMaster for YARN

Navigator Sdk ⭐ 23

Scriptable scheduler for periodical Hadoop workflows

Neo4j Graphx ⭐ 23

Similar to Shifu - Neo4j-GraphX extends Neo4j graph database to process big data graph algorithms with HDFS and Apache Spark on a scalable data set

Architect Java ⭐ 23

java后端架构师技术图谱

Volume Balancer ⭐ 23

DataNode Volumes Rebalancing tool for Apache Hadoop HDFS (HDFS-1312)

Scaling Hdfs Namenode ⭐ 23

NEW: see http://www.hops.io/. OLD: This work aims to re-engineer the Hadoop Distributed File System (HDFS) so that it can be 1) highly available, and 2) horizontally scalable. This is achieved by replacing the central master server with a distributed real-time database (in our implementation, MySQL Cluster).

Document_search_engine_architecture ⭐ 22

📄🚀 Unleash a powerful Document Search Engine with Apache NiFi for lightning-fast, comprehensive text indexing and search.

Backup Hadoop And Hive ⭐ 22

Bigdata Tutorial ⭐ 22

A testing framework for Trino

⛺ blog by Vuepress

Storm Kafka Examples ⭐ 21

storm kafka hdfs examples

Xlearning Gpu ⭐ 21

qihoo360 xlearning with GPU support; AI on Hadoop

Hdfs Inotify Example ⭐ 21

HDFS inotify Example

Bigdata_platform ⭐ 20

大数据建模分析平台

Hdfsutils ⭐ 19

hdfs文件治理工具，文件批量解压、压缩、小文件合并

Npedetector ⭐ 19

Finding the potential null pointer exception

Collector ⭐ 19

HDFS endpoint collecting and aggregating data flows

Informationextraction ⭐ 19

Yarn Proto ⭐ 18

Solr on YARN prototype

Data Pipeline Project ⭐ 18

Data pipeline project

HA, fault-tolerant, non-intrusive INotify for Hadoop HDFS

Spark Notes ⭐ 18

Note anything during writing spark or scala

Kube2hadoop ⭐ 17

Secure HDFS Access from Kubernetes

Ruby Hdfs ⭐ 17

Native Ruby bindings to Hadoop's libhdfs, for interacting with Hadoop DFS.

Mapreduce Knn ⭐ 17

(java) K nearest neighbour implementation for Hadoop MapReduce

Big Data Application Firewall

Pyramidio ⭐ 17

Image pyramid reader and writer

Hadoop Etl Udfs ⭐ 17

The Hadoop ETL UDFs are the main way to load data from Hadoop into EXASOL

Httpfs Client ⭐ 17

httpfs java client, read & write hdfs filesystem with the webhdfs REST HTTP API

Datax Src ⭐ 16

DataX 是异构数据广泛使用的离线数据同步工具/平台，实现包括 MySQL、Oracle、SqlServer、Postgre、HDFS、Hive、ADS、HBase 等各种异构数据源之间高效的数据同步功能。

Hadoop In A Box ⭐ 16

An all-in-one Hadoop suite and REPL for both interactive development and learning

Hdfstree ⭐ 16

A command line tool to display HDFS directories as a tree.

Hdfsblockfinder ⭐ 16

Allows you to see where(datanodes) that contain a file in HDFS

Hdfschecksumforlocalfile ⭐ 16

This program / jar creates checksum, with same algorithm that hadoop uses to create on hdfs files. So integrity of file can be verified on local and hadoop system. Can also, be used to check if file exist based on checksum, before uploading and cluttering hdfs with duplicate files.

Aerospike Hadoop ⭐ 16

Aerospike Hadoop Connector

Huahin Manager ⭐ 15

Simple Management System for Hadoop MapReduce Job

Phonecloud Java ⭐ 15

毕业设计-基于HBase实现的手机数据备份系统，实现了手机关键信息的备份，如短信、联系人、重要文件等

Storm State ⭐ 15

小白大数据学习笔记 ⭐

Minispark ⭐ 15

Java implementation of a mini Spark-like framework named MiniSpark that can run on top of a HDFS cluster. MiniSpark supports operators including Map, FlatMap, MapPair, Reduce, ReduceByKey, Collect, Count, Parallelize, Join and Filter.

Eshadoop ⭐ 15

Packt Publication - "Elasticsearch for Hadoop" Book Source Code

Avrocount ⭐ 15

Count records in Avro files efficiently

A Big Data Platform Prototype Project

Quootstrap ⭐ 14

Unsupervised method for extracting quotation-speaker pairs from large news corpora.

Copybookinputformat ⭐ 14

Using JRecord to build a mapred and mapreduce inputformat for HDFS, MAPREDUCE, PIG, HIVE, Spark, ...

Hadoop_tutorial ⭐ 14

Bi_project ⭐ 14

一个简单的Hive项目，使用了Sqoop、Hadoop、Hive、MySQL，对电商数据进行分析

Marayarn ⭐ 13

Marathon on yarn

Hdfs Mesos ⭐ 13

Apache Hadoop HDFS Data Node Scheduler

Hdfs Checksum ⭐ 13

Utility to calculate hadoop checksum for local file, plain old Vanilla checksum for hdfs file, and block-level-checksums for hdfs file

Hadoop_example ⭐ 13

Hadoop基本操作，包括pagerank、kmeans、join、max_temperature、

Matrixmultiply ⭐ 13

Sparse matrix multiplication for hadoop

Cloudera Framework ⭐ 12

Publications Ssnmm ⭐ 12

Experiments for the publication 'Scalable Similarity-Based Neighborhood Methods with MapReduce' at the ACM Recommender Systems Conference 2012

Spring Boot Spark Integration Demo ⭐ 12

Demo on how to integrate Spring Data JPA, Apache Spark and GraphX with Java and Scala mixed codes

Camus Compressor ⭐ 12

Camus Compressor merges files created by Camus and saves them in a compressed format.

Kafka Connect Hdfs Ext ⭐ 12

Set of extensions for kafka connect hdfs

Kafka Hadoop Loader My ⭐ 11

kafka0.8.2 using simple consumer load message into hdfs using custom mapreduce

Graylog Plugin Output Webhdfs ⭐ 11

WebHDFS Output plugin for Graylog

Archived Data Bus ⭐ 11

Mucommander ⭐ 11

Supports any HDFS version, Quantcast QFS

Spark Tpcds Benchmark ⭐ 11

Utility for benchmarking changes in Spark using TPC-DS workloads

Parquetplugin ⭐ 11

Youtube Data Analysis ⭐ 11

This project implements Hadoop MapReduce algorithm on the YouTube data and display the result on a web server.

Kafka Connect Field And Time Partitioner ⭐ 11

Kafka Connect Store Partitioner by custom fields and time

Scribengin ⭐ 11

HA Distributed System to transactionally move data from Sources (eg Kafka) to Sinks ( eg Hadoop HDFS )

Avro Flume Hive Example ⭐ 11

Hdfs To Ftp ⭐ 11

a tool help copy files from hdfs direct to ftp server

Bigdataguide ⭐ 11

秋招自学上岸，自学太难了，想总结一份详细的大数据开发资料，包括基础 | 架构 | 源码，让更多自学的伙伴少走弯路。有相关问题可以添加公众号：大数据老刘，联系老刘！

Content Data Store (HDFS/HBase)

Hio_test ⭐ 10

Druid Hadoop Utils ⭐ 10

Read druid segments from hadoop

Flink Tools ⭐ 10

A collection of Flink applications for working with Pravega streams

Streamsx.hdfs ⭐ 9

This toolkit provides operators and functions for interacting with Hadoop File System.

Over Bigdata ⭐ 9

大数据笔记：[进度01% ]Hadoop、Spark、Hbase、Flink等

Demo related artifacts/datasets for PXF

Hadoop Training Samples ⭐ 9

Sample code that I use for giving basic training on Hadoop HDFS and MapReduce

Melody Join ⭐ 9

Earth Mover's Distance based Similarity Join on Hadoop

Kafka Hadoop Consumer ⭐ 9

Send kafka message to hdfs using api not mapreduce

Yarn Starter ⭐ 9

Starter examples to writes distributed fault-tolerant YARN applications

Algorithm Implementation Using Map Reduce ⭐ 8

Page Rank, Inverted Index and Matrix Multiplication

Ingestion Ws Kafka Hdfs ⭐ 8

Example of ingestion pipeline realizing flow: WebSocket -> Kafka -> HDFS

Chlorine Hadoop ⭐ 8

Mapreduce program to detect and mask sensitive data in Hadoop

Distributed linear algebra operations using Apache Spark

Hdfsclient ⭐ 8

A Java Hdfs client example and full Kerberos example for call hadoop commands directly in java code or on your local machine.

Java Study ⭐ 8

JAVA相关技术实现，文件流操作，常用的设计模式，数据结构实现，算法应用和案例，JAVA8一些新特性 API用法），一致性hash算法代码实现，ELK集成，Hadoop HDFS实现等

Streamsx.sparkmllib ⭐ 8

Toolkit for real-time scoring using Apache Spark MLLib library

Cascading.accumulo ⭐ 8

High Betweenness Set Extraction ⭐ 8

Approximate Betweenness Centrality computation for big graph data.

Related Searches

Java Docker (6,180)

Java Database (6,015)

Java Mysql (5,954)

Java Sdk (5,864)

Java Apache (4,283)

Java Json (3,692)

Java Command Line (3,457)

Python Java (3,215)

Java Jdbc (2,549)

Java Hadoop (2,117)

101-200 of 279 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.