Awesome Open Source

Programming Languages

Search results for java spark

650 search results found

Whylogs Java ⭐ 179

Profile and monitor your ML data pipeline end-to-end

Spark Kafka Writer ⭐ 177

Write your Spark data to Kafka seamlessly

Zipkin Dependencies ⭐ 173

Spark job that aggregates zipkin spans for use in the UI

Kafka Book ⭐ 167

《Kafka技术内幕》代码

DistML provide a supplement to mllib to support model-parallel on Spark

Incubator Wayang ⭐ 162

Apache Wayang(incubating) is the first cross-platform data processing system.

Dcos Commons ⭐ 162

DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.

Distributed DataFrame: Productivity = Power x Simplicity For Scientists & Engineers, on any Data Engine

Spark Pac4j ⭐ 159

Security library for Sparkjava: OAuth, CAS, SAML, OpenID Connect, LDAP, JWT...

Bigdata In Practice ⭐ 154

大数据实践项目 Hadoop、Spark、Kafka、Hbase、Flink.....

Spark Extension ⭐ 152

A library that provides useful extensions to Apache Spark and PySpark.

Lambda Arch ⭐ 151

A full big data pipeline (Lambda Architecture) with Spark, Kafka, HDFS and Cassandra.

Crucible ⭐ 151

Crucible is a Thermos fork containing various patches for bug fixes and performance improvements. Join our discord to stay updated with the project development.

Batch Processing Gateway ⭐ 148

The gateway component to make Spark on K8s much easier for Spark users.

Csdn Code ⭐ 138

停止维护 -->移步 https://github.com/vbay/tutorials

Logvision ⭐ 136

分布式实时日志分析与入侵检测系统

Bigdata Learning ⭐ 136

大数据学习记录

Distributed Graph Analytics ⭐ 135

Distributed Graph Analytics (DGA) is a compendium of graph analytics written for Bulk-Synchronous-Parallel (BSP) processing frameworks such as Giraph and GraphX. The analytics included are High Betweenness Set Extraction, Weakly Connected Components, Page Rank, Leaf Compression, and Louvain Modularity.

Envelope ⭐ 133

Build configuration-driven ETL pipelines on Apache Spark

A distributed scheduling framework supporting DAG workflow for big data and regular jobs, providing programmable job types across different languages.

Studyspark ⭐ 129

学习 Spark 的一个小项目，以及其中各种调优的笔记

Shuttle ⭐ 123

Shuttle：High Available, High Performance Remote Shuffle Service

Iot Traffic Monitor ⭐ 123

Aliyun Emapreduce Demo ⭐ 123

Java_learning_practice ⭐ 118

java 进阶之路：面试高频算法、akka、多线程、NIO、Netty、SpringBoot、Spark&&F 等

Java library for distributed zero knowledge proof systems

Hanshu Note ⭐ 116

所有的学习笔记都在这里了，地主家也没有余粮了。

Spark Terasort ⭐ 116

Xichuan_note ⭐ 114

xichuan的学习总结笔记,覆盖了java、spring、java其他常用框架,以及大数据相关组件

Asakusafw ⭐ 113

Asakusa Framework

Spark Streaming监控平台，支持任务部署与告警、自启动

Spark Dependencies ⭐ 112

Spark job for dependency links

Spring Shiro Spark ⭐ 112

Spring-Shiro-Spark是Spring-Boot Hibernate Spark Spark-SQL Shiro iView VueJs... ...的集成尝试

Explore, transform, and analyze FHIR data with Apache Spark

Spark Ts Examples ⭐ 110

Spark TS Examples

Spark Website ⭐ 109

Apache Spark Website

Logisland ⭐ 106

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Spark Basic Structure ⭐ 103

Example of one possible way of structuring a Spark application

Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm

Kafka Spark Streaming Example ⭐ 96

Simple examle for Spark Streaming over Kafka topic

Flight Spark Source ⭐ 94

Mongo Spark ⭐ 93

Example application on how to use mongo-hadoop connector with Spark

Spark Jobs Rest Client ⭐ 91

Fluent client for interacting with Spark Standalone Mode's Rest API for submitting, killing and monitoring the state of jobs.

Android App ⭐ 90

Spark Android App

A Linux based software package to control led's on Logitech G910, G810, G610 and G410.

Genomicsdb ⭐ 88

High performance data storage for importing, querying and transforming variants.

基于JavaScript Engine的轻量级规则引擎系统，重构于开源IOT项目thingboard

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Pig on Apache Spark

Spark Llap ⭐ 82

Minitwit ⭐ 82

Based on Flask's MiniTwit example and written in Java with the Spark web framework, Spring, and HSQLDB

Cc Index Table ⭐ 78

Index Common Crawl archives in tabular format

Docker Spark ⭐ 77

🚢 Docker image for Apache Spark

Reference implementations of data-intensive algorithms in MapReduce and Spark

Cassandra Count ⭐ 73

Count rows in Cassandra Table

Simplesparkapp ⭐ 73

Simple Spark Application

The Apache Ignite Book ⭐ 72

All code samples, scripts and more in-depth examples for The Apache Ignite Book. Include Apache Ignite 2.6 or above

本项目已废弃，笔记收藏整理参考：

Kafka_spark_hbase_demo ⭐ 72

kafka spark hbase 日志统计

REST API for Apache Spark on K8S or YARN

Open Source algorithmic trading platform in Java / Python

Pathling ⭐ 71

Tools that make it easier to use FHIR® and clinical terminology within data analytics, built on Apache Spark.

Sparkapps ⭐ 70

Apache Spark applications

Spark_als ⭐ 68

基于spark-ml,spark-mllib,spark-streaming的推荐算法实现

Splittablegzip ⭐ 66

Splittable Gzip codec for Hadoop

Lpa Detector ⭐ 65

Optimize and improve the Label propagation algorithm

Sparklingml ⭐ 65

Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)

Doris Spark Connector ⭐ 64

Spark Connector for Apache Doris

Rce Over Spark ⭐ 64

Remote Command Execution Over Spark

Net.jgp.labs.spark ⭐ 63

Apache Spark examples exclusively in Java

Net.jgp.books.spark.ch01 ⭐ 61

Spark in Action, 2nd edition - chapter 1 - Introduction

Example code for the Wiley book "Machine Learning - Hands On for Developers and Technical Professionals"

A temporary home for LinkedIn's changes to Apache Iceberg (incubating)

Blogservice_sparkexample ⭐ 59

A simple application described in a post on the Spark framework

Spark Xml Utils ⭐ 59

Token Dispenser ⭐ 56

Stores email-password pairs, gives out Google Play Store tokens

Geosparktemplateproject ⭐ 55

Template projects for GeoSpark, GeoSpark-SQL, GeoSpark-Viz

Data Stream Development With Apache Spark Kafka And Spring Boot ⭐ 54

Data Stream Development with Apache Spark, Kafka and Spring Boot by Packt Publishing

Webex Java Sdk ⭐ 54

Java library for consuming RESTful APIs for Cisco Spark

Kotlin Spark Demo ⭐ 54

Kotlin / Spark Sample

A collection of online books for data science, computer science and coding!

Spark Docker ⭐ 53

Official Dockerfile for Apache Spark

Bestconf ⭐ 53

A tool automatically improving the performance of large-scale systems by finding better configuration settings

Spark Compaction ⭐ 52

File compaction tool that runs on top of the Spark framework.

Tablasco ⭐ 52

Tablasco is a JUnit rule for comparing tables and Spark module for comparing large data sets

This repository is ReadOnly now. please go to https://github.com/apache/incubator-iotdb

Atlas Checks ⭐ 51

OSM data integrity checks with Atlas

Hadoop Training ⭐ 50

Hadoop training material from free MapR courses.

Uberscriptquery ⭐ 50

UberScriptQuery, a SQL-like DSL to make writing Spark jobs super easy

Machine learning around business processes

A compiler for automatically re-targeting sequential Java code to Apache Spark.

Java_love_go ⭐ 46

专注Java与Golang！！！Java基础、Java Core、JVM、Spring大家族、Golang语言、各种中间件（如rabbitmq、netty、

Sagemaker Sparkml Serving Container ⭐ 46

This code is used to build & run a Docker container for performing predictions against a Spark ML Pipeline.

Sparkudfexamples ⭐ 46

Spark SQL UDF examples

Zemberek Nlp Server ⭐ 46

Zemberek Türkçe NLP Java Kütüphanesi üzerine REST Docker Sunucu

Spark In MapReduce (SIMR) - launching Spark applications on existing Hadoop MapReduce infrastructure

Sparkjobserverclient ⭐ 45

Java Client of the Spark Job Server implementing the arranged Rest APIs

Learnbasicbigdatatech ⭐ 44

🚀Some projects on Big Data Analysis like Spark, Hive, Presto and Data Visualization like Superset

Related Searches

Java Spring (21,350)

Java Spring Boot (11,982)

Java Video Game (8,093)

Java Gradle (8,072)

Java Docker (6,180)

Java Sdk (5,864)

Java Rest (4,956)

Java Algorithms (4,737)

Javascript Java (4,659)

Java Mysql (4,593)

101-200 of 650 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.