Awesome Open Source

Programming Languages

Search results for scala streaming

282 search results found

Flink ⭐ 22,747

Akka ⭐ 12,864

Build highly concurrent, distributed, and resilient message-driven applications on the JVM

Snowplow ⭐ 6,677

The enterprise-grade behavioral data engine (web, mobile, server-side, webhooks), running cloud-natively on AWS and GCP

A Scala API for Apache Beam and Google Cloud Dataflow.

Awesome Streaming ⭐ 2,447

a curated list of awesome streaming frameworks, applications, etc

Summingbird ⭐ 2,117

Streaming MapReduce with Scalding and Storm

Akka Http ⭐ 1,333

The Streaming-first HTTP server/module of Akka

Killrweather ⭐ 1,174

KillrWeather is a reference application (work in progress) showing how to easily integrate streaming and batch data processing with Apache Spark Streaming, Apache Cassandra, Apache Kafka and Akka for fast, streaming computations on time series data in asynchronous event-driven environments.

Utils4s ⭐ 1,033

scala、spark使用过程中，各种测试用例以及相关资料整理

Stream Reactor ⭐ 960

A collection of open source Apache 2.0 Kafka Connector maintained by Lenses.io.

Spark Redis ⭐ 926

A connector for Spark that allows reading and writing to/from Redis cluster

Incubator Pekko ⭐ 898

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala

Gearpump ⭐ 758

Lightweight real-time big data streaming engine over Akka

Reference Apps ⭐ 615

Spark reference applications

Nussknacker ⭐ 564

Low-code tool for automating actions on real time data | Stream processing for the users.

Real Time Analytics and Data Pipelines based on Spark Streaming

Streamdm ⭐ 456

Stream Data Mining Library for Spark Streaming

Spark Scala Examples ⭐ 443

This project provides Apache Spark SQL, RDD, DataFrame and Dataset examples in Scala language

Spark Solr ⭐ 440

Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.

Akka Grpc ⭐ 427

Spark Training ⭐ 365

Apache Spark training material

Redis4cats ⭐ 325

🔖 Redis client built on top of Cats Effect, Fs2 and Lettuce

Mirror of Apache Bahir

Cloudflow ⭐ 323

Cloudflow enables users to quickly develop, orchestrate, and operate distributed streaming applications on Kubernetes.

Ping Play ⭐ 315

BigPipe streaming for the Play Framework

Scala Xml ⭐ 290

The standard Scala XML library

Fs2 Kafka ⭐ 280

Functional Kafka Streams for Scala

Twitter4s ⭐ 258

An asynchronous non-blocking Scala client for both the Twitter Rest and Streaming API

Quine • a streaming graph • https://quine.io • Slack: https://that.re/quine-slack

Sparkstreaming ⭐ 253

Spark Streaming+Flume+Kafka+HBase+Hadoop+Zookeeper实现实时日志

Zio Grpc ⭐ 247

ScalaPB meets ZIO: write purely functional gRPC services and clients using ZIO

Azure Event Hubs Spark ⭐ 225

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Example Spark ⭐ 197

Spark, Spark Streaming and Spark SQL unit testing strategies

Iteratee ⭐ 188

Iteratees for Cats

Fs2 Aws ⭐ 179

fs2 utilities to interact with AWS

Spark 2.3.1 ⭐ 174

Spark-2.3.1源码解读

Spark Streaming With Kafka ⭐ 161

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

Neotypes ⭐ 154

Scala lightweight, type-safe, asynchronous driver for neo4j

Spark Binlog ⭐ 153

A library for querying Binlog with Apache Spark structure streaming, for Spark SQL , DataFrames and [MLSQL](https://www.mlsql.tech).

Spark Structured Streaming Examples ⭐ 153

Spark Structured Streaming / Kafka / Cassandra / Elastic

Coral is a real-time analytics and data science platform. It transforms streaming events and extract patterns from data via RESTful APIs. Built on Scala, Akka, Cassandra and Spray.

Circe Fs2 ⭐ 149

Streaming JSON parsing and decoding with fs2

Fs2 Rabbit ⭐ 143

🐰 RabbitMQ stream-based client built on top of Fs2

Circe Yaml ⭐ 138

YAML parser for circe using SnakeYAML

Spark Kafka ⭐ 136

Low level integration of Spark and Kafka

Incubator Pekko Http ⭐ 135

The Streaming-first HTTP server/module of Apache Pekko

Kinesis Sql ⭐ 135

Kinesis Connector for Structured Streaming

Anormcypher ⭐ 128

Neo4j Scala library based on Anorm in the Play Framework

Roshttp ⭐ 123

Unified Scala.js + Scala HTTP client API

Lila Ws ⭐ 123

Lichess' websocket server

Advanced Http4s ⭐ 114

🌈 Code samples of advanced features of Http4s in combination with some features of Fs2 not often seen.

Spark Mllib Twitter Sentiment Analysis ⭐ 103

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

Pulsar Spark ⭐ 103

Spark Connector to read and write with Pulsar

Streaming Matrix Factorization ⭐ 100

Distributed Streaming Matrix Factorization implemented on Spark for Recommendation Systems

Spark Streaming Example Project ⭐ 95

A Spark Streaming job reading events from Amazon Kinesis and writing event counts to DynamoDB

Learning Spark ⭐ 94

Practical examples of using Apache Spark in several different use cases

Blog Spark Streaming Log Aggregation ⭐ 91

Example of use of Spark Streaming with Kafka

Spark States ⭐ 88

Custom state store providers for Apache Spark

Sparkstreaminghbaseexample ⭐ 87

Spark Streaming HBase Example

Commons Aws ⭐ 87

Streaming / asynchronous Scala client for common AWS services

Twitter Sentiment Analysis ⭐ 86

Streaming tweets with spark, language detection & sentiment analysis, dashboard with Kibana

A real-time data replication platform that "unbundles" the receiving, transforming, and transport of data streams.

Flink Jpmml ⭐ 82

flink-jpmml is a fresh-made library for dynamic real time machine learning predictions built on top of PMML standard models and Apache Flink streaming engine

Spark_training ⭐ 81

Sample Spark Code

Azure Databricks Nyc Taxi Workshop ⭐ 80

An Azure Databricks workshop leveraging the New York Taxi and Limousine Commission Trip Records dataset

Spark Acid ⭐ 79

ACID Data Source for Apache Spark based on Hive ACID

Event sourcing utilities for FS2

Pagelets ⭐ 76

A module for the Play Framework to build highly modular applications

Fs2 Kafka ⭐ 75

Kafka client for functional streams for scala (fs2)

Kafka Streams Workshop ⭐ 71

Faunadb Jvm ⭐ 71

Scala and Java driver for FaunaDB v4

Akka Http Streaming Response Examples ⭐ 70

A list of examples that involve streaming with Akka Streams and used together with Akka HTTP

Delimited ⭐ 69

Scala library for working with {tab,colon,semicolon,comma,pipe,etc}-separated files.

Spark Bigquery ⭐ 69

Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.

Scala Twitterstreamer ⭐ 68

Scala client for the Twitter streaming api

Binlogupdatetohive ⭐ 68

mysql数据实时增量导入hive

Spark Structured Streaming ⭐ 66

Spark structured streaming with Kafka data source and writing to Cassandra

ScalaCheck for Spark

Experiments in Streaming

Akka Http Akka Streams Akka Actors Integration ⭐ 57

Streaming Chuck Norris jokes in JSON as Server Sent Events using Akka Steams, Akka HTTP and Akka Actors

Anomaly Detection ⭐ 57

Anomaly Detection model uses Spark for training and Spark Streaming for testing

Sparkstreamingexample ⭐ 57

Zound, a PlayFramework 2 audio streaming experiment using Iteratees

Msgpack4s ⭐ 56

A fast, streaming-friendly, type-safe, pure-Scala MessagePack library. Supercharge your microservices today!

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .

Sparkcore ⭐ 54

Spark源码分析,主要包含SparkContext源码、Executor进程启动、Stage划分、

Natural Series Database

Sparkstreamingapps ⭐ 51

A spark sbt blueprint to build your own spark apps off of (for cloud native runtime, see the kube/spark examples)

Spark Cep ⭐ 51

Spark CEP is an extension of Spark Streaming to support SQL-based query processing

XML Streaming for Scala including FS2/cats support

Prosparkstreaming ⭐ 49

Code used in "Pro Spark Streaming: The Zen of Real-time Analytics using Apache Spark" published by Apress Publishing.

Sparkonkudu ⭐ 48

Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.

Spark Activator ⭐ 47

Spark Streaming with Scala and Akka Activator template

Streaming Parallel Decision Tree

Scala Conduits ⭐ 45

A port to Scala of the Conduit library by Michael Snoyman

Xml Spac ⭐ 45

Handle streaming XML and JSON with declarative, composable parsers

Twitterstream ⭐ 45

Twitter Streaming API Example with Kafka Streams in Scala

Awesome Recommendation Engine ⭐ 43

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.

Flink Parameter Server ⭐ 43

Parameter Server implementation in Apache Flink

Trembita ⭐ 43

Model complex data transformation pipelines easily

Related Searches

Scala Sbt (4,178)

Scala Spark (3,279)

Scala Akka (2,120)

Javascript Streaming (2,085)

Java Scala (1,794)

Stream Streaming (1,696)

Python Streaming (1,407)

Scala Play Framework (1,309)

Java Streaming (1,103)

Plugin Scala (1,079)

1-100 of 282 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.