Awesome Open Source

Programming Languages

Search results for scala streaming

282 search results found

Awesome Recommendation Engine ⭐ 43

The purpose of this tiny project is to put things together with the know how that i learned from the course big data expert from formacionhadoop.com The idea is to show how to play with apache spark streaming, kafka,mongo, spark machine learning algorithms.

Fs2 Google Pubsub ⭐ 42

Google Cloud Pub/Sub stream-based client built on top of cats-effect, fs2 and http4s.

Datasource Receiver ⭐ 41

Spark Receiver for SQL or NoSQL Databases like Cassandra, MongoDB, Elasticsearch or JDBC

Hyperdrive ⭐ 41

Extensible streaming ingestion pipeline on top of Apache Spark

Spark Ref Architecture ⭐ 38

Reference Architectures for Apache Spark

Real Time Stream Processing Engine ⭐ 37

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Milan is a Scala API and runtime infrastructure for building data-oriented systems, built on top of Apache Flink.

Spark Kafka 0 8 Sql ⭐ 36

Spark Structured Streaming Kafka 0.8 Source Implementation

Activator Spray Twitter ⭐ 36

Activator showing how to use Spray Client to implement a streaming Twitter client

Airbnb Spark Thrift ⭐ 34

A library for loadling Thrift data into Spark SQL

Spark In Practice Scala ⭐ 33

Getting started with Spark, Spark streaming, Spark SQL and DataFrame.

Spark Stateful Example ⭐ 33

A full example of my blog post regarding Sparks stateful streaming (http://asyncified.io/2016/07/31/exploring-statefu

Pafka is originated from the OpenAIOS project to leverage an optimized tiered storage access strategy to improve overall performance for streaming/messaging system.

Tweet Driven Comparable Companies ⭐ 33

Analyzing Twitter real time feed with Spark Streaming

Kanadi is a Nakadi client for Scala

Hivemall Spark ⭐ 31

A Hivemall wrapper for Spark

Snappy Examples ⭐ 31

Use cases built on SnappyData. Use cases contained here: 1. Ad Analytics 2. Streaming data ingestion from RabbitMQ.

Spark Utils ⭐ 30

Basic framework utilities to quickly start writing production ready Apache Spark applications

Incubator Pekko Grpc ⭐ 30

Apache Pekko gRPC

A simple, idiomatic (S)FTP client for ZIO

Spark Secure Kafka App ⭐ 29

Sample Spark Streaming application for secure consumption from Kafka

Apache Spark 2x Machine Learning Cookbook ⭐ 28

Apache Spark 2x Machine Learning Cookbook, published by Packt

Spark Cloudant ⭐ 27

Cloudant integration with Spark as Spark SQL external datasource

Chronicler ⭐ 26

Scala toolchain for InfluxDB

Spark Hive Streaming Sink ⭐ 26

A sink to save Spark Structured Streaming DataFrame into Hive table

Scalable Batch and Stream Data Processing

Chronicler Spark ⭐ 25

InfluxDB connector to Apache Spark on top of Chronicler

Spark Structured Streaming Examples ⭐ 25

Spark structured streaming examples with using of version 3.4.0

Grpcmonix ⭐ 25

Use Monix's Observable with GRPC services

Mapr Streams Sparkstreaming Hbase ⭐ 25

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Spark Scala Playground ⭐ 25

Sample processing code using Spark 2.1+ and Scala

Streaming Amqp ⭐ 23

AMQP data source for dstream (Spark Streaming)

Scala Kafka Twitter ⭐ 23

Example integration of Kafka, Avro & Spark-Streaming on live Twitter feed

Flink code for TPC-DS competition，forked from Apache Flink，and cherry pick some new feature.

Streamingstopgraceful ⭐ 23

Example to show how to stop the Spark Streaming Application Gracefully

Zeppelin Solr ⭐ 23

Apache Solr interpreter for Apache Zeppelin

Spark State Tools ⭐ 22

Spark Structured Streaming State Tools

Processing Tweet Stream ⭐ 22

A Processing library for the Twitter Streaming API

Kafka Streams Plumber ⭐ 22

Plumber, for your dirtiest Kafka streaming jobs

Udemy Spark Streaming ⭐ 22

For Udemy students: the official repository of Rock the JVM's Spark Streaming course

Sparkstreaminghbaseexample ⭐ 21

Spark Streaming HBase Example

Spark_log_data ⭐ 21

Flume-to-Spark-Streaming Log Parser

Spark Kafka Streaming ⭐ 21

Custom Spark Kafka consumer based on Kafka SimpleConsumer API.

Streamkv ⭐ 21

A streaming key-value store implementation using native Flink Streaming operators

Sparktwitterstreamanalysis ⭐ 21

A Spark Streaming App to analyze the popular hashtags based on keywords

Sample Kafkasparkcassandra ⭐ 21

Introductory sample scala app using Apache Spark Streaming to accept data from Kafka and write a summary to Cassandra.

Akka Streams Example ⭐ 21

Example on Akka Streams with productive cases

Bigdata Project ⭐ 20

大数据相关笔记

Getting Started ⭐ 20

Mapr Sparkml Streaming Uber ⭐ 20

Ruscello ⭐ 19

Real time and offline time series analysis with Spark, Spark Streaming and Storm

Spark Streaming With Google Cloud Example ⭐ 19

an example of integrating Spark Streaming with Google Pub/Sub and Google Datastore

Mapr Pcapstream ⭐ 18

An example Spark Streaming application processing PCAP data.

Elastic Indexer4s ⭐ 18

Stream your stuff into elasticsearch

Fast, lightweight Scala Http framework

Spark Streaming Jdbc Source ⭐ 17

Torrentstream ⭐ 17

BitTorrent streaming engine, written in Scala and based on akka-streams

Skiis: Streaming + Parallel collection for Scala

S3 Stream ⭐ 17

Akka Streaming Client for S3 and Supporting Libraries

Sparknlp Elasticsearch ⭐ 17

Twitter sentiment analysis using Spark and Stanford CoreNLP and visualization using elasticsearch and kibana

Dataproc Pubsub Spark Streaming ⭐ 16

Async Twitter Client ⭐ 16

Async Twitter client on top of Ning/Netty/Akka

Spark Twitter Named Entity ⭐ 16

Named Entity Extraction on Twitter Stream using Apache Spark Streaming and Stanford CoreNLP

Scodec Akka ⭐ 16

Provides interop between scodec and akka

Streaming Demo ⭐ 15

A Spark Streaming demo framework that implements and improves the functions of Twitter Rainbird

Akkamonixsttpbackend ⭐ 15

A STTP backend that utilizes Monix Observables and Tasks.

Spark Streaming Clickhouse ⭐ 15

Apache Spark structured streaming connector for Yandex ClickHouse OLAP

Spark Hive Streaming Sink ⭐ 15

A sink to save Spark Structured Streaming DataFrame into Hive table

Spark Sql Kafka Offset Committer ⭐ 15

Kafka offset committer for structured streaming query

Telemetry Streaming ⭐ 15

Spark Streaming ETL jobs for Mozilla Telemetry

Spark Streaming Monitoring With Lightning ⭐ 15

Plot live-stats as graph from ApacheSpark application using Lightning-viz

Loveisintheair ⭐ 14

A spark based twitter streaming application that was used to process valentines tweets from all over India during the Valentines week of 2016 for analyzing the cities and states of India in love

Quark is a streaming-first Api Gateway using Akka

Logeventsprocessingspark ⭐ 13

real time log event processing using spark, kafka & cassandra

Reactivemongo Streaming ⭐ 13

🍃 Streaming libraries for ReactiveMongo

Spark Demos ⭐ 13

Spark(multi versions) + Streaming/Hive/SQL/UDF Demos

Wow Spark ⭐ 13

🔆 spark自学手册，包含了例如spark core、spark sql、spark streaming、spark-kafka、delta-lake，以及scala基础练习，还有一些例

Mbtiles Server ⭐ 13

Map tile server for streaming images shipped as MBTiles

Scala Spark Cab Rides Predictions ⭐ 12

A big data project for predicting prices of Uber/Lyft rides depending on the weather

Defunct Template Scala Parallel Universal Recommendation ⭐ 12

Sparkatscale ⭐ 12

Flink Parameter Server ⭐ 12

Parameter Server implementation in Apache Flink.

Baryon is a library for building Spark Streaming applications that consume data from Kafka.

Dsci_553 ⭐ 12

USC ✌️ 2020 Spring DSCI 553 (Foundations and Applications of Data Mining) 数据挖掘基础与应用 Score: 9️⃣4️⃣

SCARFF (SCAlable Real-time Frauds Finder) is a framework which enables credit card fraud detection.

Spark Stream Kudu ⭐ 12

Kafka, Spark Streaming, Kudu integration examples

My MSc on Data Science final project. This is a library for Data Pre-processing Algorithms for Streaming in Flink (DPASF)

Fs2 Mongodb ⭐ 12

Simple streaming interface for FS2 queries

Spark Example ⭐ 11

Spark1.6和spark2.2的示例，包含kafka,flume,structuredstrea

Streaming Instagram ⭐ 11

A library for reading social data from Instagram using Spark Streaming.

Sparkka Streams ⭐ 11

Power a Spark Stream from anywhere in your Akka Stream Flow

Akka Online ⭐ 11

Online and streaming algorithms with Akka

Spark Kinesis Sql Asl ⭐ 11

Amazon Kinesis Source for Structured Streaming

Rich Spark ⭐ 11

Rich Spark adds more to Apache Spark

Spark Streaming Kafka Example ⭐ 11

An example project using Spark Streaming with Kafka message and Avro serialization

Screamingtwitter ⭐ 11

Using Spark Streaming to send tweets from Twitter Streaming API to Elasticsearch

Streaming Facebook ⭐ 11

A library for reading social data from Facebook using Spark Streaming.

Spark_streaming_aggregation ⭐ 11

Event aggregation with spark streaming

Spark State Store ⭐ 10

Rocksdb state storage implementation for Structured Streaming.

Related Searches

Scala Sbt (4,178)

Scala Spark (3,279)

Scala Akka (2,120)

Javascript Streaming (2,085)

Java Scala (1,794)

Stream Streaming (1,696)

Python Streaming (1,407)

Scala Play Framework (1,309)

Java Streaming (1,103)

Plugin Scala (1,079)

101-200 of 282 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.