Awesome Open Source

Programming Languages

Search results for scala spark streaming

spark-streaming x

68 search results found

Angel ⭐ 6,690

A Flexible and Powerful Parameter Server for large-scale machine learning

Movie_recommend ⭐ 1,441

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

Utils4s ⭐ 1,033

scala、spark使用过程中，各种测试用例以及相关资料整理

Reference Apps ⭐ 615

Spark reference applications

Real Time Analytics and Data Pipelines based on Spark Streaming

Streamdm ⭐ 456

Stream Data Mining Library for Spark Streaming

Learningspark ⭐ 406

Scala examples for learning to use Spark

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Azure Event Hubs Spark ⭐ 225

Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs

Example Spark ⭐ 197

Spark, Spark Streaming and Spark SQL unit testing strategies

Spark Streaming With Kafka ⭐ 161

Self-contained examples of Apache Spark streaming integrated with Apache Kafka.

Bigdata Playground ⭐ 154

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Spark Kafka ⭐ 136

Low level integration of Spark and Kafka

Kinesis Sql ⭐ 135

Kinesis Connector for Structured Streaming

Example Spark Kafka ⭐ 118

Apache Spark and Apache Kafka integration example

Spark Mllib Twitter Sentiment Analysis ⭐ 103

🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib

Spark States ⭐ 88

Custom state store providers for Apache Spark

Recommendmoteur ⭐ 57

电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎

Anomaly Detection ⭐ 57

Anomaly Detection model uses Spark for training and Spark Streaming for testing

Spark Training ⭐ 52

Repository used for Spark Trainings

Fdp Modelserver ⭐ 45

An umbrella project for multiple implementations of model serving

Datastax Spark Streaming Demo ⭐ 43

Counting Twitter hashtags using Spark Streaming and Cassandra

Xxhadoop ⭐ 37

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Real Time Stream Processing Engine ⭐ 37

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Litemall Dw ⭐ 36

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；

Airbnb Spark Thrift ⭐ 34

A library for loadling Thrift data into Spark SQL

Sparkdemo ⭐ 34

spark全示例代码(java、scala) Spark most full instance code DEMO (java、scala)

Spark Utils ⭐ 30

Basic framework utilities to quickly start writing production ready Apache Spark applications

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Hadooplearning ⭐ 25

全套大数据基础学习教程，包含最基础的centos、maven。大数据主要包含hdfs、mr、yarn

Recommendsystem ⭐ 24

电影推荐系统

Seatunnel Example ⭐ 23

seatunnel plugin developing examples.

Bandar Log ⭐ 20

Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.

Sparknlp Elasticsearch ⭐ 17

Twitter sentiment analysis using Spark and Stanford CoreNLP and visualization using elasticsearch and kibana

Java_spark ⭐ 16

Spark 2.x 案例操作：Scala版本与 Java1.8lambda版代码示例。涵盖Spark核心技术操作SparkCore、SparkSql

Spark Streaming Monitoring With Lightning ⭐ 15

Plot live-stats as graph from ApacheSpark application using Lightning-viz

Scala Spark Cab Rides Predictions ⭐ 12

A big data project for predicting prices of Uber/Lyft rides depending on the weather

Nyc_taxi_pipeline ⭐ 12

Design/Implement stream/batch architecture on NYC taxi data | #DE

Spark Example ⭐ 11

Spark1.6和spark2.2的示例，包含kafka,flume,structuredstrea

Streaming Facebook ⭐ 11

A library for reading social data from Facebook using Spark Streaming.

Streaming Instagram ⭐ 11

A library for reading social data from Instagram using Spark Streaming.

Spark Kinesis Sql Asl ⭐ 11

Amazon Kinesis Source for Structured Streaming

Confluent Platform Spark Streaming ⭐ 10

Working example of consuming Avro data from Kafka with Spark Streaming

Project Fortis Spark ⭐ 9

A repository for all spark jobs running on fortis

Spark Streaming Mqtts ⭐ 9

Spark Streaming receiver that supports MQTT over TLS v1.2 with X.509 client certificate based authentication.

Bigdatademo ⭐ 9

The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big data project relates to Hadoop ecosystem

Twitch Streamer ⭐ 8

Spark Streaming library for reading chat messages from Twitch.tv

Pro Spark Streaming ⭐ 8

Source code for 'Pro Spark Streaming' by Zubair Nabi

Kafka Scala Api ⭐ 8

Samples for using Kafka within Spark Streaming and Akka Actors, Akka Streams

Probabilistic data structures java implementation.

Spark2 Template ⭐ 7

Intellij template to develop Apache Spark 2.x applications

Sundaymovies ⭐ 7

🙊 大数据过滤推荐引擎包含电影展示和基于Spark的电影推荐引擎

Bullet Spark ⭐ 7

The Apache Spark Streaming implementation of the Bullet backend

Spark Streaming Kafka Cassandra Starter ⭐ 7

Application built on Spark Streaming, Kafka and Cassandra.

Kafkaoffshore ⭐ 7

Kafka, CouchDB and Friends: A test flight beyond the shore

Openmrs Etl ⭐ 7

openmrs - mysql - debezium - kafka - spark - scala

Spark Streaming ⭐ 6

The official repository for the Rock the JVM Spark Streaming course

Spark Learning ⭐ 6

Example code which can help in getting started with spark

Spark Streaming Gnip ⭐ 6

An Apache Spark utility for pulling Tweets from Gnip's PowerTrack in realtime

Odsc West Streaming Trends ⭐ 6

All Data, Relevant Information, Scripts, and Applications for the Open Data Science Conference (2018)

Spark Kafka Connector ⭐ 6

Reliable spark-kafka connector. Kafka 1.x and Spark 2.x

Errorsnrt ⭐ 6

NRT detection of web-traffic anomalies using Flume, Spark Streaming and Impala

Las Vpe Platform ⭐ 5

ISEE Video Parsing and Evaluation (VPE) Platform.

Raspi Spark Streaming Mqtt ⭐ 5

The basic purpose of this project is that the raspberryPi sends the temperature event to the server and spark streams the data using the spark streaming

P7hb Docker Mllib Twitter Sentiment ⭐ 5

🚢 Docker image for Twitter Sentiment analysis with Spark MLlib

Spark Streaming Kafka 0 10 Connector ⭐ 5

A Kafka 0.10 connector for Spark 1.x Streaming

Taming Big Data With Spark Streaming And Scala Hands On ⭐ 5

Taming Big Data with Spark Streaming and Scala – Hands On, published by Packt

Spatialsparkapp ⭐ 5

Spark Kafka Example ⭐ 5

Example for Data Reading from and Writing to from Kafka Topic using Apache Spark DataFrame and DataSet

Physonline ⭐ 5

PhysOnline: An Open Source Machine Learning Pipeline for Real-Time Analysis of Waveform Data

Related Searches

Scala Sbt (4,178)

Scala Spark (3,280)

Scala Akka (2,110)

Scala Java (1,812)

Scala Play Framework (1,309)

Plugin Scala (1,079)

Scala Kafka (969)

Scala Functional Programming (942)

Scala Scalajs (887)

Docker Scala (728)

1-68 of 68 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.