Awesome Open Source

Programming Languages

Search results for spark streaming

spark-streaming x

159 search results found

一个基于Softflowd，Kafka，Spark Streaming，Elk，Django开发的网络数据流监控分析后台，支持Netflow V9与Netflow V5。可以对进入和流出的流量进行异常分析并执行自动化漏洞修复。

Big Data ⭐ 10

Big data technologies

Realtime parking spot recommender system and crowd-sourcing platform

Project Fortis Spark ⭐ 9

A repository for all spark jobs running on fortis

Freeza Offset ⭐ 9

Spark stream consumption commit in kafka consumer group

Spark Streaming Mqtts ⭐ 9

Spark Streaming receiver that supports MQTT over TLS v1.2 with X.509 client certificate based authentication.

Bigdatademo ⭐ 9

The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big data project relates to Hadoop ecosystem

Big Data Framework Demos ⭐ 9

It is a assemble to include all Practice Projects about Big Data Topic, includes Hadoop, Spark, Spark Streaming and Kafka

Pro Spark Streaming ⭐ 8

Source code for 'Pro Spark Streaming' by Zubair Nabi

Probabilistic data structures java implementation.

Kafka Spark Streaming Weblog ⭐ 8

Sparking Stream from Kafka to calculate real time top url click stream from an http weblog using Spark Streaming, Kafka, SpringBoot, Spring Integration tech stack

Firehose - Spark streaming 2.2 + Kafka 0.8_2

Kafka Scala Api ⭐ 8

Samples for using Kafka within Spark Streaming and Akka Actors, Akka Streams

Twitch Streamer ⭐ 8

Spark Streaming library for reading chat messages from Twitch.tv

Data_origination_workshop ⭐ 8

Hands-on workshop with Iceberg, Redpanda, Debezium and Kafka-Connect

Kafka Spark Product Recommendation ⭐ 8

Python script demonstrating spark streaming and Kafka implementation using an e-commerce website like product recommendation engine based on item-based collaborative filtering. 🐍. 💥

Realtime Recommender ⭐ 8

Spark-Kafka Realtime recommender Engine.

Big Data Laboratory ⭐ 7

Big Data laboratory, using Kibana, Elasticsearch, Logstash, Kafka and Spark to process messages coming from OPC UA and DB

Kse Sample ⭐ 7

This project is used for getting data from Kafka and dealing through Spark streaming and finally storing into Elasticsearch.

Spark2 Template ⭐ 7

Intellij template to develop Apache Spark 2.x applications

Sundaymovies ⭐ 7

🙊 大数据过滤推荐引擎包含电影展示和基于Spark的电影推荐引擎

Openmrs Etl ⭐ 7

openmrs - mysql - debezium - kafka - spark - scala

Kafkaoffshore ⭐ 7

Kafka, CouchDB and Friends: A test flight beyond the shore

Spark Streaming Kafka Cassandra Starter ⭐ 7

Application built on Spark Streaming, Kafka and Cassandra.

Bullet Spark ⭐ 7

The Apache Spark Streaming implementation of the Bullet backend

Spark Streaming Twitter ⭐ 7

Building pipeline to process the real-time data using Spark and Mongodb.

Insightde ⭐ 6

TrafficAdvisor: a Real-Time Traffic Monitoring System

Spork Streaming ⭐ 6

Pig on Spark Streaming

Benchmark_minhash_lsh ⭐ 6

insight data engineering fellow project

Errorsnrt ⭐ 6

NRT detection of web-traffic anomalies using Flume, Spark Streaming and Impala

Spark Learning ⭐ 6

Example code which can help in getting started with spark

Twittersentimentanalysis ⭐ 6

A Spark Streaming implementation for Online Twitter Sentiment Analysis.

Spark Streaming Gnip ⭐ 6

An Apache Spark utility for pulling Tweets from Gnip's PowerTrack in realtime

Spark Road Traffic Graph ⭐ 6

divide city to some points as nodes of a traffic graph and process location data from kafka and calculate edge between nodes with spark aggregations

Data_visualization_and_analysis_tool_for_telemetry_data ⭐ 6

An naive anomaly detection and data visualization tool for F1 on board telemetry data.

Spark Streaming ⭐ 6

The official repository for the Rock the JVM Spark Streaming course

Msc In Machine Learning And Artificial Intelligence ⭐ 6

Master of Science in Machine Learning & Artificial Intelligence - Indian Institute Technology Madras & Liverpool John Moores University

Bigdata Ecosystem Architecture ⭐ 6

Life-cycle: Internal working of HDFS, SQOOP, HIVE, SPARK, HBASE, KAFKA with code.

Odsc West Streaming Trends ⭐ 6

All Data, Relevant Information, Scripts, and Applications for the Open Data Science Conference (2018)

Spark Kafka Connector ⭐ 6

Reliable spark-kafka connector. Kafka 1.x and Spark 2.x

Databrickstraining ⭐ 6

Repository for Microsoft Databricks Training Events - Hosted by BlueGranite

Physonline ⭐ 5

PhysOnline: An Open Source Machine Learning Pipeline for Real-Time Analysis of Waveform Data

Spark Kafka Example ⭐ 5

Example for Data Reading from and Writing to from Kafka Topic using Apache Spark DataFrame and DataSet

Spatialsparkapp ⭐ 5

Spotless_recommender ⭐ 5

Movie Recommendation Als Spark ⭐ 5

EC-JANE Entertainment launches an innovative film recommendation project utilizing MovieLens data. This project aims to incorporate Big Data analysis and machine learning to enhance movie suggestions, leveraging Apache Spark, Elasticsearch, and a Flask API to provide a personalized and dynamic user experience.

Main repository of the Flint project for Spark and Amazon EMR.

Sparkstreaming Network Anomaly Detection ⭐ 5

This repository includes supervised and unsupervised machine learning methods which are used to detect anomalies on network datasets. Decision Tree, Random Forest, Gradient Boost Tree, Naive Bayes, and Logistic Regression were used for supervised learning. K-Means was used for unsupervised learning.

Spark Streaming ⭐ 5

Twitter Spark Streaming using PySpark

Taming Big Data With Spark Streaming And Scala Hands On ⭐ 5

Taming Big Data with Spark Streaming and Scala – Hands On, published by Packt

Las Vpe Platform ⭐ 5

ISEE Video Parsing and Evaluation (VPE) Platform.

Thunder Streaming ⭐ 5

Streaming analysis of large-scale spatial temporal neural data

Iceberg Intro Workshop ⭐ 5

Hands-on workshop with Apache Iceberg

Raspi Spark Streaming Mqtt ⭐ 5

The basic purpose of this project is that the raspberryPi sends the temperature event to the server and spark streams the data using the spark streaming

Spark Streaming Kafka 0 10 Connector ⭐ 5

A Kafka 0.10 connector for Spark 1.x Streaming

Spark Streaming In Python ⭐ 5

Apache Spark 3 - Structured Streaming Course Material

Spark Streaming Kafka Demo ⭐ 5

spark streaming从kafka读取消息，offset写入Redis，spark计算单词出现频率，最后

P7hb Docker Mllib Twitter Sentiment ⭐ 5

🚢 Docker image for Twitter Sentiment analysis with Spark MLlib

101-159 of 159 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.