Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for spark streaming
spark-streaming
x
160 search results found
Angel
⭐
6,690
A Flexible and Powerful Parameter Server for large-scale machine learning
Risingwave
⭐
5,799
The distributed streaming database. Engineered to offer the simplest and most cost-efficient way for stream processing and management.
Coolplayspark
⭐
3,447
酷玩 Spark: Spark 源代码解析、Spark 类库等
Spark
⭐
1,963
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
Movie_recommend
⭐
1,441
基于Spark的电影推荐系统,包含爬虫项目、web网站、后台管理系统以及spark推荐系统
Utils4s
⭐
1,033
scala、spark使用过程中,各种测试用例以及相关资料整理
Mobius
⭐
937
C# and F# language binding and extensions to Apache Spark
Wormhole
⭐
863
Wormhole is a SPaaS (Stream Processing as a Service) Platform
Cdap
⭐
735
An open source framework for building data analytic applications.
Streaming Readings
⭐
640
Streaming System 相关的论文读物
Reference Apps
⭐
615
Spark reference applications
Sparta
⭐
526
Real Time Analytics and Data Pipelines based on Spark Streaming
Streamdm
⭐
456
Stream Data Mining Library for Spark Streaming
Learningspark
⭐
406
Scala examples for learning to use Spark
Sylph
⭐
396
Stream computing platform for bigdata
Decision
⭐
311
Powered by Spark Streaming & Siddhi
Data Accelerator
⭐
293
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
Dbldatagen
⭐
234
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines
Gimel
⭐
230
Big Data Processing Framework - Unified Data API or SQL on Any Storage
Azure Event Hubs Spark
⭐
225
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
Example Spark
⭐
197
Spark, Spark Streaming and Spark SQL unit testing strategies
Sparkstreaming
⭐
183
💥 🚀 封装sparkstreaming动态调节batch time(有数据就执行计算);🚀 支持运行过程中增删topic;🚀 封装sparkstreaming 1.6 - kafka 010 用以支持 SSL。
Spark Streaming With Kafka
⭐
161
Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
Streamline
⭐
156
StreamLine - Streaming Analytics
Bigdata Playground
⭐
154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Spark Kafka
⭐
136
Low level integration of Spark and Kafka
Kinesis Sql
⭐
135
Kinesis Connector for Structured Streaming
Example Spark Kafka
⭐
118
Apache Spark and Apache Kafka integration example
Spark Mllib Twitter Sentiment Analysis
⭐
103
🌟 ✨ Analyze and visualize Twitter Sentiment on a world map using Spark MLlib
Kafka Spark Streaming Example
⭐
96
Simple examle for Spark Streaming over Kafka topic
Spark States
⭐
88
Custom state store providers for Apache Spark
Spark_als
⭐
68
基于spark-ml,spark-mllib,spark-streaming的推荐算法实现
Pyspark Twitter Stream Mining
⭐
63
Real-time Machine Learning with Apache Spark on Twitter Public Stream
Apachespark
⭐
59
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
Recommendmoteur
⭐
57
电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎
Anomaly Detection
⭐
57
Anomaly Detection model uses Spark for training and Spark Streaming for testing
Spark Training
⭐
52
Repository used for Spark Trainings
Movie Recommender Demo
⭐
50
This project walks through how you can create recommendations using Apache Spark machine learning. There are a number of jupyter notebooks that you can run on IBM Data Science Experience, and there a live demo of a movie recommendation web application you can interact with. The demo also uses IBM Message Hub (kafka) to push application events to topic where they are consumed by a spark streaming job running on IBM BigInsights (hadoop).
Fdp Modelserver
⭐
45
An umbrella project for multiple implementations of model serving
Projects
⭐
43
秒杀,音乐商店项目实战,Redis源码,推荐系统
Datastax Spark Streaming Demo
⭐
43
Counting Twitter hashtags using Spark Streaming and Cassandra
Architect_big_data_solutions_with_spark
⭐
42
code, labs and lectures for the course
Real Time Stream Processing Engine
⭐
37
This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.
Xxhadoop
⭐
37
Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !
Spark_app_twitter
⭐
36
A data engineering project (Twitter monitor app)
Litemall Dw
⭐
36
基于开源Litemall电商项目的大数据项目,包含前端埋点(openresty+lua)、后端埋点;
Spark Utils
⭐
35
💥 👽 ♨️🚀Encapsulated spark 与其他组件的结合api,方便使用,例如 es,hbase,kudu,kafka,mq等
Airbnb Spark Thrift
⭐
34
A library for loadling Thrift data into Spark SQL
Sparkdemo
⭐
34
spark全示例代码(java、scala) Spark most full instance code DEMO (java、scala)
Spark Ai
⭐
31
Toolbox for building Generative AI applications on top of Apache Spark.
Spark Utils
⭐
30
Basic framework utilities to quickly start writing production ready Apache Spark applications
Spark Twitter Watson Dashboard
⭐
30
Real-time dashboard for Twitter Sentiment analysis using Spark Streaming and Watson Tone Analyzer
Spark Streaming Direct Kafka
⭐
30
High Performance Spark Streaming with Direct Kafka in Java
Pathway Benchmarks
⭐
26
Benchmarks for data processing systems: Pathway, Spark, Flink, Kafka Streams
Interview Refresher Java Bigdata
⭐
26
a one-stop repo to lookup for code snippets of core java concepts, sql, data structures as well as big data. It also consists of interview questions asked in real-life.
Cassandra.realtime
⭐
25
Different ways to process data into Cassandra in realtime with technologies such as Kafka, Spark, Akka, Flink
Wasp
⭐
25
WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.
Hadooplearning
⭐
25
全套大数据基础学习教程,包含最基础的centos、maven。大数据主要包含hdfs、mr、yarn
Open Stream Processing Benchmark
⭐
24
This repository contains the code base for the Open Stream Processing Benchmark.
Recommendsystem
⭐
24
电影推荐系统
Seatunnel Example
⭐
23
seatunnel plugin developing examples.
Adrealtimeanalysis
⭐
23
四川大学拓思艾诺广告流量实时分析项目
Ozymandias
⭐
23
Real-time image processing at scale using Kafka and Spark Streaming
Framework Js
⭐
23
Simple yet powerful live data computation framework.
Biginsights On Apache Hadoop
⭐
21
Example projects for 'BigInsights for Apache Hadoop' on IBM Bluemix
Spark And Kafka_iot Data Processing And Analytics
⭐
21
Final Project for IoT: Big Data Processing and Analytics class in UCSC Extension. Analyzing U.S nationwide temperature from IoT sensors in real-time
Zephyr
⭐
21
Zephyr is a big data, platform agnostic ETL API, with Hadoop MapReduce, Storm, and other big data bindings.
Kafka Connect Msk Demo
⭐
21
For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR
Bandar Log
⭐
20
Monitoring tool to measure flow throughput of data sources and processing components that are part of Data Ingestion and ETL pipelines.
Lasagna
⭐
20
A Docker Compose template that builds a interactive development environment for PySpark with Jupyter Lab, MinIO as object storage, Hive Metastore, Trino and Kafka
Exdemon
⭐
19
A general purpose metrics monitor implemented with Apache Spark. Kafka source, Elastic sink, aggregate metrics, different analysis, notifications, actions, live configuration update, missing metrics, ...
Realtime Trading Project
⭐
19
💲Crypto Trading Strategies using Reinforcement Learning with Linear-Q Learning, LSTM Q-learning, Kafka, and Apache Spark 📈📉
Realtime Dashboard Example
⭐
18
This is a real-time dashboard example using Spark Streaming and Node.js
Spark And Mllib Projects
⭐
18
This repository contains Spark, MLlib, PySpark and Dataframes projects
Bigdatatutorial
⭐
18
bigdatatutorial
Awesome Big Data
⭐
17
大数据&&分布式系统学习过程中一些经验总结
Dspbench
⭐
17
a suite of benchmark applications for distributed data stream processing systems
Sparknlp Elasticsearch
⭐
17
Twitter sentiment analysis using Spark and Stanford CoreNLP and visualization using elasticsearch and kibana
Qs Hadoop
⭐
17
大数据生态圈学习
Kafka Twitter Spark Streaming
⭐
16
Counting Tweets Per User in Real-Time
Java_spark
⭐
16
Spark 2.x 案例操作:Scala版本与 Java1.8lambda版代码示例。涵盖Spark核心技术操作SparkCore、SparkSql
Real Time Stock Analyzer
⭐
16
Bigdata Pipeline
Spark Streaming Monitoring With Lightning
⭐
15
Plot live-stats as graph from ApacheSpark application using Lightning-viz
Twitterstreamingsparkkafkademo
⭐
15
a demo project to Analyze most popular twitter hashtags using Java 8 Spring-Boot Spark Streaming Kafka & Docker Demo.
T Watch
⭐
15
Real Time Twitter Sentiment Analysis Product
Tweet Analysis With Kafka And Spark
⭐
15
A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.
Project Fortis Pipeline
⭐
14
Project Fortis is a data ingestion, analysis and visualization pipeline.
Bdp
⭐
14
A Big Data Platform Prototype Project
Lambda Architecture Demo
⭐
14
Developing a Lambda Architecture pipeline using Apache Kafka, Spark Structured Streaming, Redshift, S3, Python
Live_twitter_sentiment_analysis
⭐
14
Live Twitter sentiment analysis using Python, Apache Spark Streaming, Kafka, NLTK, SocketIO
Spark Streaming External Projects
⭐
13
Nyc_taxi_pipeline
⭐
12
Design/Implement stream/batch architecture on NYC taxi data | #DE
Kafka Spark Streaming
⭐
12
An example project for Kafka and Spark Streaming integration
Scala Spark Cab Rides Predictions
⭐
12
A big data project for predicting prices of Uber/Lyft rides depending on the weather
Streaming Instagram
⭐
11
A library for reading social data from Instagram using Spark Streaming.
Registry
⭐
11
Schema Registry
Streaming Facebook
⭐
11
A library for reading social data from Facebook using Spark Streaming.
Spark Pubsub
⭐
11
Google Cloud Pubsub connector for Spark Streaming
Spark Kinesis Sql Asl
⭐
11
Amazon Kinesis Source for Structured Streaming
Spark Example
⭐
11
Spark1.6和spark2.2的示例,包含kafka,flume,structuredstrea
1-100 of 160 search results
Next >
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.