Awesome Open Source
Search
Programming Languages
Languages
All Categories
Categories
About
Search results for python spark streaming
python
x
spark-streaming
x
41 search results found
Cdap
⭐
735
An open source framework for building data analytic applications.
Dbldatagen
⭐
234
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines
Gimel
⭐
230
Big Data Processing Framework - Unified Data API or SQL on Any Storage
Bigdata Playground
⭐
154
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
Pyspark Twitter Stream Mining
⭐
63
Real-time Machine Learning with Apache Spark on Twitter Public Stream
Apachespark
⭐
59
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
Spark Training
⭐
52
Repository used for Spark Trainings
Architect_big_data_solutions_with_spark
⭐
42
code, labs and lectures for the course
Spark_app_twitter
⭐
36
A data engineering project (Twitter monitor app)
Spark Ai
⭐
31
Toolbox for building Generative AI applications on top of Apache Spark.
Pathway Benchmarks
⭐
26
Benchmarks for data processing systems: Pathway, Spark, Flink, Kafka Streams
Ozymandias
⭐
23
Real-time image processing at scale using Kafka and Spark Streaming
Spark And Kafka_iot Data Processing And Analytics
⭐
21
Final Project for IoT: Big Data Processing and Analytics class in UCSC Extension. Analyzing U.S nationwide temperature from IoT sensors in real-time
Kafka Connect Msk Demo
⭐
21
For a series of posts on Amazon MSK, Amazon EKS, and Amazon EMR
Spark And Mllib Projects
⭐
18
This repository contains Spark, MLlib, PySpark and Dataframes projects
Kafka Twitter Spark Streaming
⭐
16
Counting Tweets Per User in Real-Time
Real Time Stock Analyzer
⭐
16
Bigdata Pipeline
Tweet Analysis With Kafka And Spark
⭐
15
A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.
Live_twitter_sentiment_analysis
⭐
14
Live Twitter sentiment analysis using Python, Apache Spark Streaming, Kafka, NLTK, SocketIO
Lambda Architecture Demo
⭐
14
Developing a Lambda Architecture pipeline using Apache Kafka, Spark Structured Streaming, Redshift, S3, Python
Nyc_taxi_pipeline
⭐
12
Design/Implement stream/batch architecture on NYC taxi data | #DE
Spark Pubsub
⭐
11
Google Cloud Pubsub connector for Spark Streaming
Big Data
⭐
10
Big data technologies
Mnet
⭐
10
一个基于Softflowd,Kafka,Spark Streaming,Elk,Django开发的网络数据流监控分析后台, 支持Netflow V9与Netflow V5。可以对进入和流出的流量进行异常分析并执行自动化漏洞修复。
Easypark
⭐
9
Realtime parking spot recommender system and crowd-sourcing platform
Freeza Offset
⭐
9
Spark stream consumption commit in kafka consumer group
Data_origination_workshop
⭐
8
Hands-on workshop with Iceberg, Redpanda, Debezium and Kafka-Connect
Kafka Spark Product Recommendation
⭐
8
Python script demonstrating spark streaming and Kafka implementation using an e-commerce website like product recommendation engine based on item-based collaborative filtering. 🐍. 💥
Realtime Recommender
⭐
8
Spark-Kafka Realtime recommender Engine.
Kse Sample
⭐
7
This project is used for getting data from Kafka and dealing through Spark streaming and finally storing into Elasticsearch.
Kafkaoffshore
⭐
7
Kafka, CouchDB and Friends: A test flight beyond the shore
Spark Streaming Twitter
⭐
7
Building pipeline to process the real-time data using Spark and Mongodb.
Twittersentimentanalysis
⭐
6
A Spark Streaming implementation for Online Twitter Sentiment Analysis.
Benchmark_minhash_lsh
⭐
6
insight data engineering fellow project
Insightde
⭐
6
TrafficAdvisor: a Real-Time Traffic Monitoring System
Msc In Machine Learning And Artificial Intelligence
⭐
6
Master of Science in Machine Learning & Artificial Intelligence - Indian Institute Technology Madras & Liverpool John Moores University
Databrickstraining
⭐
6
Repository for Microsoft Databricks Training Events - Hosted by BlueGranite
Data_visualization_and_analysis_tool_for_telemetry_data
⭐
6
An naive anomaly detection and data visualization tool for F1 on board telemetry data.
Spark Streaming In Python
⭐
5
Apache Spark 3 - Structured Streaming Course Material
Movie Recommendation Als Spark
⭐
5
EC-JANE Entertainment launches an innovative film recommendation project utilizing MovieLens data. This project aims to incorporate Big Data analysis and machine learning to enhance movie suggestions, leveraging Apache Spark, Elasticsearch, and a Flask API to provide a personalized and dynamic user experience.
Flint
⭐
5
Main repository of the Flint project for Spark and Amazon EMR.
Thunder Streaming
⭐
5
Streaming analysis of large-scale spatial temporal neural data
Spotless_recommender
⭐
5
Related Searches
Python Django (28,897)
Python Machine Learning (20,195)
Python Flask (17,643)
Python Jupyter Notebook (16,242)
Python Dataset (15,243)
Python Docker (13,758)
Python Tensorflow (13,736)
Python Command Line (13,351)
Python Deep Learning (13,092)
Python Network (11,495)
1-41 of 41 search results
Privacy
|
About
|
Terms
|
Follow Us On Twitter
Copyright 2018-2024 Awesome Open Source. All rights reserved.