Awesome Open Source

Programming Languages

Search results for python kafka

448 search results found

Faust ⭐ 6,637

Python Stream Processing

Kafka Python ⭐ 5,403

Python client for Apache Kafka

Share_ppt ⭐ 5,176

🚗 个人做过的技术分享... ( topic: 高性能架构, 中间件原理实践，云原生，Golang 等)

Confluent Kafka Python ⭐ 3,535

Confluent's Kafka Python Client

Syslog Ng ⭐ 2,014

syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL.

Faststream ⭐ 1,485

FastStream is a powerful and easy-to-use Python framework for building asynchronous services interacting with event streams such as Apache Kafka, RabbitMQ, NATS and Redis.

Seldon Server ⭐ 1,420

Machine Learning Platform and Recommendation Engine built on Kubernetes

Faust ⭐ 1,330

Python Stream Processing. A Faust fork

Frontera ⭐ 1,244

A scalable frontier for web crawlers

Alnoda Workspaces ⭐ 1,200

🎆 Flexible and extendable containerized workspaces. Now. with free offline chat GPT!!! 🚀🚀🚀

Scrapy Cluster ⭐ 1,137

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

Cp Docker Images ⭐ 1,125

[DEPRECATED] Docker images for Confluent Platform.

Pathway ⭐ 1,118

Pathway is a high-throughput, low-latency data processing framework that handles live data & streaming for you. Made with ❤️ for Python & ML/AI developers.

Pykafka ⭐ 1,071

Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.

Aiokafka ⭐ 989

asyncio client for kafka

Broadcaster ⭐ 880

Broadcast channels for async web apps. 📢

Parsedmarc ⭐ 839

A Python package and CLI for parsing aggregate and forensic DMARC reports

Cp All In One ⭐ 834

docker-compose.yml files for cp-all-in-one , cp-all-in-one-community, cp-all-in-one-cloud, Apache Kafka Confluent Platform

Backend Interview ⭐ 817

后端面试题汇总（Python、Redis、MySQL、PostgreSQL、Kafka、数据结构、算

Kafka Streams Machine Learning Examples ⭐ 806

This project contains examples which demonstrate how to deploy analytic models to mission-critical, scalable production environments leveraging Apache Kafka and its Streams API. Models are built with Python, H2O, TensorFlow, Keras, DeepLearning4 and other technologies.

Cookbook ⭐ 686

🎉🎉🎉JAVA高级架构师技术栈==任何技能通过 “刻意练习” 都可以达到融会贯通的境界，就像烹饪一样，这里有一份JAVA开发技术手册，只需要增加自己练习的次数。?/a>

Dataengineeringproject ⭐ 644

Example end to end data engineering project.

Funboost ⭐ 571

pip install funboost，python全功能分布式函数调度框架,。支持python所有类型的并发模式和一切知 celery dramatiq等框架整体作为funboost中间件，python函数加速器，框架包罗万象，用户能想 python业务场景，适用范围广。只需要一行代码即可分布式执行python一切函数，99%用过fun 感受是　简易方便强劲强大，相见恨晚。

Kafka-based Job Queue for Python

Spiderman ⭐ 498

基于 scrapy-redis 的通用分布式爬虫框架

Kafka Tools ⭐ 475

A collection of tools for working with Apache Kafka.

Propan is a powerful and easy-to-use Python framework for building event-driven applications that interact with any MQ Broker

Cp Ansible ⭐ 460

Ansible playbooks for the Confluent Platform

Agile_data_code_2 ⭐ 435

Code for Agile Data Science 2.0, O'Reilly 2017, Second Edition

Tributary ⭐ 424

Streaming reactive and dataflow graphs in Python

Zeek Analysis Tools (ZAT): Processing and analysis of Zeek network data with Pandas, scikit-learn, Kafka and Spark

Mysql_streamer ⭐ 401

MySQLStreamer is a database change data capture and publish system.

Aliware Kafka Demos ⭐ 389

提供各种客户端接入阿里云消息队列 Kafka 的demo工程(Provide a demo project for various clients to access Alibaba Cloud message queue Kafka)

Datafaker ⭐ 377

Datafaker is a large-scale test data and flow test data generation tool. Datafaker fakes data and inserts to varied data sources. 测试数据生成工具

Cryptostore ⭐ 358

A scalable storage service for cryptocurrency data

Gather Deployment ⭐ 347

Gathers Python deployment, infrastructure and practices.

Tech Blog ⭐ 345

我的个人技术博客（Python、Django、Docker、Go、Redis、ElasticSear

Kafka Images ⭐ 336

Confluent Docker images for Apache Kafka

Quix Streams ⭐ 334

Quix Streams - A library for data streaming and Python Stream Processing

Distributed_framework ⭐ 314

pip install function_scheduling_distributed_framework，python通用

Kafka Utils ⭐ 311

Langstream ⭐ 307

LangStream. Event-Driven Developer Platform for Building and Running LLM AI Apps. Powered by Kubernetes and Kafka.

Winton Kafka Streams ⭐ 281

A Python implementation of Apache Kafka Streams

Qbusbridge ⭐ 277

The Apache Kafka Client SDK

Ghost_sa ⭐ 269

open_server for sensorsdata ghost_sa(鬼策)的用途是接收神策SDK 上报的数据，移动广告监测，站外阅读监测，短链创建与解析，反爬，接入控制与管理，用户分群与召回等功能

Sync data from the other DB to ClickHouse(cluster)

Sourcecodeofbook ⭐ 255

《Python爬虫开发从入门到实战》配套源代码。

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Py_zipkin ⭐ 219

Provides utilities to facilitate the usage of Zipkin in Python

My Tech Blog: about Rust / Golang / Python / Flutter / Blockchain etc.

Kafka Influxdb ⭐ 206

High performance Kafka consumer for InfluxDB. Supports collectd message formats.

Software Development Best Practices ⭐ 191

Modest and essential collection of software engineering practices.

Dataclasses Avroschema ⭐ 189

Generate avro schemas from python classes. Code generation from avro schemas. Serialize/Deserialize python instances with avro schemas

Minibatch ⭐ 177

Python stream processing for humans

Playgrounds ⭐ 167

Provide docker environment and examples for PyFlink

Hivemq Mqtt Tensorflow Kafka Realtime Iot Machine Learning Training Inference ⭐ 159

Real Time Big Data / IoT Machine Learning (Model Training and Inference) with HiveMQ (MQTT), TensorFlow IO and Apache Kafka - no additional data store like S3, HDFS or Spark required

Bigdata Playground ⭐ 154

A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL

Scrapy_demo ⭐ 150

all kinds of scrapy demo

Open Source Books ⭐ 141

开源书籍大搜罗

Clickhouse Sink Connector ⭐ 140

Replicate data from MySQL, Postgres and MongoDB to ClickHouse

Distributed notifications using websockets

Napalm Logs ⭐ 132

Cross-vendor normalisation for network syslog messages, following the OpenConfig and IETF YANG models

Kafka Ml ⭐ 131

Kafka-ML: connecting the data stream with ML/AI frameworks (now TensorFlow and PyTorch!)

Ansible Kafka Admin ⭐ 131

Manage your topic's configuration (partitions, replication factor, parameters), ACLs, quotas, users and get stats, without any effort with this library. It does not use the Kafka scripts and does not require ssh connection to the remote broker.

Ksql Python ⭐ 129

A python wrapper for the KSQL REST API.

Python Notebooks For Apache Kafka ⭐ 126

A Series of Notebooks on how to start with Kafka and Python

Remotecodecompiler ⭐ 117

An online code compiler supporting 11 programming languages (Java, Kotlin, Scala, C, C++, C#, Golang, Python, Ruby, Rust and Haskell) for competitive programming and coding interviews.

Free5gmano ⭐ 111

Yelper_recommendation_system ⭐ 108

Yelper recommendation system

De Zoomcamp Ui ⭐ 107

🎨 UI for the Free Data Engineering Zoomcamp 2023 Course provided by DataTalksClub

Jun_linux ⭐ 102

Docker镜像大礼包，Linux运维安装工具及脚本，K8S构建，各个环境构建部署等，包括不限于于s

Stormkafkamon ⭐ 98

Dumps state of Storm Kafka consumers

Streamify ⭐ 97

A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!

Pyflink_learn ⭐ 96

基于 PyFlink 的学习文档，通过一个个小实践，便于大家快速入手 PyFlink

Incremental_training ⭐ 96

Repo that relates to the Medium blog 'Keeping your ML model in shape with Kafka, Airflow' and MLFlow'

Kukulcan ⭐ 91

A REPL for Apache Kafka

Orion Server ⭐ 83

Database-backed storage solution for OwnTracks location data

kafka text user interface in style!

Datacater ⭐ 80

The developer-friendly ETL platform for transforming data in real-time. Based on Apache Kafka® and Kubernetes®.

Twitter Sentiment Analysis Using Spark Streaming And Kafka ⭐ 78

Twitter Sentiment Analysis using Spark and Kafka

실전 카프카 개발부터 운영까지

Architectural POC for real-time market data and portfolio order processing using Storm, Kafka, InfluxDB, Graphana, ooh and Python!

Product Sp ⭐ 74

An open source, cloud-native streaming data integration and analytics product optimized for agile digital businesses

Cookiecutter Faust ⭐ 70

A Cookiecutter template for creating Faust projects quickly.

Google Finance Stock Data Analysis ⭐ 69

Developed a high performance data processing platform using Apache Kafka, Apache Cassandra, and Apache Spark to analyze stock price and related stock tweets sentiment.

Kafka Shell ⭐ 65

⚡A supercharged, interactive Kafka shell built on top of the existing Kafka CLI tools.

Scrapy Kafka ⭐ 63

Kafka-based components for Scrapy

Kryptoflow ⭐ 63

Real-time analysis of bitcoin markets with Kafka and Tensorflow Serving

Faust Docker Compose Example ⭐ 62

Faust dockerized application

Python Kafka Avro ⭐ 62

A simple examle for Python Kafka Avro

Python Fake Data Producer For Apache Kafka ⭐ 61

The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and push it to an Apache Kafka topic.

Distributed task redisqueue(最简单python分布式函数调度框架)

Ansible Playbook ⭐ 59

Ansible playbook to deploy distributed technologies

Ansible Kafka ⭐ 58

Ansible playbook for provisioning a Kafka cluster with Zookeeper

Datapipeline ⭐ 57

Real time stock data pipeline --play with Kafka, Cassandra, Spark, Redis, Node.js, Zookeeper

Insight Mapmycab ⭐ 56

An API to Analyze Cab GeoLocation Data and a Simulated App for finding an available cab in Real-Time

Python data pipeline

Pybigdata ⭐ 56

使用 python 操作大数据的各种组件

Prometheus Kafka Consumer Group Exporter ⭐ 56

Prometheus Kafka Consumer Group Exporter

Journalpump ⭐ 55

systemd journald to aws_cloudwatch, elasticsearch, google cloud logging, kafka, rsyslog or logplex log sender

Related Searches

Python Django (28,897)

Python Machine Learning (20,195)

Python Flask (17,643)

Python Dataset (14,792)

Python Docker (14,113)

Python Tensorflow (13,736)

Python Command Line (13,351)

Python Deep Learning (13,092)

Python Jupyter Notebook (12,976)

Python Network (11,495)

1-100 of 448 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.