Awesome Open Source

Programming Languages

Search results for postgresql kafka

95 search results found

Risingwave ⭐ 5,799

The distributed streaming database. Engineered to offer the simplest and most cost-efficient way for stream processing and management.

Materialize ⭐ 5,547

The data warehouse for operational workloads.

Devops Bash Tools ⭐ 2,224

1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..

Bottledwater Pg ⭐ 1,517

Change data capture from PostgreSQL into Kafka

Kubeblocks ⭐ 1,465

KubeBlocks is an open-source control plane that runs and manages databases, message queues and other data infrastructure on K8s.

Peerdb ⭐ 1,315

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage

Gnomock ⭐ 1,250

Test your code without writing mocks with ephemeral Docker containers 📦 Setup popular services with just a couple lines of code ⏱️ No bash, no yaml, only code 💻

Alnoda Workspaces ⭐ 1,200

🎆 Flexible and extendable containerized workspaces. Now. with free offline chat GPT!!! 🚀🚀🚀

Blockchain data parsing and persisting results

pmacct is a small set of multi-purpose passive network monitoring tools [NetFlow IPFIX sFlow libpcap BGP BMP RPKI IGP Streaming Telemetry].

A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues

Backend Interview ⭐ 817

后端面试题汇总（Python、Redis、MySQL、PostgreSQL、Kafka、数据结构、算

Microservice Kafka ⭐ 548

Demo to show how Apache Kafka can be used for communication between microservices

Hypertrace ⭐ 505

An open source distributed tracing & observability platform

Zipkin Js ⭐ 484

Zipkin instrumentation for Node.js and browsers

Micronaut Microservices Poc ⭐ 404

Very simplified insurance sales system made in a microservices architecture using Micronaut

Datafaker ⭐ 377

Datafaker is a large-scale test data and flow test data generation tool. Datafaker fakes data and inserts to varied data sources. 测试数据生成工具

Cryptostore ⭐ 358

A scalable storage service for cryptocurrency data

Devicehive Java Server ⭐ 340

DeviceHive Java Server

Firehose ⭐ 312

Firehose is an extensible, no-code, and cloud-native service to load real-time streaming data from Kafka to data stores, data lakes, and analytical storage systems.

Replicadb ⭐ 304

ReplicaDB is open source tool for database replication, designed for efficiently transferring bulk data between relational and non-relational databases

Storagetapper ⭐ 269

StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service

Sync data from the other DB to ClickHouse(cluster)

Quarkus Super Heroes ⭐ 224

Quarkus sample application - Super Heroes

Asky开源架构：极简、轻量、极致性能《Asky零基础1小时学编程 dnc+vue+tidb+redis+rabbitMQ+ES》QQ群 779699538

Docker Compose Stacks ⭐ 205

Contains all the docker-compose stacks I use for my testing and development work

Firecamp ⭐ 188

Serverless Platform for the stateful services

Go Notify ⭐ 165

An email automation solution, written in Golang.

Amazonriver ⭐ 162

amazonriver 是一个将postgresql的实时数据同步到es或kafka的服务

Flow Pipeline ⭐ 140

A set of tools and examples to run a flow-pipeline (sFlow, NetFlow)

Clickhouse Sink Connector ⭐ 140

Replicate data from MySQL, Postgres and MongoDB to ClickHouse

Node Server Template ⭐ 126

This is Node.js server tidy template / boilerplate with Express (with asyncified handlers, custom error handler) framework and MongoDb. The server use ES6 and above. On different branches you can see different techniques' and technologies' usage, such as Kafka, nodemailer, file download... You also can find postman collections.

PG数据同步工具（Java实现）

Postgres Kafka Demo ⭐ 116

Fully reproducible, Dockerized, step-by-step, demo on how to stream tables from Postgres to Kafka/KSQL back to Postgres. Detailed blog post published on Medium.

Pg_kafka ⭐ 105

INACTIVE: A PostgreSQL extension to produce messages to Apache Kafka.

A high performance/ real-time C++ Kafka streams framework (C++17)

Stove: The easiest way of writing e2e tests for your back-end API in Kotlin

Bireme is an incremental synchronization tool for the Greenplum / HashData data warehouse

Mysqltoall ⭐ 80

A Mysql data to file/elasticsearch/kafka/redis/redis-cluster/mongo and normal)/TiDB/postgresql with binlog tool.

Open Bank Mark ⭐ 72

A bank simulation application using mainly Clojure, which can be used to end-to-end test and show some graphs.

Pg2kafka ⭐ 63

Ship changes in Postgres 🐘 to Kafka 📖

Ecommerce App ⭐ 59

eCommerce application is a platform where customers can find products, shop around using a cart, check out the products and initiate payments. It is used for the didactic purpose only, as a support project for my training at https://www.ionutbalosin.com/training

Goharvest ⭐ 50

Transactional outbox harvester for Postgres → Kafka, written in Go

Etl Engine ⭐ 47

etl engine 轻量级跨平台流批一体ETL引擎数据抽取-转换-装载 ETL engine lightweight cross platform batch flow integration ETL engine data extraction transformation loading

Database Journal ⭐ 43

Databases: Concepts, commands, codes, interview questions and more...

Camelboilerplate ⭐ 42

A Spring Boot Camel boilerplate that aims to consume events from Apache Kafka, process it and send to a PostgreSQL database.

Lectures ⭐ 42

Лекции по курсу Распределенные Системы Обработки Информации кафедры ИУ7 МГТУ им. Н.Э.Баумана

Contact Center ⭐ 42

一个基于 Spring Cloud 的微服务客服系统

Aiven Examples ⭐ 39

Aiven "getting started" code examples

Spring Boot 2 ⭐ 36

Spring boot 2 türkçe örnekler

Run dev environments easily and fastly using Podman or Docker

A fast massive push platform for APNs and FCM

Event sourcing in java with vavr, akka stream and vertx reactive PG driver

Sequelize Kafka Connect ⭐ 28

💎 nodejs kafka connect connector for MySQL, Postgres, SQLite and MSSQL

Kafka Nodejs Example ⭐ 28

Showcases using Kafka with a producer and consumer in NodeJS.

multiple terminal client for data storage [kafka | mysql | postgresql | click house |redis]

Teachapachecamel ⭐ 27

Pg_listener ⭐ 24

Go application to capture inserts into PostgreSQL table and produce events to Apache Kafka using replication slot and WAL

Enterprise Application Software

Jun_bigdata ⭐ 18

jun_bigdata大数据平台服务框架。实现了Kafka实时数据过滤、清洗、转换、消费，实现了Sp SQL对Redis、MongoDB等非关系型数据库的数据的读写；集成了规则引擎，可基于规则引擎实现客

Reddit Streaming ⭐ 18

streaming eight subreddits from reddit api using kafka producer & spark structured streaming.

Spark Kafka Avro ⭐ 17

POC: Spark consumer for bottledwater-pg Kafka Avro topics

Bigdata Workshop Es ⭐ 17

Workshop Big Data en Español

Mz Twitch Analytics ⭐ 17

Self-contained demo using Kafka, Materialize and Metabase to check what's streaming on Twitch. All you need is Docker and Twitch access tokens! 👾

Psql Streamer ⭐ 17

Stream database events from PostgreSQL to Kafka

Angularportfoliomgr ⭐ 17

This is an project to show the use of Angular 17, Spring Boot 3, H2/Postgresql with Jpa, Liquibase, Kafka and Gradle and a Helm chart for a Kubernetes deployment. The frontend uses D3 for charts. For dynamic queries the frontend uses Drag'n Drop and the Backend Jpa Criteria api and the frontend displays the results in Table/Tree Angular components.

Avro Schema Registry ⭐ 16

Avro Schema Registry (mostly) compatible with salsify/avro-schema-registry

Smalllinks ⭐ 16

Simple URL shortener built with Fastify. Uses PostgreSQL, Redis, and Kafka.

Besu Exflo ⭐ 16

A plugin for the Besu enterprise-grade Ethereum client with the aim of making it easier to extract chain data into a variety of different data stores and processing pipelines.

Es Cqrs Shopping Cart ⭐ 16

A resilient and scalable shopping cart system designed using Event Sourcing (ES) and Command Query Responsibility Segregation (CQRS)

Smag Mvp ⭐ 15

Social Record - Distributed scraping and analysis pipeline for a range of social media platforms

Tail the Binlog of a database

Device Manager ⭐ 15

Device management service for dojot

Kafka Example ⭐ 14

Heapland ⭐ 13

Universal interface for data services

Eventstream ⭐ 13

🚀 Eventstream pipeline to preprocess and resend from some source to some storage

E Commerce Api ⭐ 13

E-Commerce API Made With NodeJs,Typescript,PostgreSQL,Redis And Kafka

Chronos Pipeline ⭐ 13

A data pipeline for processing event data

Kafka Rust Example ⭐ 12

Simple command line application to read/write message to kafka topic using protobuf

Ayb.debezium.ticket ⭐ 12

.NET framework based implementation of the Outbox Pattern using Apache Kafka and Debezium.

🌅(Mostly) educational app to manage favorite locations and recipes. Techstack Frontend: Angular 16 (TypeScript, Mapbox GL), Backend: Spring Boot 3.2 (JDK 21, Kotlin, PostgreSQL, Kafka, Cognito), Go Microservices, Docker, Terraform managed AWS Infrastructure

Fake Data Pipeline ⭐ 10

Data Generators -> Kafka -> Spark Streaming -> PostgreSQL -> Grafana

Starter components for golang, for connect to any external service with 1 line of code.

Partialfood Inventory ⭐ 10

Inventory Management server for the Partial Foods sample

Spark_streaming_demo ⭐ 10

Spark Streaming with Kafka and Wikipedia Edits

Notes about programming in Web, Python, PostgreSQL, MySQL, Golang etc.

Tickets Sales System ⭐ 10

Tickets sales application for FIFA World Cup Qatar 22. It is a web application where users can purchase tickets for matches along with admin dashboard to view states about sold tickets. The application is built using event driven architecture along with security best practices and TDD

Go Clean Architecture Example ⭐ 10

Golang Clean Architecture Example

Quarkus Hexagonal ⭐ 9

Quarkus hexagonal architecture example

Postgres Kafka Elastic ⭐ 9

Docker example with kafka connect and sink

A secure-by-default, async Rest API with hyper, tokio, bb8, kafka-threadpool, postgres and prometheus for monitoring. Includes: a working user management and authentication backend written for postgres, async s3 uploading/downloading, async publishing to kafka with mTLS for encryption in transit

Bottled Water ⭐ 8

Kafka Connect + Postgres + Debezium and KSQL on Heroku

Kratos Uba ⭐ 8

User Behavior Analysis System base on microservice.

Docker Compose Ultimate ⭐ 8

🌀 Ultimate Docker Compose for All Services.

Trimetric ⭐ 7

Realtime visualization of Portland's transit system

Gingerspec ⭐ 7

Acceptance test library. General purpose automation framework.

Bigdata Mind Map ⭐ 7

🌟 大数据知识脑图 🌟

Awesome Backend ⭐ 7

Music Store ⭐ 7

A simple CRUD rest application with HTTP4S, Slick, Kafka and Elastic Search

Go Cqrs Kafka Grpc Microservices ⭐ 7

Go gRPC Kafka CQRS microservices with tracing

Related Searches

Database Postgresql (5,322)

Javascript Postgresql (4,454)

Docker Postgresql (3,367)

Java Kafka (3,237)

Python Postgresql (2,800)

Typescript Postgresql (2,539)

Postgresql Sql (2,391)

Java Postgresql (2,173)

Reactjs Postgresql (2,110)

Django Postgresql (1,839)

1-95 of 95 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.