Collecting Data
This is a HOWTO for collecting data in Ruby and Python applications and sending it to S3 via Kafka.
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Javakeeper | 1,766 | 6 months ago | 7 | Java | ||||||
| ✍️ Java 工程师必备架构体系知识总结：涵盖分布式、微服务、RPC等互联网公司常用架构，以及数据存储、缓存、搜索等必备技能 | ||||||||||
| Dataengineeringproject | 644 | a year ago | 4 | mit | Python | |||||
| Example end to end data engineering project. | ||||||||||
| Kafka Connect Ui | 494 | 4 months ago | 24 | other | JavaScript | |||||
| Web tool for Kafka Connect | | ||||||||||
| Automq For Kafka | 304 | 3 months ago | 72 | apache-2.0 | Java | |||||
| A cloud native implementation for Apache Kafka, reducing your cloud infrastructure bill by up to 90%. | ||||||||||
| Storagetapper | 269 | 2 years ago | 4 | November 19, 2021 | 21 | mit | Go | |||
| StorageTapper is a scalable realtime MySQL change data streaming, logical backup and logical replication service | ||||||||||
| Kafka Connect Storage Cloud | 256 | 3 months ago | 178 | other | Java | |||||
| Kafka Connect suite of connectors for Cloud storage (Amazon S3) | ||||||||||
| Kafka Connect Fs | 106 | a year ago | 19 | apache-2.0 | Java | |||||
| Kafka Connect FileSystem Connector | ||||||||||
| Bifrost | 98 | 5 years ago | 4 | epl-1.0 | Clojure | |||||
| Safely archive data from Apache Kafka to S3 with no Hadoop dependencies :) | ||||||||||
| Streamx | 95 | 5 years ago | 26 | apache-2.0 | Java | |||||
| kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3) | ||||||||||
| Automq For Rocketmq | 86 | 3 months ago | 47 | apache-2.0 | Java | |||||
| A cloud native implementation for Apache RocketMQ 5.0 | ||||||||||
Alternatives To Collecting DataSelect To Compare
Alternative Project Comparisons
Popular Kafka Projects
Popular S3 Projects
Popular Data Processing Categories
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Python
Ruby
Email
Kafka
S3
Avro