Awesome Open Source
Awesome Open Source

Kafka Connect HDFS Connector

kafka-connect-hdfs is a Kafka Connector for copying data between Kafka and Hadoop HDFS.

Documentation for this connector can be found here.

Development

To build a development version you'll need a recent version of Kafka as well as a set of upstream Confluent projects, which you'll have to build from their appropriate snapshot branch. See the FAQ for guidance on this process.

You can build kafka-connect-hdfs with Maven using the standard lifecycle phases.

FAQ

Refer frequently asked questions on Kafka Connect HDFS here - https://github.com/confluentinc/kafka-connect-hdfs/wiki/FAQ

Contribute

License

This project is licensed under the Confluent Community License.


Get A Weekly Email With Trending Projects For These Topics
No Spam. Unsubscribe easily at any time.
java (30,358
kafka (397
streaming (282
big-data (232
hadoop (129
hdfs (41
apache-kafka (38
confluent (20

Find Open Source By Browsing 7,000 Topics Across 59 Categories