Awesome Open Source

Programming Languages

Search results for streaming parquet

8 search results found

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

Apache Spark is a fast, in-memory data processing engine with elegant and expressive development API's to allow data workers to efficiently execute streaming, machine learning or SQL workloads that require fast iterative access to datasets.This project will have sample programs for Spark in Scala language .

Avro Json ⭐ 29

Utilities for converting to and from JSON from Avro records via Hadoop streaming or Hive.

Iow Hadoop Streaming ⭐ 26

Set of hadoop input/output formats for use in combination with hadoop streaming

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Spark_log_data ⭐ 21

Flume-to-Spark-Streaming Log Parser

Streaming Data Platform ⭐ 19

Spark Streaming Twitter ⭐ 7

Building pipeline to process the real-time data using Spark and Mongodb.

Related Searches

Javascript Streaming (2,085)

Stream Streaming (1,696)

Python Streaming (1,407)

Java Streaming (1,103)

Spark Streaming (813)

Streaming Kafka (627)

1-8 of 8 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.