Awesome Open Source

Programming Languages

Search results for kafka hive

85 search results found

Bigdata Notes ⭐ 14,872

大数据入门指南 ⭐

God Of Bigdata ⭐ 8,483

专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive.

Bigdataguide ⭐ 2,355

大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

Szt Bigdata ⭐ 2,055

深圳地铁大数据客流分析系统🚇🚄🌟

Secor ⭐ 1,828

Secor is a service implementing Kafka log persistence

Movie_recommend ⭐ 1,441

基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

Bigdata Growth ⭐ 1,256

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

Stream Reactor ⭐ 960

A collection of open source Apache 2.0 Kafka Connector maintained by Lenses.io.

Spiderman ⭐ 498

基于 scrapy-redis 的通用分布式爬虫框架

Zdh_web ⭐ 379

大数据采集,抽取平台,zdh_web是zdh系列服务的可视化管理平台，包含数据采集,调度,权限,审批

Datafaker ⭐ 377

Datafaker is a large-scale test data and flow test data generation tool. Datafaker fakes data and inserts to varied data sources. 测试数据生成工具

Flink Notes ⭐ 223

flink学习笔记

Big Data ⭐ 190

一个开源、成体系的大数据学习教程。spark学习 hadoop hive hbase flink教程 linux 从入门到精通

Bigdata Hub ⭐ 187

数据建设与大数据技术知识体系，包含hadoop、hive、spark、flink主流框架和系列框架，

Huaweicloud Mrs Example ⭐ 150

Examples for HUAWEI CLOUD MRS.

Eel Sdk ⭐ 140

Big Data Toolkit for the JVM

Bigdata Learning ⭐ 136

大数据学习记录

Xichuan_note ⭐ 114

xichuan的学习总结笔记,覆盖了java、spring、java其他常用框架,以及大数据相关组件

Spark Atlas Connector ⭐ 112

A Spark Atlas connector to track data lineage in Apache Atlas

kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)

My Tutorial ⭐ 93

我想构建形成自己的知识的体系，工作职位是大数据，所以主要还是以大数据为主，从主流框架Hadoop，S 大数据开发是很繁琐的，正确的运行环境是成功的第一步，所以我尽量从搭建，部署，开发整个流程都做出来，单

Springboot Templates ⭐ 79

springboot和dubbo、netty的集成，redis mongodb的nosql模板， kafka rocketmq rabbit的MQ模板， solr solrcloud elasticsearch查询引擎

Kafka as Hive Storage

Titandataoperationsystem ⭐ 57

最好的大数据项目。《Titan数据运营系统》，本项目是一个全栈闭环系统，我们有用作数据可视化的web Echart等；

Pybigdata ⭐ 56

使用 python 操作大数据的各种组件

Insight Mapmycab ⭐ 56

An API to Analyze Cab GeoLocation Data and a Simulated App for finding an available cab in Real-Time

Flume Canal Source ⭐ 54

Flume NG Canal source

Bigdataparty ⭐ 54

大数据组件 All-in-One 的 Dockerfile

Today I Learned

A tool for developing and testing ETL and ELT processes for automating the capture, delivery and processing of information in data warehouses on the MicroFocus Vertica platform.

Movie Recommender Demo ⭐ 50

This project walks through how you can create recommendations using Apache Spark machine learning. There are a number of jupyter notebooks that you can run on IBM Data Science Experience, and there a live demo of a movie recommendation web application you can interact with. The demo also uses IBM Message Hub (kafka) to push application events to topic where they are consumed by a spark streaming job running on IBM BigInsights (hadoop).

Etl Engine ⭐ 47

etl engine 轻量级跨平台流批一体ETL引擎数据抽取-转换-装载 ETL engine lightweight cross platform batch flow integration ETL engine data extraction transformation loading

Hadoop Unit ⭐ 45

Hadoop-Unit is a project which allow testing projects which need hadoop ecosysteme like kafka, solr, hdfs, hive, hbase, ...

Big Data Parent ⭐ 39

大数据体系，存储，计算，相关组件，分析引擎等

Awesome Druid ⭐ 38

Xxhadoop ⭐ 37

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

Litemall Dw ⭐ 36

基于开源Litemall电商项目的大数据项目，包含前端埋点(openresty+lua)、后端埋点；

Engineeringteam ⭐ 32

와이빅타 엔지니어링팀의 자료를 정리해두는 곳입니다.

Framework Of Bigdata ⭐ 30

大数据面试题，从0到1走向架构师之路。Flink、Spark、Hive、HBase、Hadoop、K

Minipipe ⭐ 30

Minipipe: a minimal end-to-end data pipeline

Bigdata Doc ⭐ 25

大数据学习笔记，学习路线，技术案例整理。

Mysql Time Machine ⭐ 22

mysql-time-machine project

Bigdata Tutorial ⭐ 22

Jun_bigdata ⭐ 18

jun_bigdata大数据平台服务框架。实现了Kafka实时数据过滤、清洗、转换、消费，实现了Sp SQL对Redis、MongoDB等非关系型数据库的数据的读写；集成了规则引擎，可基于规则引擎实现客

Bigdata Book ⭐ 18

上百本大数据电子书，附带下载链接，包括计算机基础，Java，hadoop，spark，flink，k

Qs Hadoop ⭐ 17

大数据生态圈学习

Jmx_exporter Cloudera Hadoop ⭐ 17

Prometheus jmx_exporter configurations for Cloudera Hadoop

小白大数据学习笔记 ⭐

Bigdataguider ⭐ 15

大数据学习笔记: 涉及hadoop,spark,hive,zookeeper等内容

Simple Datahub ⭐ 15

simplify linkedin datahub metadata platform

Bigdata Learning ⭐ 14

大数据学习，主要涉及Kafka、ZooKeeper、Hive、HBase、Spark

Docker Hadoop ⭐ 14

一键搭建zookeeper/hadoop/hive/hbase/sqoop/kafka/spark/

Arduino Temperature Streaming Demo ⭐ 13

Arquitectura simple de propósito general para el procesamiento en tiempo real y batch de lecturas de sensor de temperatura sobre arduino.

Yangdocker ⭐ 12

自助搭建的 hadoop + spark + kafka + zookeeper + storm + hbase + hive + flume 集群，一主两从。

Bigdata News ⭐ 12

基于Spark2.2新闻网大数据实时系统项目

Bigdataguide ⭐ 11

秋招自学上岸，自学太难了，想总结一份详细的大数据开发资料，包括基础 | 架构 | 源码，让更多自学的伙伴少走弯路。有相关问题可以添加公众号：大数据老刘，联系老刘！

Conch Bigdata ⭐ 10

good good study,day day up (记录学习的点点滴滴)

Notewarehouse ⭐ 9

❄️本仓库包含Java学习笔记和大数据学习笔记，主要包含Java基础、JavaWEB、Java框架、

Weather Mrs ⭐ 9

天气爬虫采集，kafka实时分发，flume 收集数据导入到 Hbase, 再由 Hive 与 Hbase 建立映射，Superset 分析和展示数据。

Bigdata Docker ⭐ 9

Run Hadoop Cluster within Docker Containers.

Big Data Pipeline ⭐ 9

Bigdatademo ⭐ 9

The demo of using Kafka, Spark, Hive, Cassandra, etc by using Docker. It produces the production ready environment for any kinds of big data project relates to Hadoop ecosystem

Tbds_maintance_dev_demo_project ⭐ 9

Drone Fly ⭐ 9

A service which allows Hive Metastore Listeners to be deployed outside of the Hive Metastore Service

Bigdata Interview ⭐ 8

2021年超全超详细的最新大数据开发面试题，附答案解析，大数据面试题，看这一套就够了

1kuang_datas ⭐ 7

亿矿云大数据处理框架：借助Hadoop、Spark、Storm等分布式处理架构，满足海量数据的批处理亿矿云大数据预处理：运用数据冗余剔除、异常检测、归一化等方法对原始数据进行清洗，为后续存储、管理与分亿矿云大数据存储与管理：通过分布式文件系统、NoSQL数据库、关系数据库、时序数据库等不同的数据管理

Myproject ⭐ 7

Docker Bigdata Cluster ⭐ 7

Infrastructure automation to deploy Hadoop,Hive,Spark,airflow nodes on a docker host

Random Datagen ⭐ 7

A generator of Random Data to HDFS, HBase, Hive, Kafka, Kudu, Ozone, SolR in CDP (Cloudera Data Platform)

Infraestructura para Big Data : Hadoop + NiFi +Spark + Hive usando Docker

Atlas Ranger Tag Security ⭐ 6

Data Misc Tools ⭐ 6

This project hosts several tools to help with development using Hive, Spark

Drillbook ⭐ 6

The Official Source Repository for Learning Apache Drill (O'Reilly, 2018)

Bigdata Platform ⭐ 6

End to end big data project, that aims to show how to implement different big data layers, from the infrastructure layer to the end user one. [HADOOP][Spark][Kafka][Cassandra][Ansible][Jupyter

Bigdata Ecosystem Architecture ⭐ 6

Life-cycle: Internal working of HDFS, SQOOP, HIVE, SPARK, HBASE, KAFKA with code.

Big Data Knowledge ⭐ 6

📖大数据相关知识集锦

Technology Summary ⭐ 5

Java开发知识点、大数据技术应用和常见后端面试题总结

The Node about BigData

Etlexpress ⭐ 5

ETL元数据注册,表达式注册

Spark Streaming Kafka Demo ⭐ 5

spark streaming从kafka读取消息，offset写入Redis，spark计算单词出现频率，最后

An Hadoop Application Deployment tool

Analysisofuserbehaviors ⭐ 5

基于spark的电商用户行为分析系统

Related Searches

Java Kafka (3,237)

Kafka Zookeeper (1,229)

Docker Kafka (1,191)

Python Kafka (1,133)

Spark Kafka (979)

Scala Kafka (969)

Golang Kafka (919)

Apache Kafka (836)

Stream Kafka (790)

Hadoop Hive (703)

1-85 of 85 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.