Awesome Open Source

Programming Languages

Search results for elasticsearch spark

elasticsearch x

88 search results found

Flink Learning ⭐ 13,801

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《 Flink 实战与性能优化》

Dev Setup ⭐ 5,802

macOS development environment setup: Easy-to-understand instructions with automated setup scripts for developer tools like Vim, Sublime Text, Bash, iTerm, Python data analysis, Spark, Hadoop MapReduce, AWS, Heroku, JavaScript web development, Android development, common data stores, and dev-based OS X defaults.

The Hunting ELK

Spring Boot Quick ⭐ 2,282

🌿 基于springboot的快速学习示例,整合自己遇到的开源框架,如：rabbitmq(延迟队列)、K

Szt Bigdata ⭐ 2,055

深圳地铁大数据客流分析系统🚇🚄🌟

Quicksql ⭐ 1,939

A Flexible, Fast, Federated(3F) SQL Analysis Middleware for Multiple Data Sources

Elasticsearch Hadoop ⭐ 1,914

🐘 Elasticsearch real-time search and analytics natively integrated with Hadoop

Elassandra ⭐ 1,633

Elassandra = Elasticsearch + Apache Cassandra

Devops Python Tools ⭐ 709

80+ DevOps & Data CLI Tools - AWS, GCP, GCF Python Cloud Functions, Log Anonymizer, Spark, Hadoop, HBase, Hive, Impala, Linux, Docker, Spark Data Converters & Validators (Avro/Parquet/JSON/CSV/INI/XML/YAML), Travis CI, AWS CloudFormation, Elasticsearch, Solr etc.

Elasticsearch Spark Recommender ⭐ 603

Use Jupyter Notebooks to demonstrate how to build a Recommender with Apache Spark & Elasticsearch

Yanagishima ⭐ 584

Web UI for Trino, Hive and SparkSQL

Every Single Day I Tldr ⭐ 311

A daily digest of the articles or videos I've found interesting, that I want to share with you.

Openuba ⭐ 264

A robust, and flexible open source User & Entity Behavior Analytics (UEBA) framework used for Security Analytics. Developed with luv by Data Scientists & Security Analysts from the Cyber Security Industry. [PRE-ALPHA]

Big Data Processing Framework - Unified Data API or SQL on Any Storage

Docker Zeppelin ⭐ 210

Docker build for Zeppelin, a web-based Spark notebook

Unified SQL Analytics Engine Based on SparkSQL

Spark Elastic ⭐ 197

This project combines Apache Spark and Elasticsearch to enable mining & prediction for Elasticsearch.

Zipkin Dependencies ⭐ 173

Spark job that aggregates zipkin spans for use in the UI

Dcos Commons ⭐ 162

DC/OS SDK is a collection of tools, libraries, and documentation for easy integration of technologies such as Kafka, Cassandra, HDFS, Spark, and TensorFlow with DC/OS.

web-based analysis tool for rare disease genomics

A recommender system for discovering GitHub repos, built with Apache Spark

Spark Dependencies ⭐ 112

Spark job for dependency links

Dcos Iot Demo ⭐ 106

This project demonstrates how to configure a full stack geo-enabled Internet of Things (IoT) solution using Mesosphere's open sourced Data Center Operating System (DC/OS) using Docker containerization and frameworks for Mesos including Marathon, Kafka, Spark, and Elasticsearch.

Logisland ⭐ 106

Scalable stream processing platform for advanced realtime analytics on top of Kafka and Spark. LogIsland also supports MQTT and Kafka Streams (Flink being in the roadmap). The platform does complex event processing and is suitable for time series analysis. A large set of valuable ready to use processors, data sources and sinks are available.

Qbox Blog Code ⭐ 88

Code reference from my Qbox blog posts.

Generator Mitosis ⭐ 75

A micro-service infrastructure generator based on Yeoman/Chatbot, Kubernetes/Docker Swarm, Traefik, Ansible, Jenkins, Spark, Hadoop, Kafka, etc.

Pybigdata ⭐ 56

使用 python 操作大数据的各种组件

Spark Es ⭐ 44

ElasticSearch integration for Apache Spark

Yuzhouwan ⭐ 42

Code Library for My Blog

Datashark ⭐ 41

dataShark is a Security & Network Event Analytics Framework built on Apache Spark

Datasource Receiver ⭐ 41

Spark Receiver for SQL or NoSQL Databases like Cassandra, MongoDB, Elasticsearch or JDBC

Real Time Stream Processing Engine ⭐ 37

This is an example of real time stream processing using Spark Streaming, Kafka & Elasticsearch.

Xxhadoop ⭐ 37

Data Analysis Using Hadoop/Spark/Storm/ElasticSearch/MachineLearning etc. This is My Daily Notes/Code/Demo. Don't fork, Just star !

RDF2X converts big RDF datasets to the relational database model, CSV, JSON and ElasticSearch.

Dev Notes ⭐ 34

开发进阶笔记

Real Time Data Warehouse ⭐ 29

Real-time Data Warehouse with Apache Flink & Apache Kafka & Apache Hudi

Elasticsearch Data Import Handler ⭐ 27

A multi-source-wrangling-incremental-and-full-loadin Data Importer for ElasticSearch/Algolia

WASP is a framework to build complex real time big data applications. It relies on a kind of Kappa/Lambda architecture mainly leveraging Kafka and Spark. If you need to ingest huge amount of heterogeneous data and analyze them through complex pipelines, this is the framework for you.

Combine /kämˌbīn/ - Metadata Aggregator Platform

Dummyrdd ⭐ 24

A pure python mock of pyspark's RDD

Location Based Restaurants Recommendation System ⭐ 23

Big Data Management and Analysis Final Project

Spark_recommender ⭐ 21

Spark Recommender example

Idocuments ⭐ 20

收集与 Java 开发相关的文档，包括基础系统服务（大数据、流计算、NoSQL 等）、专业名词、jar 包、开发工具等文档，持续更新……

Eskimo is a state of the art Big Data Infrastructure and Management Web Console to build, manage and operate Big Data 2.0 Analytics clusters on Kubernetes. This is the git repository of Eskimo Community Edition.

Daf Kylo ⭐ 20

Kylo integration with PDND (previously DAF).

Offlineesindexgenerator ⭐ 19

Offline Elasticsearch index generator

Tweetsets ⭐ 19

Service for creating Twitter datasets for research and archiving.

Mapr Pcapstream ⭐ 18

An example Spark Streaming application processing PCAP data.

Jun_bigdata ⭐ 18

jun_bigdata大数据平台服务框架。实现了Kafka实时数据过滤、清洗、转换、消费，实现了Sp SQL对Redis、MongoDB等非关系型数据库的数据的读写；集成了规则引擎，可基于规则引擎实现客

Qs Hadoop ⭐ 17

大数据生态圈学习

Sparknlp Elasticsearch ⭐ 17

Twitter sentiment analysis using Spark and Stanford CoreNLP and visualization using elasticsearch and kibana

Address Index Data ⭐ 16

Kylo_docker ⭐ 16

Bigdata_learning ⭐ 16

大数据组件学习代码

Aws Emr Examples ⭐ 14

Some AWS EMR examples

Knowledge_search ⭐ 14

a graph-based knowledge search engine powered by Wikipedia

Spark Playground ⭐ 13

Playground for experimenting with Apache Spark

Bootcamp_data Engineering ⭐ 13

Bootcamp to learn basics in Data Engineering

Spark2elasticsearch ⭐ 12

Spark Library for Bulk Loading into Elasticsearch

RELK -- The Research Elastic Stack (Kafka, Beats, Zookeeper, Logstash, ElasticSearch, Kibana, Spark, & Jupyter -- All in Docker)

Screamingtwitter ⭐ 11

Using Spark Streaming to send tweets from Twitter Streaming API to Elasticsearch

Elasticsearch Prediction Spark ⭐ 11

Generates Elasticsearch plugin to score/evaluate Spark Trained Models

Reporting Apache Spark metrics to Elasticsearch

Spark Example ⭐ 11

Spark1.6和spark2.2的示例，包含kafka,flume,structuredstrea

Big Data ⭐ 10

Big data technologies

Elasticsearch Hadoop ⭐ 9

elasticsearch-hadoop connector for elassandra

Jaeger Dependencies ⭐ 9

build dependencies between services for jaeger UI

Elastic Tools ⭐ 9

Apache Spark based command line tools for ElasticSearch

Realtime parking spot recommender system and crowd-sourcing platform

Spark Csv Es ⭐ 9

Spark job to bulk load into ES spatial and temporal data.

Jaeger_exporter ⭐ 9

🌀Prometheus Opentracing Jaeger exporter based on Elasticsearch

Hbase Elasticsearch ⭐ 9

Efficiency of hbase concurrent writing, hbase synchronization to elasticsearch and elasticsearch concurrent querying.

Fast Data Examples ⭐ 8

Deploy Spark Streaming Ml ⭐ 8

빅데이터 pipeline 구성 요소 기술들에 관한 coding 실습 및 연구

Net.jgp.books.spark.ch08 ⭐ 8

Spark in Action, 2nd edition - chapter 8

Guide to Integrating Spark and Elasticsearch

Mongodb Elasticsearch Spark Etl ⭐ 7

Generic template to read MongoDB and migrate to ElasticSearch

Kse Sample ⭐ 7

This project is used for getting data from Kafka and dealing through Spark streaming and finally storing into Elasticsearch.

Kafka Spark Es ⭐ 6

Kafka spark elastic search

Read Books ⭐ 6

2017年7月参加工作以来看的书

Predictionio Docker ⭐ 6

Docker support for PredictionIO

Predictionio Docker Compose ⭐ 6

Fully working example of Apache PredictionIO and Universal Recommender in docker-compose

Smarthire ⭐ 5

SmartHire - An open source applicant prioritization system powered by machine learning

The Hunting ELK高级分析功能的漏洞挖掘平台 https://github.com/Cyb3rWard0g/HELK

Kf Portal Etl ⭐ 5

🏭 Extract-Transform-Load Pipeline for producing data for the Kids First Data Resource Portal

Spark Elasticsearch Connector ⭐ 5

A library for querying Elasticsearch with spark

Aws Oss Alternatives ⭐ 5

Open Source Alternatives to AWS Services

Related Searches

Scala Spark (3,279)

Java Elasticsearch (2,094)

Python Spark (2,053)

Elasticsearch Kibana (1,982)

Python Elasticsearch (1,920)

Javascript Elasticsearch (1,591)

Java Spark (1,587)

Docker Elasticsearch (1,535)

Apache Spark (1,207)

Spark Hadoop (1,188)

1-88 of 88 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.