Awesome Open Source

Programming Languages

Search results for metrics spark

34 search results found

Flink Learning ⭐ 13,801

flink learning blog. http://www.54tianzhisheng.cn/ 含 Flink 入门、概念、原理、实战、性能调优、源码解析等内容。涉及 Flink Connector、Metrics、Library、DataStream API、Table API & SQL 等内容的学习案例，还有 Flink 落地应用的大型项目案例（PVUV、日志存储、百亿数据实时去重、监控告警）分享。欢迎大家支持我的专栏《 Flink 实战与性能优化》

Deequ ⭐ 3,044

Deequ is a library built on top of Apache Spark for defining "unit tests for data", which measure data quality in large datasets.

Jvm Profiler ⭐ 1,717

JVM Profiler Sending Metrics to Kafka, Console Output or Custom Reporter

Digandburied ⭐ 645

挖坑与填坑

Sparkmeasure ⭐ 603

This is the development repository for sparkMeasure, a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task and stage metrics data.

Metorikku ⭐ 536

A simplified, lightweight ETL Framework based on Apache Spark

Grafana Spark Dashboards ⭐ 225

Scripts for generating Grafana dashboards for monitoring Spark jobs

Spark Metrics ⭐ 150

Spark metrics related custom classes and sinks (e.g. Prometheus)

Spark Metrics ⭐ 138

A library to expose more of Apache Spark's metrics system

The LinkedIn Fairness Toolkit (LiFT) is a Scala/Spark library that enables the measurement of fairness in large scale machine learning workflows.

Dataquality ⭐ 110

DataQuality for BigData

Distribution transparent Machine Learning experiments on Apache Spark

Spark Dashboard ⭐ 79

This repo provides the tooling and configuration for deploying an Apache Spark Performance Dashboard using containers technology.

Sparkplugins ⭐ 70

Code and examples of how to write and deploy Apache Spark Plugins with Spark 3.x. Spark plugins allow runnig custom code on the executors as they are initialized. This also allows extending the Spark metrics systems with user-provided monitoring probes.

Spark Influx Sink ⭐ 46

A Spark metrics sink that pushes to InfluxDb

Sparkoscope ⭐ 43

Enabling Spark Optimization through Cross-stack Monitoring and Visualization

Sparkprophet ⭐ 28

Sample application running fbprophet using spark

Metrics Spark Reporter ⭐ 28

Dropwizard Metrics reporter for Apache Spark

Spark Ranking Metrics ⭐ 22

Offline Recommender System Evaluation for Spark

Spark Kafka Streaming ⭐ 21

Custom Spark Kafka consumer based on Kafka SimpleConsumer API.

A general purpose metrics monitor implemented with Apache Spark. Kafka source, Elastic sink, aggregate metrics, different analysis, notifications, actions, live configuration update, missing metrics, ...

Opentsdb Spark ⭐ 17

Access OpenTSDB data from Spark

Tiledb Spark ⭐ 15

Spark interface to the TileDB storage manager

Sqlalarm ⭐ 14

Big data smart alarm by sql

Sparkmeasure ⭐ 13

This is a mirror of https://github.com/LucaCanali/sparkMeasure - sparkMeasure is a tool for performance troubleshooting of Apache Spark workloads. It simplifies the collection and analysis of Spark task metrics.

Metrics Spark Receiver ⭐ 13

Apache Spark Streaming receiver for metrics-spark-reporter

Baryon is a library for building Spark Streaming applications that consume data from Kafka.

Librato Spark ⭐ 11

Command line interface to generate sparklines of your Librato metrics

Reporting Apache Spark metrics to Elasticsearch

Spark Metrics ⭐ 11

Library to add Metrics to Spark-Java Routes

Kaltura's next generation Analytics solution based on Spark, Cassandra and Kafka

Spark Kafka Sink ⭐ 9

A Kafka metric sink for Apache Spark

Spark Python Knn ⭐ 8

Function for computing K-NN in Apache Spark

Spark Statsd ⭐ 7

A 2048 clone with analytics built on Apache Cassandra & Spark

Spark Cluster ⭐ 6

Sample spark cluster, uses systemd, ansible, centos7, influxdb, statsd, spark metrics system, spark job server and more.

Bus Capstone ⭐ 6

MTA bus reliability metrics and data quality assessment for SIRI - Bus Time API data.

Botkop Telcotraffic Spark ⭐ 6

Spark streaming event processor for simulated telco traffic

Apache Spark Monitoring Extension ⭐ 6

AppDynamics Machine Agent Extension for use with Apache Spark

Docker_spark_history_ui ⭐ 5

A dockerised version of the spark history server which enables us to access metrics in the spark ui from a log generated by AWS glue

Related Searches

Scala Spark (3,279)

Python Metrics (2,851)

Metrics Prometheus (2,325)

Golang Metrics (2,192)

Python Spark (2,053)

Java Spark (1,587)

Javascript Metrics (1,527)

Java Metrics (1,461)

Metrics Monitoring (1,217)

Apache Spark (1,207)

1-34 of 34 search results

Privacy | About | Terms | Follow Us On Twitter

Copyright 2018-2024 Awesome Open Source. All rights reserved.