Jmx_exporter Cloudera Hadoop
Prometheus jmx_exporter configurations for Cloudera Hadoop
| Project Name | Stars | Downloads | Repos Using This | Packages Using This | Most Recent Commit | Total Releases | Latest Release | Open Issues | License | Language |
|---|---|---|---|---|---|---|---|---|---|---|
| Haproxy Configs | 198 | 3 months ago | mit | Shell | ||||||
| 80+ HAProxy Configs for Hadoop, Big Data, NoSQL, Docker, Kubernetes, Elasticsearch, SolrCloud, HBase, MySQL, PostgreSQL, Apache Drill, Hive, Presto, Impala, Hue, ZooKeeper, SSH, RabbitMQ, Redis, Riak, Cloudera, OpenTSDB, InfluxDB, Prometheus, Kibana, Graphite, Rancher etc. | ||||||||||
| Hadoop Hdfs Fsimage Exporter | 130 | 4 days ago | 11 | December 18, 2022 | 10 | apache-2.0 | Java | |||
| Exports Hadoop HDFS content statistics to Prometheus | ||||||||||
| Hadoop_exporter | 46 | 4 years ago | June 05, 2021 | 10 | apache-2.0 | Go | ||||
| Hadoop exporter | ||||||||||
| Yarn Prometheus Exporter | 39 | 2 years ago | mit | Go | ||||||
| Export Hadoop YARN (resource-manager) metrics in prometheus format | ||||||||||
| Hadoop_exporter | 35 | 3 years ago | 3 | Python | ||||||
| A hadoop exporter for prometheus, scrape hadoop metrics (including HDFS, YARN, MAPREDUCE, HBASE. etc.) from hadoop components jmx url. | ||||||||||
| Hadoop_jmx_exporter | 23 | 2 years ago | 1 | Python | ||||||
| HDFS & YARN jmx metrics prometheus exporter | ||||||||||
| Idocuments | 20 | a year ago | 4 | |||||||
| 收集与 Java 开发相关的文档，包括基础系统服务（大数据、流计算、NoSQL 等）、专业名词、jar 包、开发工具等文档，持续更新…… | ||||||||||
| Ambaribasedhadoopexporter | 20 | 4 months ago | 6 | mit | C# | |||||
| Exporter based on Hadoop clusters that use Ambari as their administrative tool, leveraging Ambari API to export cluster's metrics. | ||||||||||
| Flink Service Discovery | 17 | 5 years ago | Python | |||||||
| Discover Flink clusters on Hadoop YARN for Prometheus | ||||||||||
| Jmx_exporter Cloudera Hadoop | 17 | 6 years ago | mit | |||||||
| Prometheus jmx_exporter configurations for Cloudera Hadoop | ||||||||||
Alternatives To Jmx_exporter Cloudera HadoopSelect To Compare
Alternative Project Comparisons
Readme
jmx_exporter-cloudera-hadoop
Prometheus jmx_exporter configurations for Cloudera Hadoop.
Cloudera Hadoop Metrics
For Cloudera Hadoop I enabled jmxremote for each service via the extra java options and used jmxterm to get all beans I needed. Don't forget to remove the jmxremote settings after you are finished.
Exporter ports and configuration files
The table is sorted alphabetically by service name.
| Service | Role | Impl. progress | JMX port | Exporter port | Configuration file |
|---|---|---|---|---|---|
| HDFS | NameNode | ✓ | 18000 | 19000 | cdh-hdfs-namenode.yaml |
| HDFS | SecondaryNameNode | ✓ | 18001 | 19001 | cdh-hdfs-secondarynamenode.yaml |
| HDFS | JournalNode | 0% | 18002 | 19002 | cdh-hdfs-journalnode.yaml |
| HDFS | Failover Controller | 0% | 18003 | 19003 | cdh-hdfs-failover-controller.yaml |
| HDFS | HttpFS | 0% | 18004 | 19004 | cdh-hdfs-httpfs.yaml |
| HDFS | Balancer | 0% | 18005 | 19005 | cdh-hdfs-balancer.yaml |
| HDFS | NFS Gateway | 0% | 18006 | 19006 | cdh-hdfs-nfs-gateway.yaml |
| HDFS | DataNode | ✓ | 18007 | 19007 | cdh-hdfs-datanode.yaml |
| Hive | HiveServer2 | 0% | 18020 | 19020 | cdh-hive-hiveserver2.yaml |
| Hive | Hive Metastore Server | 0% | 18021 | 19021 | cdh-hive-metastore-server.yaml |
| Hive | WebHCat Server | 0% | 18022 | 19022 | cdh-hive-webhcat-server.yaml |
| Hue | Hue Server | 0% | 18040 | 19040 | cdh-hue-server.yaml |
| Hue | Kerberos Ticket Renewer | 0% | 18041 | 19041 | cdh-hue-kerberos-ticket-renewer.yaml |
| Hue | Loadbalancer | 0% | 18042 | 19042 | cdh-hue-loadbalancer.yaml |
| Kafka | Kafka Broker | 0% | 18090 | 19090 | cdh-kafka-broker.yaml |
| Kafka | Kafka MirrorMaker | 0% | 18091 | 19091 | cdh-kafka-mirrormaker.yaml |
| Oozie | Oozie Server | 0% | 18050 | 19050 | cdh-oozie-server.yaml |
| Sentry | Sentry Server | 0% | 18060 | 19060 | cdh-sentry-server.yaml |
| Solr | Solr Server | 0% | 18100 | 19100 | cdh-solr-server.yaml |
| Spark | History Server | 0% | 18070 | 19070 | cdh-spark-history-server.yaml |
| Spark 2 | History Server | 0% | 18080 | 19080 | cdh-spark2-history-server.yaml |
| YARN | ResourceManager | 0% | 18010 | 19010 | cdh-yarn-resourcemanager.yaml |
| YARN | JobHistory Server | 0% | 18011 | 19011 | cdh-yarn-jobhistory-server.yaml |
| YARN | NodeManager | 0% | 18012 | 19012 | cdh-yarn-nodemanager.yaml |
| ZooKeeper | Server | 0% | 18030 | 19030 | cdh-zookeeper-server.yaml |
JMX configuration for getting MBeans
Enable jmxremote
Example for configuring the DataNode:
HADOOP_DATANODE_OPTS=<DEFAULT OPTIONS PROVIDED BY CLOUDERA> \
-Dcom.sun.management.jmxremote \
-Dcom.sun.management.jmxremote.port=18007 \
-Dcom.sun.management.jmxremote.local.only=true \
-Dcom.sun.management.jmxremote.authenticate=false \
-Dcom.sun.management.jmxremote.ssl=false
Get MBeans with jmxterm
$ java -jar jmxterm.jar --url localhost:18007
$>beans
#domain = Hadoop:
Hadoop:name=DataNodeInfo,service=DataNode
Hadoop:name=UgiMetrics,service=DataNode
Hadoop:name=JvmMetrics,service=DataNode
Hadoop:name=MetricsSystem,service=DataNode,sub=Control
Hadoop:name=MetricsSystem,service=DataNode,sub=Stats
Hadoop:name=RpcActivityForPort50020,service=DataNode
Hadoop:name=RpcDetailedActivityForPort50020,service=DataNode
....
Popular Hadoop Projects
Popular Prometheus Projects
Popular Data Processing Categories
Related Searches
Get A Weekly Email With Trending Projects For These Categories
No Spam. Unsubscribe easily at any time.
Kafka
Prometheus
Hadoop
Hive
Hdfs
Hue
Prometheus Exporter
Jmx