ganglia3.6.1+jmxtrans+strom-0.9.4集成

1、安装ganglia参考之前的一篇博客（以下示例使用ganglia组播方式，单播方式大家自己尝试）

http://chengyanbin.blog.51cto.com/3900113/1591373

2、安装jmxtrans

http://chengyanbin.blog.51cto.com/3900113/1654754

3、安装storm

http://chengyanbin.blog.51cto.com/3900113/1654757

4、修改storm配置文件storm..yaml

###nimbus config
 nimbus.childopts: "-verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=12345 -Xmx1024m"

###supervisor config
 supervisor.childopts: "-verbose:gc -XX:+PrintGCTimeStamps -XX:+PrintGCDetails -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.port=12346 -Xmx256m"

5、为jmxtrans增加两个json文件

分别获取nimbus和supervisor节点的jvm信息，以下文件仅列举了部分参数，如果有需要可以增加queries中的数据，以监控更多的参数，具体的MBean的参数，可以通过jconsole来查看

nimbus.json

{
    "servers": [
        {
        		"host": "master",
            "port": "12345",
            "queries": [
                {
                    "outputWriters": [
                        {
                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",
                            "settings": {
                                "groupName": "nimbus",
                                "host": "239.2.11.71",
                                "port": "8649"
                            }
                        }
                    ],
                    "obj": "java.lang:type=Memory",
                    "resultAlias": "nimbus.heap",
                    "attr": [
                        "ObjectPendingFinalizationCount"
                    ]
                },
                {
                    "outputWriters": [
                        {
                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",
                            "settings": {
                                "groupName": "nimbus",
                                "host": "239.2.11.71",
                                "port": "8649"
                            }
                        }
                    ],
                    "obj": "java.lang:name=Copy,type=GarbageCollector",
                    "resultAlias": "nimbus.gc",
                    "attr": [
                        "CollectionCount",
                        "CollectionTime"
                    ]
                },
                {
                    "outputWriters": [
                        {
                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",
                            "settings": {
                                "groupName": "nimbus",
                                "host": "239.2.11.71",
                                "port": "8649"
                            }
                        }
                    ],
                    "obj": "java.lang:name=Code Cache,type=MemoryPool",
                    "resultAlias": "nimbus.threads",
                    "attr": [
                        "CollectionUsageThreshold",
                        "CollectionUsageThresholdCount",
                        "UsageThreshold",
                        "UsageThresholdCount"
                    ]
                },
                {
                    "outputWriters": [
                        {
                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",
                            "settings": {
                                "groupName": "nimbus",
                                "host": "239.2.11.71",
                                "port": "8649"
                            }
                        }
                    ],
                    "obj": "java.lang:type=Runtime",
                    "resultAlias": "nimbus.runtime",
                    "attr": [
                        "StartTime",
                        "Uptime"
                    ]
                }
            ],
            "numQueryThreads": 2
        }
    ]
}

supervisor.json

{
    "servers": [
        {
        		"host": "node1",
            "port": "12346",
            "queries": [
                {
                    "outputWriters": [
                        {
                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",
                            "settings": {
                                "groupName": "supervisor",
                                "host": "239.2.11.71",
                                "port": "8649"
                            }
                        }
                    ],
                    "obj": "java.lang:type=Memory",
                    "resultAlias": "supervisor.heap",
                    "attr": [
                        "ObjectPendingFinalizationCount"
                    ]
                },
                {
                    "outputWriters": [
                        {
                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",
                            "settings": {
                                "groupName": "supervisor",
                                "host": "239.2.11.71",
                                "port": "8649"
                            }
                        }
                    ],
                    "obj": "java.lang:name=Copy,type=GarbageCollector",
                    "resultAlias": "supervisor.gc",
                    "attr": [
                        "CollectionCount",
                        "CollectionTime"
                    ]
                },
                {
                    "outputWriters": [
                        {
                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",
                            "settings": {
                                "groupName": "supervisor",
                                "host": "239.2.11.71",
                                "port": "8649"
                            }
                        }
                    ],
                    "obj": "java.lang:name=Code Cache,type=MemoryPool",
                    "resultAlias": "supervisor.threads",
                    "attr": [
                        "CollectionUsageThreshold",
                        "CollectionUsageThresholdCount",
                        "UsageThreshold",
                        "UsageThresholdCount"
                    ]
                },
                {
                    "outputWriters": [
                        {
                            "@class": "com.googlecode.jmxtrans.model.output.GangliaWriter",
                            "settings": {
                                "groupName": "supervisor",
                                "host": "239.2.11.71",
                                "port": "8649"
                            }
                        }
                    ],
                    "obj": "java.lang:type=Runtime",
                    "resultAlias": "supervisor.runtime",
                    "attr": [
                        "StartTime",
                        "Uptime"
                    ]
                }
            ],
            "numQueryThreads": 2
        }
    ]
}

两个json文件一定要注意host是主机名，如果写ip的话，在ganglia里同一个节点会有两个显示，看着有点别扭，大家都统一使用hostname就好.ganglia的gmnod和gmetad不需要重启，用自动收集。

说明：

    修改json文件需要重新启动jmxtrans,查看jmxtrans日志/var/log/jmxtrans/jmxtrans.log.

    service jmxtrans restart

下面来张ganglia的主界面，监控两个节点

上图显示不出来监控指标，就放下面来了，可以看到supervisor的监控数据已经收集到ganglia里了。

下图搞了master节点的页面，可以看到nimbus group的监控数据已经显示，node1节点的supervisor group懒得上图了，大家可以明白了，不明白的去面壁去