Kubernetes-dashboard+Heapster+InfluxDB+Grafana的示例分析

这篇文章将为大家详细讲解有关Kubernetes-dashboard+Heapster+InfluxDB+Grafana的示例分析，小编觉得挺实用的，因此分享给大家做个参考，希望大家阅读完这篇文章后可以有所收获。

一：前言

1.kubernetes-dashboard 官方提供的用户管理Kubernets集群可视化工具

2.cAdvisor是用于监控容器运行状态的利器之一。在kubernetes系统中，cAdvisor已经被默认集成到了kubelet组件内，当kubelet服务启动时，它会自动启动cAdvisor服务，然后cAdvisor会实时采集所在节点的性能指标及节点上运行的容器的性能指标。cAdvisor主页显示了主机的实时运行状态，包括CPU使用情况、内存使用情况、网络吞吐量及文件系统使用情况等信息。但是cAdvisor只提供了单机的容器资源占用情况，而在大规模容器集群中，需要对所有的Node和全部容器进行性能监控。这就需要一套工具来实现集群性能数据的采集、存储和展示。

3.Heapster 提供整个集群的资源监控，并支持持久化数据存储到InfluxDB或者其他的存储后端。Heapster从kubelet提供的API采集节点和容器的资源占用。另外，Heapster的 /metrics API提供了Prometheus格式的数据。

4.InfluxDB是一个开源分布式时序、事件和指标数据库。

5.Grafana是一个开源仪表盘工具，它可用于Graphite、InfluxDB与 OpenTSDB 一起使用。最新的版本还可以用于其他的数据源，比如Elasticsearch。（与heapster与Prometheus均可集成）

6.Zabbix是一个基于WEB界面的提供分布式系统监视以及网络监视功能的企业级的开源解决方案.多用于传统（非微服务）分布式系统的监控。

7.Prometheus 容器时代的产物。集成采集、存储（支持多种时序数据库）、页面展示与一体的监控工具。

监控方案：
a.Heapster+InfluxDB+Grafana
b.Prometheus

二：安装
1.镜像
k8s.gcr.io/kubernetes-dashboard-amd64：v1.8.2
gcr.io/google_containers/heapster-amd64：v1.4.2
gcr.io/google_containers/heapster-influxdb-amd64：v1.3.3 
gcr.io/google_containers/heapster-grafana-amd64：v4.4.3

2.yaml文件


admin-user.yaml(不需修改)

点击(此处)折叠或打开

1. apiVersion: v1
   

2. kind: ServiceAccount
   

3. metadata:
   

4.   name: admin-user
   

5.   namespace: kube-system
   

6. ---
   

7. apiVersion: rbac.authorization.k8s.io/v1
   

8. kind: ClusterRoleBinding
   

9. metadata:
   

10.   name: admin-user
    

11. roleRef:
    

12.   apiGroup: rbac.authorization.k8s.io
    

13.   kind: ClusterRole
    

14.   name: cluster-admin
    

15. subjects:
    

16. - kind: ServiceAccount
    

17.   name: admin-user
    

18.   namespace: kube-system

dashboard.yaml(橙色标示是修改的地方。特别说明当前版本需要添加 - --heapster-host=http://heapster 配置，否则无法正常获取metrics )

点击(此处)折叠或打开

1. # Copyright 2017 The Kubernetes Authors.
   

2. #
   

3. # Licensed under the Apache License, Version 2.0 (the "License");
   

4. # you may not use this file except in compliance with the License.
   

5. # You may obtain a copy of the License at
   

6. #
   

7. #     http://www.apache.org/licenses/LICENSE-2.0
   

8. #
   

9. # Unless required by applicable law or agreed to in writing, software
   

10. # distributed under the License is distributed on an "AS IS" BASIS,
    

11. # WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
    

12. # See the License for the specific language governing permissions and
    

13. # limitations under the License.
    

14. 
    

15. # Configuration to deploy release version of the Dashboard UI compatible with
    

16. # Kubernetes 1.8.
    

17. #
    

18. # Example usage: kubectl create -f
    

19. 
    

20. # ------------------- Dashboard Secret ------------------- #
    

21. 
    

22. apiVersion: v1
    

23. kind: Secret
    

24. metadata:
    

25.   labels:
    

26.     k8s-app: kubernetes-dashboard
    

27.   name: kubernetes-dashboard-certs
    

28.   namespace: kube-system
    

29. type: Opaque
    

30. 
    

31. ---
    

32. # ------------------- Dashboard Service Account ------------------- #
    

33. 
    

34. apiVersion: v1
    

35. kind: ServiceAccount
    

36. metadata:
    

37.   labels:
    

38.     k8s-app: kubernetes-dashboard
    

39.   name: kubernetes-dashboard
    

40.   namespace: kube-system
    

41. 
    

42. ---
    

43. # ------------------- Dashboard Role & Role Binding ------------------- #
    

44. 
    

45. kind: Role
    

46. apiVersion: rbac.authorization.k8s.io/v1
    

47. metadata:
    

48.   name: kubernetes-dashboard-minimal
    

49.   namespace: kube-system
    

50. rules:
    

51.   # Allow Dashboard to create 'kubernetes-dashboard-key-holder' secret.
    

52. - apiGroups: [""]
    

53.   resources: ["secrets"]
    

54.   verbs: ["create"]
    

55.   # Allow Dashboard to create 'kubernetes-dashboard-settings' config map.
    

56. - apiGroups: [""]
    

57.   resources: ["configmaps"]
    

58.   verbs: ["create"]
    

59.   # Allow Dashboard to get, update and delete Dashboard exclusive secrets.
    

60. - apiGroups: [""]
    

61.   resources: ["secrets"]
    

62.   resourceNames: ["kubernetes-dashboard-key-holder", "kubernetes-dashboard-certs"]
    

63.   verbs: ["get", "update", "delete"]
    

64.   # Allow Dashboard to get and update 'kubernetes-dashboard-settings' config map.
    

65. - apiGroups: [""]
    

66.   resources: ["configmaps"]
    

67.   resourceNames: ["kubernetes-dashboard-settings"]
    

68.   verbs: ["get", "update"]
    

69.   # Allow Dashboard to get metrics from heapster.
    

70. - apiGroups: [""]
    

71.   resources: ["services"]
    

72.   resourceNames: ["heapster"]
    

73.   verbs: ["proxy"]
    

74. - apiGroups: [""]
    

75.   resources: ["services/proxy"]
    

76.   resourceNames: ["heapster", "http:heapster:", "https:heapster:"]
    

77.   verbs: ["get"]
    

78. 
    

79. ---
    

80. apiVersion: rbac.authorization.k8s.io/v1
    

81. kind: RoleBinding
    

82. metadata:
    

83.   name: kubernetes-dashboard-minimal
    

84.   namespace: kube-system
    

85. roleRef:
    

86.   apiGroup: rbac.authorization.k8s.io
    

87.   kind: Role
    

88.   name: kubernetes-dashboard-minimal
    

89. subjects:
    

90. - kind: ServiceAccount
    

91.   name: kubernetes-dashboard
    

92.   namespace: kube-system
    

93. 
    

94. ---
    

95. # ------------------- Dashboard Deployment ------------------- #
    

96. 
    

97. kind: Deployment
    

98. apiVersion: apps/v1beta2
    

99. metadata:
    

100.   labels:
     

101.     k8s-app: kubernetes-dashboard
     

102.   name: kubernetes-dashboard
     

103.   namespace: kube-system
     

104. spec:
     

105.   replicas: 1
     

106.   revisionHistoryLimit: 10
     

107.   selector:
     

108.     matchLabels:
     

109.       k8s-app: kubernetes-dashboard
     

110.   template:
     

111.     metadata:
     

112.       labels:
     

113.         k8s-app: kubernetes-dashboard
     

114.     spec:
     

115.       containers:
     

116.       - name: kubernetes-dashboard
     

117.         image: k8s.gcr.io/kubernetes-dashboard-amd64:v1.8.2
     

118.         ports:
     

119.         - containerPort: 8443
     

120.           protocol: TCP
     

121.         args:
     

122.           - --auto-generate-certificates
     

123.           # Uncomment the following line to manually specify Kubernetes API server Host
     

124.           # If not specified, Dashboard will attempt to auto discover the API server and connect
     

125.           # to it. Uncomment only if the default does not work.
     

126.           # - --apiserver-host=http://my-address:port
     

127.           - --heapster-host=http://heapster
     

128.         volumeMounts:
     

129.         - name: kubernetes-dashboard-certs
     

130.           mountPath: /certs
     

131.           # Create on-disk volume to store exec logs
     

132.         - mountPath: /tmp
     

133.           name: tmp-volume
     

134.         livenessProbe:
     

135.           httpGet:
     

136.             scheme: HTTPS
     

137.             path: /
     

138.             port: 8443
     

139.           initialDelaySeconds: 30
     

140.           timeoutSeconds: 30
     

141.       volumes:
     

142.       - name: kubernetes-dashboard-certs
     

143.         secret:
     

144.           secretName: kubernetes-dashboard-certs
     

145.       - name: tmp-volume
     

146.         emptyDir: {}
     

147.       serviceAccountName: kubernetes-dashboard
     

148.       # Comment the following tolerations if Dashboard must not be deployed on master
     

149.       tolerations:
     

150.       - key: node-role.kubernetes.io/master
     

151.         effect: NoSchedule
     

152. 
     

153. ---
     

154. # ------------------- Dashboard Service ------------------- #
     

155. 
     

156. kind: Service
     

157. apiVersion: v1
     

158. metadata:
     

159.   labels:
     

160.     k8s-app: kubernetes-dashboard
     

161.   name: kubernetes-dashboard
     

162.   namespace: kube-system
     

163. spec:
     

164.   type: NodePort
     

165.   ports:
     

166.     - port: 443
     

167.       targetPort: 8443
     

168.       nodePort: 32666
     

169.   selector:
     

170.     k8s-app: kubernetes-dashboard

grafana.yaml(橙色标示为需要修改的地方)

点击(此处)折叠或打开

1. apiVersion: extensions/v1beta1
   

2. kind: Deployment
   

3. metadata:
   

4.   name: monitoring-grafana
   

5.   namespace: kube-system
   

6. spec:
   

7.   replicas: 1
   

8.   template:
   

9.     metadata:
   

10.       labels:
    

11.         task: monitoring
    

12.         k8s-app: grafana
    

13.     spec:
    

14.       containers:
    

15.       - name: grafana
    

16.         image: gcr.io/google_containers/heapster-grafana-amd64:v4.4.3
    

17.         ports:
    

18.         - containerPort: 3000
    

19.           protocol: TCP
    

20.         volumeMounts:
    

21.         - mountPath: /etc/ssl/certs
    

22.           name: ca-certificates
    

23.           readOnly: true
    

24.         - mountPath: /var
    

25.           name: grafana-storage
    

26.         env:
    

27.         - name: INFLUXDB_HOST
    

28.           value: monitoring-influxdb
    

29.         - name: GF_SERVER_HTTP_PORT
    

30.           value: "3000"
    

31.           # The following env variables are required to make Grafana accessible via
    

32.           # the kubernetes api-server proxy. On production clusters, we recommend
    

33.           # removing these env variables, setup auth for grafana, and expose the grafana
    

34.           # service using a LoadBalancer or a public IP.
    

35.         - name: GF_AUTH_BASIC_ENABLED
    

36.           value: "false"
    

37.         - name: GF_AUTH_ANONYMOUS_ENABLED
    

38.           value: "true"
    

39.         - name: GF_AUTH_ANONYMOUS_ORG_ROLE
    

40.           value: Admin
    

41.         - name: GF_SERVER_ROOT_URL
    

42.           # If you're only using the API Server proxy, set this value instead:
    

43.           # value: /api/v1/namespaces/kube-system/services/monitoring-grafana/proxy
    

44.           value: /
    

45.       volumes:
    

46.       - name: ca-certificates
    

47.         hostPath:
    

48.           path: /etc/ssl/certs
    

49.       - name: grafana-storage
    

50.         emptyDir: {}
    

51. ---
    

52. apiVersion: v1
    

53. kind: Service
    

54. metadata:
    

55.   labels:
    

56.     # For use as a Cluster add-on (https://github.com/kubernetes/kubernetes/tree/master/cluster/addons)
    

57.     # If you are NOT using this as an addon, you should comment out this line.
    

58.     kubernetes.io/cluster-service: 'true

heapster-rbac.yaml（不需要修改）

点击(此处)折叠或打开

1. kind: ClusterRoleBinding
   

2. apiVersion: rbac.authorization.k8s.io/v1beta1
   

3. metadata:
   

4.   name: heapster
   

5. roleRef:
   

6.   apiGroup: rbac.authorization.k8s.io
   

7.   kind: ClusterRole
   

8.   name: system:heapster
   

9. subjects:
   

10. - kind: ServiceAccount
    

11.   name: heapster
    

12.   namespace: kube-system

heapster.yaml（橙色标示为需要修改的地方）

点击(此处)折叠或打开

1. apiVersion: v1
   

2. kind: ServiceAccount
   

3. metadata:
   

4.   name: heapster
   

5.   namespace: kube-system
   

6. ---
   

7. apiVersion: extensions/v1beta1
   

8. kind: Deployment
   

9. metadata:
   

10.   name: heapster
    

11.   namespace: kube-system
    

12. spec:
    

13.   replicas: 1
    

14.   template:
    

15.     metadata:
    

16.       labels:
    

17.         task: monitoring
    

18.         k8s-app: heapster
    

19.     spec:
    

20.       serviceAccountName: heapster
    

21.       containers:
    

22.       - name: heapster
    

23.         image: gcr.io/google_containers/heapster-amd64:v1.4.2
    

24.         imagePullPolicy: IfNotPresent
    

25.         command:
    

26.         - /heapster
    

27.         - --source=kubernetes:https://10.116.137.196:6443
    

28.         - --sink=influxdb:http://monitoring-influxdb.kube-system.svc:8086
    

29. ---
    

30. apiVersion: v1
    

31. kind: Service
    

32. metadata:
    

33.   labels:
    

34.     task: monitoring
    

35.     # For use as a Cluster add-on (https://github.com/kubernetes/kubernetes/tree/master/cluster/addons)
    

36.     # If you are NOT using this as an addon, you should comment out this line.
    

37.     kubernetes.io/cluster-service: 'true'
    

38.     kubernetes.io/name: Heapster
    

39.   name: heapster
    

40.   namespace: kube-system
    

41. spec:
    

42.   ports:
    

43.   - port: 80
    

44.     targetPort: 8082
    

45.   selector:
    

46.     k8s-app: heapster

influxdb.yaml（橙色标示为需要修改的地方）

点击(此处)折叠或打开

1. apiVersion: extensions/v1beta1
   

2. kind: Deployment
   

3. metadata:
   

4.   name: monitoring-influxdb
   

5.   namespace: kube-system
   

6. spec:
   

7.   replicas: 1
   

8.   template:
   

9.     metadata:
   

10.       labels:
    

11.         task: monitoring
    

12.         k8s-app: influxdb
    

13.     spec:
    

14.       containers:
    

15.       - name: influxdb
    

16.         image: gcr.io/google_containers/heapster-influxdb-amd64:v1.3.3
    

17.         volumeMounts:
    

18.         - mountPath: /data
    

19.           name: influxdb-storage
    

20.       volumes:
    

21.       - name: influxdb-storage
    

22.         emptyDir: {}
    

23. ---
    

24. apiVersion: v1
    

25. kind: Service
    

26. metadata:
    

27.   labels:
    

28.     task: monitoring
    

29.     # For use as a Cluster add-on (https://github.com/kubernetes/kubernetes/tree/master/cluster/addons)
    

30.     # If you are NOT using this as an addon, you should comment out this line.
    

31.     kubernetes.io/cluster-service: 'true'
    

32.     kubernetes.io/name: monitoring-influxdb
    

33.   name: monitoring-influxdb
    

34.   namespace: kube-system
    

35. spec:
    

36.   ports:
    

37.   - port: 8086
    

38.     targetPort: 8086
    

39.   selector:
    

40.     k8s-app: influxdb

dashboard.yaml 文件源于https://raw.githubusercontent.com/kubernetes/dashboard/master/src/deploy/recommended/kubernetes-dashboard.yaml

其他yaml.文件源于
https://codeload.github.com/kubernetes/heapster/zip/v1.4.2  下载后解压缩  位于目录\deploy\kube-config\influxdb

3.创建相关资源
执行命令：
kubectl create -f admin-user.yaml -f dashboard.yaml -f grafana.yaml -f heapster-rbac.yaml -f heapster.yaml -f influxdb.yaml
查看创建状态：
kubectl get pods --all-namespaces

三：访问
建议使用Firefox浏览器访问https://nodeIp:32666



选择使用令牌登录的方式，  生成令牌的命令如下（请保存好生成的Token）：

点击(此处)折叠或打开

1. kubectl -n kube-system describe secret $(kubectl -n kube-system get secret | grep admin-user | awk '{print $1}') | grep token

成功登录后的页面：

关于“Kubernetes-dashboard+Heapster+InfluxDB+Grafana的示例分析”这篇文章就分享到这里了，希望以上内容可以对大家有一定的帮助，使各位可以学到更多知识，如果觉得文章不错，请把它分享出去让更多的人看到。