kubernetes之prometheus kube-controller-manager。 scheduler报错问题

项目场景：

prometheus scheduler及kube-controller-manager监控报错

问题描述

在这里插入图片描述

kubeadm搭建完kube-prometheus 会有这个报错

原因分析：

root@master2:~# kubectl describe servicemonitor -n kube-system kube-controller-manager

在这里插入图片描述

通过以上图片我们发现 k8s会去 kube-system 下的svc里找带有 app.kubernetes.io/name标签的svc

root@master2:~# kubectl get svc -n kube-system -l app.kubernetes.io/name=kube-controller-manager
No resources found in monitoring namespace.
这里并没有这个标签

解决方案：

1）我们需要把监听地址改成0.0.0.0

我们这里是kubeadm安装的 修改完这个文件 即可生效, 所有master节点都要配置
- --bind-address=127.0.0.1改为- --bind-address=0.0.0.0


root@master2:~# vim /etc/kubernetes/manifests/kube-controller-manager.yaml
    - --authorization-kubeconfig=/etc/kubernetes/controller-manager.conf
    - --bind-address=0.0.0.0
    - --client-ca-file=/etc/kubernetes/pki/ca.crt
...

2）把符合标签的svc创建出来

apiVersion: v1
kind: Endpoints
metadata:
  annotations:
    app.kubernetes.io/name: kube-controller-manager
  name: kube-controller-manager-monitoring
  namespace: kube-system
subsets:
- addresses:
  - ip: 192.168.1.27
  - ip: 192.168.1.28
  - ip: 192.168.1.29

  ports:
  - name: https-metrics
    port: 10257
    protocol: TCP
---
apiVersion: v1
kind: Service
metadata:
  labels:
    app.kubernetes.io/name: kube-controller-manager
  name: kube-controller-manager-monitoring
  namespace: kube-system
spec:
  ports:
  - name: https-metrics
    port: 10257
    protocol: TCP
    targetPort: 10257
  sessionAffinity: None
  type: ClusterIP