k8s集中部署prometheus 安装node-exporter组件，在k8s集的master1节点操作
cat >node-export.yaml  <<EOF
apiVersion: apps/v1
kind: DaemonSet
metadata:
name: node-exporter
namespace: monitor-sa
labels:
name: node-exporter
spec:
selector:
matchLabels:
name: node-exporter
template:
metadata:
labels:
name: node-exporter
spec:
hostPID: true
hostIPC: true
hostNetwork: true
containers:
-
name: node-exporter
image: prom/node-exporter:v0.16.0
ports:
- containerPort: 9100
resources:
requests:
cpu: 0.15
securityContext:
privileged: true
args:
- --path.procfs
-
/host/proc
- --path.sysfs
- /host/sys
- --collector.filesystem.ignored-mount-points
- '"^/(sys|proc|dev|host|etc)($|/)"'
volumeMounts:
- name: dev
mountPath: /host/dev
- name: proc
mountPath: /host/proc
- name: sys
mountPath: /host/sys
- name: rootfs
mountPath: /rootfs
tolerations:
- key: "node-role.kubernetes.io/master"
operator: "Exists"
effect: "NoSchedule"
volumes:
- name: proc
hostPath:
path: /proc
-
name: dev
hostPath:
path: /dev
- name: sys
hostPath:
path: /sys
path: /sys
- name: rootfs
hostPath:
path: /
EOF
#通过kubectl apply更新node-exporter
kubectl apply -f node-export.yaml
#查看node-exporter是否部署成功
kubectl get pods -n monitor-sa
显⽰如下，看到pod的状态都是running，说明部署成功
NAME                  READY  STATUS    RESTARTS  AGE
node-exporter-9qpkd  1/1    Running  0          89s
node-exporter-zqmnk  1/1    Running  0          89s
通过node-exporter采集数据
k8s集中部署prometheus
1.创建namespace、sa账号，在k8s集的master节点操作
#创建⼀个monitor-sa的名称空间
kubectl create ns monitor-sa
#创建⼀个sa账号
kubectl create serviceaccount monitor -n monitor-sa
#把sa账号monitor通过clusterrolebing绑定到clusterrole上
kubectl create clusterrolebinding monitor-clusterrolebinding -n monitor-sa --clusterrole=cluster-admin  --serviceaccount=monitor-sa:monitor
2.创建数据⽬录
#在k8s集的任何⼀个node节点操作，因为我的k8s集只有⼀个node节点node1，所以我在node1上操作如下命令：
mkdir /data
chmod 777 /data/
3.安装prometheus，以下步骤均在在k8s集的master1节点操作
1)创建⼀个configmap存储卷，⽤来存放prometheus配置信息
nodeselector
cat  >prometheus-cfg.yaml <<EOF
---
kind: ConfigMap
apiVersion: v1
metadata:
labels:
app: prometheus
name: prometheus-config
namespace: monitor-sa
data:
global:
scrape_interval: 15s
scrape_interval: 15s
scrape_timeout: 10s
evaluation_interval: 1m
scrape_configs:
- job_name: 'kubernetes-node'
kubernetes_sd_configs:
- role: node
relabel_configs:
- source_labels: [__address__]
regex: '(.*):10250'
replacement: '${1}:9100'
target_label: __address__
action: replace
- action: labelmap
regex: __meta_kubernetes_node_label_(.+)
- job_name: 'kubernetes-node-cadvisor'
kubernetes_sd_configs:
- role:  node
scheme: https
tls_config:
ca_file: /var/run/secrets/kubernetes.io/
bearer_token_file: /var/run/secrets/kubernetes.io/serviceaccount/token
relabel_configs:
- action: labelmap
regex: __meta_kubernetes_node_label_(.+)
- target_label: __address__
replacement: kubernetes.default.svc:443
- source_labels: [__meta_kubernetes_node_name]
regex: (.+)
target_label: __metrics_path__
replacement: /api/v1/nodes/${1}/proxy/metrics/cadvisor
- job_name: 'kubernetes-apiserver'
kubernetes_sd_configs:
- role: endpoints
scheme: https
tls_config:
ca_file: /var/run/secrets/kubernetes.io/
bearer_token_file: /var/run/secrets/kubernetes.io/serviceaccount/token
relabel_configs:
- source_labels: [__meta_kubernetes_namespace, __meta_kubernetes_service_name, __meta_kubernetes_endpoint_port_name]        action: keep
regex: default;kubernetes;https
- job_name: 'kubernetes-service-endpoints'
kubernetes_sd_configs:
- role: endpoints
relabel_configs:
- source_labels: [__meta_kubernetes_service_annotation_prometheus_io_scrape]
action: keep
regex: true
- source_labels: [__meta_kubernetes_service_annotation_prometheus_io_scheme]
action: replace
target_label: __scheme__
regex: (https?)
- source_labels: [__meta_kubernetes_service_annotation_prometheus_io_path]
action: replace
target_label: __metrics_path__
regex: (.+)
- source_labels: [__address__, __meta_kubernetes_service_annotation_prometheus_io_port]
action: replace
target_label: __address__
regex: ([^:]+)(?::\d+)?;(\d+)
replacement: $1:$2
- action: labelmap
regex: __meta_kubernetes_service_label_(.+)
- source_labels: [__meta_kubernetes_namespace]
action: replace
action: replace
target_label: kubernetes_namespace
- source_labels: [__meta_kubernetes_service_name]
action: replace
target_label: kubernetes_name
EOF
注意：通过上⾯命令⽣成的promtheus-cfg.yaml⽂件会有⼀些问题，$1和$2这种变量在⽂件⾥没有，需要在k8s的master1节点打开promtheus-cfg.yaml⽂件，⼿动把$1和$2这种变量写进⽂件⾥，promtheus-cfg.yaml⽂件需要⼿动修改部分如下：
22⾏的replacement: ':9100'变成replacement: '${1}:9100'
42⾏的replacement: /api/v1/nodes//proxy/metrics/cadvisor变成  replacement: /api/v1/nodes/${1}/proxy/metrics/cadvisor
73⾏的replacement:  变成replacement: $1:$2
#通过kubectl apply更新configmap
kubectl apply  -f  prometheus-cfg.yaml
2)通过deployment部署prometheus
cat  >prometheus-deploy.yaml <<EOF
---
apiVersion: apps/v1
kind: Deployment
metadata:
name: prometheus-server
namespace: monitor-sa
labels:
app: prometheus
spec:
replicas: 1
selector:
matchLabels:
app: prometheus
component: server
#matchExpressions:
#- {key: app, operator: In, values: [prometheus]}    #- {key: component, operator: In, values: [server]}  template:
metadata:
labels:
app: prometheus
component: server
annotations:
prometheus.io/scrape: 'false'
spec:
nodeName: node1
serviceAccountName: monitor
containers:
- name: prometheus
image: prom/prometheus:v2.2.1
imagePullPolicy: IfNotPresent
command:
- prometheus
- --config.file=/etc/l          - --storage.tsdb.path=/prometheus
- --ion=720h
ports:
- containerPort: 9090
protocol: TCP
volumeMounts:
-
mountPath: /etc/l          name: prometheus-config
subPath: l
- mountPath: /prometheus/
name: prometheus-storage-volume
volumes:
- name: prometheus-config
configMap:
name: prometheus-config
items:
- key: l
path: l
mode: 0644
- name: prometheus-storage-volume
hostPath:
path: /data
type: Directory
EOF

版权声明：本站内容均来自互联网，仅供演示用，请勿用于商业和其他非法用途。如果侵犯了您的权益请与我们联系QQ:729038198，我们将在24小时内删除。