看api日志
kubectl logs -f ks-apiserver-7bb5c66f9-gq7lh -n kubesphere-system
E1103 10:50:06.658504 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.6/tools/cache/reflector.go:125: Failed to list *v2beta1.Config: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Config failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:50:06.660814 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.6/tools/cache/reflector.go:125: Failed to list *v2beta1.Receiver: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Receiver failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:50:20.899320 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.6/tools/cache/reflector.go:125: Failed to list *v2beta1.Config: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Config failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:50:26.456772 1 reflector.go:178] pkg/mod/k8s.io/client-go@v0.18.6/tools/cache/reflector.go:125: Failed to list *v2beta1.Receiver: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Receiver failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
root@node1:~# kubectl logs –tail=10 notification-manager-deployment-7bd887ffb4-rmmf7
E1103 10:59:23.824278 1 reflector.go:153] pkg/mod/k8s.io/client-go@v0.17.2/tools/cache/reflector.go:105: Failed to list *v2beta1.Config: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Config failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:59:23.825455 1 reflector.go:153] pkg/mod/k8s.io/client-go@v0.17.2/tools/cache/reflector.go:105: Failed to list *v2beta1.Receiver: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Receiver failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:59:25.277513 1 reflector.go:153] pkg/mod/k8s.io/client-go@v0.17.2/tools/cache/reflector.go:105: Failed to list *v2beta1.Receiver: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Receiver failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:59:25.278494 1 reflector.go:153] pkg/mod/k8s.io/client-go@v0.17.2/tools/cache/reflector.go:105: Failed to list *v2beta1.Config: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Config failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:59:26.282932 1 reflector.go:153] pkg/mod/k8s.io/client-go@v0.17.2/tools/cache/reflector.go:105: Failed to list *v2beta1.Config: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Config failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:59:26.283942 1 reflector.go:153] pkg/mod/k8s.io/client-go@v0.17.2/tools/cache/reflector.go:105: Failed to list *v2beta1.Receiver: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Receiver failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:59:27.329460 1 reflector.go:153] pkg/mod/k8s.io/client-go@v0.17.2/tools/cache/reflector.go:105: Failed to list *v2beta1.Config: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Config failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:59:27.330243 1 reflector.go:153] pkg/mod/k8s.io/client-go@v0.17.2/tools/cache/reflector.go:105: Failed to list *v2beta1.Receiver: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Receiver failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:59:28.370657 1 reflector.go:153] pkg/mod/k8s.io/client-go@v0.17.2/tools/cache/reflector.go:105: Failed to list *v2beta1.Receiver: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Receiver failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
E1103 10:59:28.371528 1 reflector.go:153] pkg/mod/k8s.io/client-go@v0.17.2/tools/cache/reflector.go:105: Failed to list *v2beta1.Config: conversion webhook for notification.kubesphere.io/v2beta2, Kind=Config failed: Post “https://notification-manager-webhook.kubesphere-monitoring-system.svc:443/convert?timeout=30s”: dial tcp 10.233.56.198:443: connect: connection refused
root@node1:~# kubectl logs -f notification-manager-operator-85797b9f87-4lnfs -c kube-rbac-proxy
I1103 02:22:38.758793 1 main.go:190] Valid token audiences:
I1103 02:22:38.758910 1 main.go:262] Generating self signed cert as no cert is provided
I1103 02:22:59.115864 1 main.go:311] Starting TCP socket on 0.0.0.0:8443
I1103 02:22:59.116308 1 main.go:318] Listening securely on 0.0.0.0:8443
2021/11/03 02:28:03 http: TLS handshake error from 127.0.0.1:44686: EOF
2021/11/03 02:28:33 http: TLS handshake error from 127.0.0.1:47128: local error: tls: bad record MAC
^[[A^[[AC 这个TLS错误是我用端口转发测试连通性的,端口转发可以连接上
root@node1:~# kubectl logs -f notification-manager-operator-85797b9f87-4lnfs -c notification-manager-operator
2021-11-03T10:22:46.714+0800 INFO controller-runtime.metrics metrics server is starting to listen {“addr”: “127.0.0.1:8080”}
2021-11-03T10:22:46.715+0800 INFO setup starting manager
I1103 10:22:46.716076 1 leaderelection.go:242] attempting to acquire leader lease kubesphere-monitoring-system/7b8d27e6.kubesphere.io…
2021-11-03T10:22:46.716+0800 INFO controller-runtime.manager starting metrics server {“path”: “/metrics”}
I1103 10:23:04.037012 1 leaderelection.go:252] successfully acquired lease kubesphere-monitoring-system/7b8d27e6.kubesphere.io
2021-11-03T10:23:04.037+0800 DEBUG controller-runtime.manager.events Normal {“object”: {“kind”:“ConfigMap”,“namespace”:“kubesphere-monitoring-system”,“name”:“7b8d27e6.kubesphere.io”,“uid”:“7a9957c6-7a85-4287-9df4-0e5b8c94e155”,“apiVersion”:“v1”,“resourceVersion”:“96504950”}, “reason”: “LeaderElection”, “message”: “notification-manager-operator-85797b9f87-4lnfs_adc6de01-1ebe-4bb0-8a21-d5157ea1a19d became leader”}
2021-11-03T10:23:04.037+0800 INFO controller-runtime.controller Starting EventSource {“controller”: “notificationmanager”, “source”: “kind source: /, Kind=”}
2021-11-03T10:23:04.337+0800 INFO controller-runtime.controller Starting EventSource {“controller”: “notificationmanager”, “source”: “kind source: /, Kind=”}
2021-11-03T10:23:04.338+0800 INFO controller-runtime.controller Starting Controller {“controller”: “notificationmanager”}
2021-11-03T10:23:04.338+0800 INFO controller-runtime.controller Starting workers {“controller”: “notificationmanager”, “worker count”: 1}
2021-11-03T10:23:04.927+0800 DEBUG controller-runtime.controller Successfully Reconciled {“controller”: “notificationmanager”, “request”: “/notification-manager”}
2021-11-03T10:23:05.046+0800 DEBUG controller-runtime.controller Successfully Reconciled {“controller”: “notificationmanager”, “request”: “/notification-manager”}
看不出是哪里的问题,是我的K8S哪里不对了吗?