k8s: 1.21.4 多节点,member集群
ks版本:3.2.0 ,基于已有K8s安装。
前端界面的工具箱中,没有日志查询和审计功能:
k8s: 1.21.4 多节点,member集群
ks版本:3.2.0 ,基于已有K8s安装。
前端界面的工具箱中,没有日志查询和审计功能:
ZhangFugui
都开启了呀
logging:
containerruntime: docker
enabled: true
logsidecar:
enabled: true
replicas: 2
events:
enabled: true
alerting:
enabled: true
auditing:
enabled: true
morriszs 看一下ks-installer的日志,是否安装成功
DehaoCheng
安装日志没有报错。
我甚至用kubectl edit cc -n kubesphere-system ks-installer,删除了status中的相关部分,重新安装了好多次,都不行。
morriszs 看下日志对应的那些pod状态吧,多半日志里面skipping了
DehaoCheng
没有,pod状态都是正常的。
es里面的index每天也有正常生成。
weili520
你可以在后端执行如下命令kubectl edit clusterconfigurations.installer.kubesphere.io -n kubesphere-system看下信息是否一致
不是改 configmap,要改cc 才能生效的
kubectl get cc ks-installer -n kubesphere-system -o yaml
看看你cc文件里改了没
ruiyaoOps
改了的,我上面也说过了,我删除了status里的相关部分,重启ks-installer跟ks-apiserver,都没有用。
[root@kc21m01 ~]# kubectl get cc ks-installer -n kubesphere-system -o yaml
apiVersion: installer.kubesphere.io/v1alpha1
kind: ClusterConfiguration
metadata:
annotations:
kubectl.kubernetes.io/last-applied-configuration: |
{“apiVersion”:“installer.kubesphere.io/v1alpha1”,“kind”:“ClusterConfiguration”,“metadata”:{“annotations”:{},“labels”:{“version”:“v3.2.0”},“name”:“ks-installer”,“namespace”:“kubesphere-system”},“spec”:{“alerting”:{“enabled”:true},“auditing”:{“enabled”:true},“authentication”:{“jwtSecret”:“khUff6ToH2b5EVHTR2a8kPEKWkHpBeBj”},“common”:{“core”:{“console”:{“enableMultiLogin”:true,“port”:30880,“type”:“NodePort”}},“es”:{“basicAuth”:{“enabled”:true,“password”:“esTic456”,“username”:“elastic”},“elkPrefix”:“logstash”,“externalElasticsearchPort”:“9200”,“externalElasticsearchUrl”:“192.168.120.85”,“logMaxAge”:7},“gpu”:{“kinds”:[{“default”:true,“resourceName”:“nvidia.com/gpu”,“resourceType”:“GPU”}]},“minio”:{“volumeSize”:“20Gi”},“monitoring”:{“GPUMonitoring”:{“enabled”:true},“endpoint”:“http://prometheus-operated.kubesphere-monitoring-system.svc:9090”},“openldap”:{“enabled”:true,“volumeSize”:“2Gi”},“redis”:{“enabled”:true,“volumeSize”:“2Gi”}},“devops”:{“enabled”:true,“jenkinsJavaOpts_MaxRAM”:“2g”,“jenkinsJavaOpts_Xms”:“512m”,“jenkinsJavaOpts_Xmx”:“512m”,“jenkinsMemoryLim”:“2Gi”,“jenkinsMemoryReq”:“1500Mi”,“jenkinsVolumeSize”:“8Gi”},“etcd”:{“endpointIps”:“localhost”,“monitoring”:false,“port”:2379,“tlsEnable”:true},“events”:{“enabled”:true},“kubeedge”:{“cloudCore”:{“cloudHub”:{“advertiseAddress”:[""],“nodeLimit”:“100”},“cloudhubHttpsPort”:“10002”,“cloudhubPort”:“10000”,“cloudhubQuicPort”:“10001”,“cloudstreamPort”:“10003”,“nodeSelector”:{“node-role.kubernetes.io/worker”:""},“service”:{“cloudhubHttpsNodePort”:“30002”,“cloudhubNodePort”:“30000”,“cloudhubQuicNodePort”:“30001”,“cloudstreamNodePort”:“30003”,“tunnelNodePort”:“30004”},“tolerations”:[],“tunnelPort”:“10004”},“edgeWatcher”:{“edgeWatcherAgent”:{“nodeSelector”:{“node-role.kubernetes.io/worker”:""},“tolerations”:[]},“nodeSelector”:{“node-role.kubernetes.io/worker”:""},“tolerations”:[]},“enabled”:false},“local_registry”:"",“logging”:{“containerruntime”:“containerd”,“enabled”:true,“logsidecar”:{“enabled”:true,“replicas”:2}},“metrics_server”:{“enabled”:true},“monitoring”:{“gpu”:{“nvidia_dcgm_exporter”:{“enabled”:false}},“storageClass”:“managed-nfs-storage”},“multicluster”:{“clusterRole”:“member”},“network”:{“ippool”:{“type”:“none”},“networkpolicy”:{“enabled”:false},“topology”:{“type”:“none”}},“openpitrix”:{“store”:{“enabled”:false}},“persistence”:{“storageClass”:“managed-nfs-storage”},“servicemesh”:{“enabled”:true}}}
creationTimestamp: “2021-11-08T02:09:45Z”
generation: 47
labels:
version: v3.2.0
name: ks-installer
namespace: kubesphere-system
resourceVersion: “8400030”
selfLink: /apis/installer.kubesphere.io/v1alpha1/namespaces/kubesphere-system/clusterconfigurations/ks-installer
uid: ddf6e2b0-dd0f-4345-9937-4f1b69585da5
spec:
alerting:
enabled: true
auditing:
enabled: true
authentication:
jwtSecret: khUff6ToH2b5EVHTR2a8adsakPEKWkHpBeBj
common:
core:
console:
enableMultiLogin: true
port: 30880
type: NodePort
es:
basicAuth:
enabled: true
password: esTic456
username: elastic
elkPrefix: logstash
externalElasticsearchPort: “9200”
externalElasticsearchUrl: 192.168.120.85
logMaxAge: 7
gpu:
kinds:
- default: true
resourceName: nvidia.com/gpu
resourceType: GPU
minio:
volumeSize: 20Gi
monitoring:
GPUMonitoring:
enabled: true
endpoint: http://prometheus-operated.kubesphere-monitoring-system.svc:9090
openldap:
enabled: true
volumeSize: 2Gi
redis:
enabled: true
volumeSize: 2Gi
devops:
enabled: true
jenkinsJavaOpts_MaxRAM: 2g
jenkinsJavaOpts_Xms: 512m
jenkinsJavaOpts_Xmx: 512m
jenkinsMemoryLim: 2Gi
jenkinsMemoryReq: 1500Mi
jenkinsVolumeSize: 8Gi
etcd:
endpointIps: localhost
monitoring: false
port: 2379
tlsEnable: true
events:
enabled: true
kubeedge:
cloudCore:
cloudHub:
advertiseAddress:
- ""
nodeLimit: “100”
cloudhubHttpsPort: “10002”
cloudhubPort: “10000”
cloudhubQuicPort: “10001”
cloudstreamPort: “10003”
nodeSelector:
node-role.kubernetes.io/worker: ""
service:
cloudhubHttpsNodePort: “30002”
cloudhubNodePort: “30000”
cloudhubQuicNodePort: “30001”
cloudstreamNodePort: “30003”
tunnelNodePort: “30004”
tolerations: []
tunnelPort: “10004”
edgeWatcher:
edgeWatcherAgent:
nodeSelector:
node-role.kubernetes.io/worker: ""
tolerations: []
nodeSelector:
node-role.kubernetes.io/worker: ""
tolerations: []
enabled: false
local_registry: ""
logging:
containerruntime: docker
enabled: true
logsidecar:
enabled: true
replicas: 2
metrics_server:
enabled: true
monitoring:
gpu:
nvidia_dcgm_exporter:
enabled: false
storageClass: managed-nfs-storage
multicluster:
clusterRole: member
network:
ippool:
type: none
networkpolicy:
enabled: false
topology:
type: none
openpitrix:
store:
enabled: false
persistence:
storageClass: managed-nfs-storage
servicemesh:
enabled: true
status:
alerting:
enabledTime: 2021-11-08T11:32:23CST
status: enabled
auditing:
enabledTime: 2021-11-08T11:29:19CST
status: enabled
clusterId: 34b14c4b-2834-463c-8d6a-1b1ca6571013-1636342382
core:
enabledTime: 2021-11-08T11:27:17CST
status: enabled
version: v3.2.0
devops:
enabledTime: 2021-11-08T11:30:48CST
status: enabled
events:
enabledTime: 2021-11-08T11:29:53CST
status: enabled
fluentbit:
enabledTime: 2021-11-08T11:26:15CST
status: enabled
logging:
enabledTime: 2021-11-08T11:30:06CST
status: enabled
metricsServer:
enabledTime: 2021-11-08T11:24:43CST
status: enabled
minio:
enabledTime: 2021-11-08T11:25:57CST
status: enabled
monitoring:
enabledTime: 2021-11-08T11:32:20CST
status: enabled
openldap:
enabledTime: 2021-11-08T11:25:44CST
status: enabled
redis:
enabledTime: 2021-11-08T11:25:35CST
status: enabled
servicemesh:
enabledTime: 2021-11-08T11:30:36CST
status: enabled
kubectl rollout restart deploy ks-installer -n kubesphere-system
把 ks-installer 重启然后看看日志,看下执行过程
真的很郁闷,同样的环境,3.1.1的工具中是没有问题的,升级到3.2.0各种问题,然后干脆卸载了3.2,重新安装,还是一样的。还有其它的问题,比如开启了auditing,pod "kube-auditing-webhook-deploy-xxxx"中也能看到auditing日志,但是es中就是生成不了index。这些小问题排查了好多天了,头痛,让我不敢轻易上生产。官方文档很简单,就是改几个参数,查都没法查。
morriszs 重新安装的集群仍然有问题吗?
你这个估计得找人远程看看,有买qingcloud 的服务么,在上面提个工单可以找人看看。
DehaoCheng
是的,仍然有问题,重装无数次了。各种日志翻遍了,找不到头绪。
morriszs 重新安装后具体是什么问题呢