创建部署问题时,请参考下面模板,你提供的信息越多,越容易及时获得解答。如果未按模板创建问题,管理员有权关闭问题。
确保帖子格式清晰易读,用 markdown code block 语法格式化代码块。
你只花一分钟创建的问题,不能指望别人花上半个小时给你解答。
操作系统信息
例如:虚拟机/物理机,Centos7.5/Ubuntu18.04,4C/8G
Kubernetes版本信息
将 kubectl version
命令执行结果贴在下方
容器运行时
将 docker version
/ crictl version
/ nerdctl version
结果贴在下方
KubeSphere版本信息
例如:v3.4.0 all in one 安装 提示 Error from server (NotFound): nodes “LAPTOP-9MOR6E4R” not found
v3.4.0 all in one 安装 提示 Error from server (NotFound): nodes “LAPTOP-9MOR6E4R” not found
13:10:13 CST success: [LocalHost]
13:10:13 CST [NodeBinariesModule] Download installation binaries
13:10:13 CST message: [localhost]
downloading amd64 kubeadm v1.22.12 …
13:10:13 CST message: [localhost]
kubeadm is existed
13:10:13 CST message: [localhost]
downloading amd64 kubelet v1.22.12 …
13:10:14 CST message: [localhost]
kubelet is existed
13:10:14 CST message: [localhost]
downloading amd64 kubectl v1.22.12 …
13:10:14 CST message: [localhost]
kubectl is existed
13:10:14 CST message: [localhost]
downloading amd64 helm v3.9.0 …
13:10:14 CST message: [localhost]
helm is existed
13:10:14 CST message: [localhost]
downloading amd64 kubecni v1.2.0 …
13:10:14 CST message: [localhost]
kubecni is existed
13:10:14 CST message: [localhost]
downloading amd64 crictl v1.24.0 …
13:10:14 CST message: [localhost]
crictl is existed
13:10:14 CST message: [localhost]
downloading amd64 etcd v3.4.13 …
13:10:14 CST message: [localhost]
etcd is existed
13:10:14 CST message: [localhost]
downloading amd64 docker 24.0.6 …
13:10:14 CST message: [localhost]
docker is existed
13:10:14 CST message: [localhost]
downloading amd64 calicoctl v3.26.1 …
13:10:15 CST message: [localhost]
calicoctl is existed
13:10:15 CST success: [LocalHost]
13:10:15 CST [ConfigureOSModule] Get OS release
13:10:15 CST success: [LAPTOP-9MOR6E4R]
13:10:15 CST [ConfigureOSModule] Prepare to init OS
13:10:15 CST success: [LAPTOP-9MOR6E4R]
13:10:15 CST [ConfigureOSModule] Generate init os script
13:10:15 CST success: [LAPTOP-9MOR6E4R]
13:10:15 CST [ConfigureOSModule] Exec init os script
13:10:15 CST stdout: [LAPTOP-9MOR6E4R]
modprobe: FATAL: Module ip_vs not found in directory /lib/modules/5.15.133.1-microsoft-standard-WSL2
modprobe: FATAL: Module ip_vs_rr not found in directory /lib/modules/5.15.133.1-microsoft-standard-WSL2
modprobe: FATAL: Module ip_vs_wrr not found in directory /lib/modules/5.15.133.1-microsoft-standard-WSL2
modprobe: FATAL: Module ip_vs_sh not found in directory /lib/modules/5.15.133.1-microsoft-standard-WSL2
modprobe: FATAL: Module nf_conntrack not found in directory /lib/modules/5.15.133.1-microsoft-standard-WSL2
net.ipv4.conf.default.rp_filter = 1
net.ipv4.conf.all.rp_filter = 1
net.ipv4.ip_forward = 1
net.bridge.bridge-nf-call-arptables = 1
net.bridge.bridge-nf-call-ip6tables = 1
net.bridge.bridge-nf-call-iptables = 1
net.ipv4.ip_local_reserved_ports = 30000-32767
net.core.netdev_max_backlog = 65535
net.core.rmem_max = 33554432
net.core.wmem_max = 33554432
net.core.somaxconn = 32768
net.ipv4.tcp_max_syn_backlog = 1048576
net.ipv4.neigh.default.gc_thresh1 = 512
net.ipv4.neigh.default.gc_thresh2 = 2048
net.ipv4.neigh.default.gc_thresh3 = 4096
net.ipv4.tcp_retries2 = 15
net.ipv4.tcp_max_tw_buckets = 1048576
net.ipv4.tcp_max_orphans = 65535
net.ipv4.udp_rmem_min = 131072
net.ipv4.udp_wmem_min = 131072
net.ipv4.conf.all.arp_accept = 1
net.ipv4.conf.default.arp_accept = 1
net.ipv4.conf.all.arp_ignore = 1
net.ipv4.conf.default.arp_ignore = 1
vm.max_map_count = 262144
vm.swappiness = 0
vm.overcommit_memory = 0
fs.inotify.max_user_instances = 524288
fs.inotify.max_user_watches = 524288
fs.pipe-max-size = 4194304
fs.aio-max-nr = 262144
kernel.pid_max = 65535
sysctl: cannot stat /proc/sys/kernel/watchdog_thresh: No such file or directory
sysctl: cannot stat /proc/sys/kernel/hung_task_timeout_secs: No such file or directory
13:10:15 CST success: [LAPTOP-9MOR6E4R]
13:10:15 CST [ConfigureOSModule] configure the ntp server for each node
13:10:15 CST skipped: [LAPTOP-9MOR6E4R]
13:10:15 CST [KubernetesStatusModule] Get kubernetes cluster status
13:10:16 CST stdout: [LAPTOP-9MOR6E4R]
v1.22.12
13:10:16 CST stdout: [LAPTOP-9MOR6E4R]
laptop-9mor6e4r v1.22.12 [map[address:172.27.249.12 type:InternalIP] map[address:laptop-9mor6e4r type:Hostname]]
13:10:16 CST stdout: [LAPTOP-9MOR6E4R]
W1119 13:10:16.500412 30903 utils.go:69] The recommended value for “clusterDNS” in “KubeletConfiguration” is: [10.233.0.10]; the provided value is: [169.254.25.10]
[upload-certs] Storing the certificates in Secret “kubeadm-certs” in the “kube-system” Namespace
[upload-certs] Using certificate key:
608b5237378faac49a650d58892a67ea26ee51660bfd78aac99df6cc667f0d29
13:10:16 CST stdout: [LAPTOP-9MOR6E4R]
secret/kubeadm-certs patched
13:10:16 CST stdout: [LAPTOP-9MOR6E4R]
secret/kubeadm-certs patched
13:10:16 CST stdout: [LAPTOP-9MOR6E4R]
secret/kubeadm-certs patched
13:10:16 CST stdout: [LAPTOP-9MOR6E4R]
naagod.72r2vvl5gjz8rngo
13:10:16 CST success: [LAPTOP-9MOR6E4R]
13:10:16 CST [InstallContainerModule] Sync docker binaries
13:10:16 CST skipped: [LAPTOP-9MOR6E4R]
13:10:16 CST [InstallContainerModule] Generate docker service
13:10:16 CST skipped: [LAPTOP-9MOR6E4R]
13:10:16 CST [InstallContainerModule] Generate docker config
13:10:16 CST skipped: [LAPTOP-9MOR6E4R]
13:10:16 CST [InstallContainerModule] Enable docker
13:10:16 CST skipped: [LAPTOP-9MOR6E4R]
13:10:16 CST [InstallContainerModule] Add auths to container runtime
13:10:16 CST skipped: [LAPTOP-9MOR6E4R]
13:10:16 CST [PullModule] Start to pull images on all nodes
13:10:16 CST message: [LAPTOP-9MOR6E4R]
downloading image: kubesphere/pause:3.5
13:10:53 CST message: [LAPTOP-9MOR6E4R]
downloading image: kubesphere/kube-apiserver:v1.22.12
13:11:31 CST message: [LAPTOP-9MOR6E4R]
downloading image: kubesphere/kube-controller-manager:v1.22.12
13:12:09 CST message: [LAPTOP-9MOR6E4R]
downloading image: kubesphere/kube-scheduler:v1.22.12
13:12:29 CST message: [LAPTOP-9MOR6E4R]
downloading image: kubesphere/kube-proxy:v1.22.12
13:13:10 CST message: [LAPTOP-9MOR6E4R]
downloading image: coredns/coredns:1.8.0
13:13:30 CST message: [LAPTOP-9MOR6E4R]
downloading image: kubesphere/k8s-dns-node-cache:1.15.12
13:14:10 CST message: [LAPTOP-9MOR6E4R]
downloading image: calico/kube-controllers:v3.26.1
13:14:38 CST message: [LAPTOP-9MOR6E4R]
downloading image: calico/cni:v3.26.1
13:14:58 CST message: [LAPTOP-9MOR6E4R]
downloading image: calico/node:v3.26.1
13:15:37 CST message: [LAPTOP-9MOR6E4R]
downloading image: calico/pod2daemon-flexvol:v3.26.1
13:15:59 CST success: [LAPTOP-9MOR6E4R]
13:15:59 CST [ETCDPreCheckModule] Get etcd status
13:15:59 CST stdout: [LAPTOP-9MOR6E4R]
ETCD_NAME=etcd-LAPTOP-9MOR6E4R
13:15:59 CST success: [LAPTOP-9MOR6E4R]
13:15:59 CST [CertsModule] Fetch etcd certs
13:15:59 CST success: [LAPTOP-9MOR6E4R]
13:15:59 CST [CertsModule] Generate etcd Certs
[certs] Using existing ca certificate authority
[certs] Using existing admin-LAPTOP-9MOR6E4R certificate and key on disk
[certs] Using existing member-LAPTOP-9MOR6E4R certificate and key on disk
[certs] Using existing node-LAPTOP-9MOR6E4R certificate and key on disk
13:15:59 CST success: [LocalHost]
13:15:59 CST [CertsModule] Synchronize certs file
13:15:59 CST success: [LAPTOP-9MOR6E4R]
13:15:59 CST [CertsModule] Synchronize certs file to master
13:15:59 CST skipped: [LAPTOP-9MOR6E4R]
13:15:59 CST [InstallETCDBinaryModule] Install etcd using binary
13:15:59 CST success: [LAPTOP-9MOR6E4R]
13:15:59 CST [InstallETCDBinaryModule] Generate etcd service
13:15:59 CST success: [LAPTOP-9MOR6E4R]
13:15:59 CST [InstallETCDBinaryModule] Generate access address
13:15:59 CST success: [LAPTOP-9MOR6E4R]
13:15:59 CST [ETCDConfigureModule] Health check on exist etcd
13:16:00 CST success: [LAPTOP-9MOR6E4R]
13:16:00 CST [ETCDConfigureModule] Generate etcd.env config on new etcd
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [ETCDConfigureModule] Join etcd member
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [ETCDConfigureModule] Health check on new etcd
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [ETCDConfigureModule] Check etcd member
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [ETCDConfigureModule] Refresh etcd.env config on all etcd
13:16:00 CST success: [LAPTOP-9MOR6E4R]
13:16:00 CST [ETCDConfigureModule] Health check on all etcd
13:16:00 CST success: [LAPTOP-9MOR6E4R]
13:16:00 CST [ETCDBackupModule] Backup etcd data regularly
13:16:00 CST success: [LAPTOP-9MOR6E4R]
13:16:00 CST [ETCDBackupModule] Generate backup ETCD service
13:16:00 CST success: [LAPTOP-9MOR6E4R]
13:16:00 CST [ETCDBackupModule] Generate backup ETCD timer
13:16:00 CST success: [LAPTOP-9MOR6E4R]
13:16:00 CST [ETCDBackupModule] Enable backup etcd service
13:16:00 CST success: [LAPTOP-9MOR6E4R]
13:16:00 CST [InstallKubeBinariesModule] Synchronize kubernetes binaries
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [InstallKubeBinariesModule] Change kubelet mode
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [InstallKubeBinariesModule] Generate kubelet service
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [InstallKubeBinariesModule] Enable kubelet service
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [InstallKubeBinariesModule] Generate kubelet env
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [InitKubernetesModule] Generate kubeadm config
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [InitKubernetesModule] Generate audit policy
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [InitKubernetesModule] Generate audit webhook
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [InitKubernetesModule] Init cluster using kubeadm
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [InitKubernetesModule] Copy admin.conf to ~/.kube/config
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [InitKubernetesModule] Remove master taint
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [ClusterDNSModule] Generate coredns service
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [ClusterDNSModule] Override coredns service
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [ClusterDNSModule] Generate nodelocaldns
13:16:00 CST success: [LAPTOP-9MOR6E4R]
13:16:00 CST [ClusterDNSModule] Deploy nodelocaldns
13:16:00 CST stdout: [LAPTOP-9MOR6E4R]
serviceaccount/nodelocaldns unchanged
daemonset.apps/nodelocaldns unchanged
13:16:00 CST success: [LAPTOP-9MOR6E4R]
13:16:00 CST [ClusterDNSModule] Generate nodelocaldns configmap
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [ClusterDNSModule] Apply nodelocaldns configmap
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [KubernetesStatusModule] Get kubernetes cluster status
13:16:00 CST stdout: [LAPTOP-9MOR6E4R]
v1.22.12
13:16:00 CST stdout: [LAPTOP-9MOR6E4R]
laptop-9mor6e4r v1.22.12 [map[address:172.27.249.12 type:InternalIP] map[address:laptop-9mor6e4r type:Hostname]]
13:16:00 CST stdout: [LAPTOP-9MOR6E4R]
W1119 13:16:00.690254 32814 utils.go:69] The recommended value for “clusterDNS” in “KubeletConfiguration” is: [10.233.0.10]; the provided value is: [169.254.25.10]
[upload-certs] Storing the certificates in Secret “kubeadm-certs” in the “kube-system” Namespace
[upload-certs] Using certificate key:
c19fe383c518fb40ed2e9851c63eca9306e831713908ae9b180e2ce3982ba8f5
13:16:00 CST stdout: [LAPTOP-9MOR6E4R]
secret/kubeadm-certs patched
13:16:00 CST stdout: [LAPTOP-9MOR6E4R]
secret/kubeadm-certs patched
13:16:00 CST stdout: [LAPTOP-9MOR6E4R]
secret/kubeadm-certs patched
13:16:00 CST stdout: [LAPTOP-9MOR6E4R]
vanypx.eef3lpsbl25bv2v5
13:16:00 CST success: [LAPTOP-9MOR6E4R]
13:16:00 CST [JoinNodesModule] Generate kubeadm config
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [JoinNodesModule] Generate audit policy
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [JoinNodesModule] Generate audit webhook
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [JoinNodesModule] Join control-plane node
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [JoinNodesModule] Join worker node
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [JoinNodesModule] Copy admin.conf to ~/.kube/config
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [JoinNodesModule] Remove master taint
13:16:00 CST skipped: [LAPTOP-9MOR6E4R]
13:16:00 CST [JoinNodesModule] Add worker label to all nodes
13:16:00 CST stdout: [LAPTOP-9MOR6E4R]
Error from server (NotFound): nodes “LAPTOP-9MOR6E4R” not found
13:16:00 CST message: [LAPTOP-9MOR6E4R]
add worker label failed: Failed to exec command: sudo -E /bin/bash -c “/usr/local/bin/kubectl label –overwrite node LAPTOP-9MOR6E4R node-role.kubernetes.io/worker=”
Error from server (NotFound): nodes “LAPTOP-9MOR6E4R” not found: Process exited with status 1
13:16:00 CST retry: [LAPTOP-9MOR6E4R]
13:16:05 CST stdout: [LAPTOP-9MOR6E4R]
Error from server (NotFound): nodes “LAPTOP-9MOR6E4R” not found
13:16:05 CST message: [LAPTOP-9MOR6E4R]
add worker label failed: Failed to exec command: sudo -E /bin/bash -c “/usr/local/bin/kubectl label –overwrite node LAPTOP-9MOR6E4R node-role.kubernetes.io/worker=”
Error from server (NotFound): nodes “LAPTOP-9MOR6E4R” not found: Process exited with status 1
13:16:05 CST retry: [LAPTOP-9MOR6E4R]
13:16:10 CST stdout: [LAPTOP-9MOR6E4R]
Error from server (NotFound): nodes “LAPTOP-9MOR6E4R” not found
13:16:10 CST message: [LAPTOP-9MOR6E4R]
add worker label failed: Failed to exec command: sudo -E /bin/bash -c “/usr/local/bin/kubectl label –overwrite node LAPTOP-9MOR6E4R node-role.kubernetes.io/worker=”
Error from server (NotFound): nodes “LAPTOP-9MOR6E4R” not found: Process exited with status 1
13:16:10 CST failed: [LAPTOP-9MOR6E4R]
error: Pipeline[CreateClusterPipeline] execute failed: Module[JoinNodesModule] exec failed:
failed: [LAPTOP-9MOR6E4R] [addWorkerLabelToNode] exec failed after 3 retries: add worker label failed: Failed to exec command: sudo -E /bin/bash -c “/usr/local/bin/kubectl label –overwrite node LAPTOP-9MOR6E4R node-role.kubernetes.io/worker=”
Error from server (NotFound): nodes “LAPTOP-9MOR6E4R” not found: Process exited with status 1