k8s-常见问题记录

发表于 更新于 分类于 Waline：

  1. 错误信息：

    1
    Failed to create pod sandbox: rpc error: code = DeadlineExceeded desc = failed to get sandbox image "k8s.gcr.io/pause:3.8": failed to pull image "k8s.gcr.io/pause:3.8": failed to pull and unpack image "k8s.gcr.io/pause:3.8": failed to resolve reference "k8s.gcr.io/pause:3.8": failed to do request: Head "https://k8s.gcr.io/v2/pause/manifests/3.8": dial tcp 74.125.23.82:443: i/o timeout

    原因：关键信息failed to pull image "k8s.gcr.io/pause:3.8"，说明镜像拉取失败，因为k8s.gcr.io解析的都是国外ip。

    方案一（临时解决）：

    1
    2
    3
    4
    5
    6
    7
    8
    #拉取镜像
    crictl pull registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.8
    #修改镜像名
    ctr -n k8s.io i tag registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.8 k8s.gcr.io/pause:3.8

    crictl pull registry.cn-hangzhou.aliyuncs.com/owater/cluster-proportional-autoscaler-amd64:1.8.3

    ctr -n k8s.io i tag registry.cn-hangzhou.aliyuncs.com/owater/cluster-proportional-autoscaler-amd64:1.8.3 k8s.gcr.io/cpa/cluster-proportional-autoscaler-amd64:1.8.5

    方案二（永久解决）：

    1
    2
    3
    4
    5
    6
    vi /etc/containerd/config.toml
    #修改该行：sandbox_image = "k8s.gcr.io/pause:3.8"
    #为     ：sandbox_image = "registry.cn-hangzhou.aliyuncs.com/google_containers/pause:3.8"
    systemctl daemon-reload
    systemctl restart containerd
    systemctl status containerd

  2. 需求信息：获取k8s的节点ip

    原因：解决一些服务需要知道节点id

    解决：

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    spec:
      containers:
        - env:
            - name: spring.profiles.active
              value: test
           #增加如下配置   
            - name: MY_POD_IP #MY_POD_IP是自定义的名字，可以修改
              valueFrom:
                fieldRef:
                  apiVersion: v1
                  fieldPath: status.hostIP

    对应的界面配置：

    pP2bQfA.png

    验证：在容器里面执行env就能看到MY_POD_IP的环境变量的值已经是宿主机的ip了

  3. 现象描述：三个节点，其中两个节点加nodeport能进行访问，其中一个节点加nodeport不能访问

    不能访问节点上的kube-proxy错误信息如下

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    [root@master ~]# kubectl get pods -n kube-system -o wide | grep kube-proxy
    kube-proxy-8xqxm                             1/1     Running   2 (<invalid> ago)     5d21h   172.16.10.44     master     <none>           <none>
    kube-proxy-9nv9t                             1/1     Running   2 (<invalid> ago)     5d21h   172.16.10.192    node-192   <none>           <none>
    kube-proxy-m5swc                             1/1     Running   1 (<invalid> ago)     5d6h    172.16.10.102    node-102   <none>           <none>
    [root@master ~]# kubectl logs -n kube-system kube-proxy-8xqxm
    W0724 06:35:13.833247       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Service: Unauthorized
    E0724 06:35:13.833277       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Service: failed to list *v1.Service: Unauthorized
    W0724 06:35:31.199383       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.Node: Unauthorized
    E0724 06:35:31.199408       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.Node: failed to list *v1.Node: Unauthorized
    W0724 06:36:01.560044       1 reflector.go:424] vendor/k8s.io/client-go/informers/factory.go:150: failed to list *v1.EndpointSlice: Unauthorized
    E0724 06:36:01.560070       1 reflector.go:140] vendor/k8s.io/client-go/informers/factory.go:150: Failed to watch *v1.EndpointSlice: failed to list *v1.EndpointSlice: Unauthorized

    解决：删除kube-system kube-proxy-8xqxm这个，然后等他自动新建个这个服务就好了