部署 Kubernetes Workers 节点

    以下命令需要在所有 worker 节点上面都运行一遍，包括 , worker-1 和 worker-2。可以使用 gcloud 命令登录到 worker 节点上，比如

    可以使用 tmux 同时登录到三个 Worker 节点上，加快部署步骤。

    安装 OS 依赖组件：

    1. sudo apt-get update
    2. sudo apt-get -y install socat conntrack ipset
    1. wget -q --show-progress --https-only --timestamping \
    2.   https://github.com/kubernetes-sigs/cri-tools/releases/download/v1.12.0/crictl-v1.12.0-linux-amd64.tar.gz \
    3.   https://storage.googleapis.com/kubernetes-the-hard-way/runsc-50c283b9f56bb7200938d9e207355f05f79f0d17 \
    4.   https://github.com/opencontainers/runc/releases/download/v1.0.0-rc5/runc.amd64 \
    5.   https://github.com/containernetworking/plugins/releases/download/v0.6.0/cni-plugins-amd64-v0.6.0.tgz \
    6.   https://github.com/containerd/containerd/releases/download/v1.2.0-rc.0/containerd-1.2.0-rc.0.linux-amd64.tar.gz \
    7.   https://storage.googleapis.com/kubernetes-release/release/v1.12.0/bin/linux/amd64/kubectl \
    8.   https://storage.googleapis.com/kubernetes-release/release/v1.12.0/bin/linux/amd64/kube-proxy \
    9.   https://storage.googleapis.com/kubernetes-release/release/v1.12.0/bin/linux/amd64/kubelet
    1. sudo mkdir -p \
    2.   /etc/cni/net.d \
    3.   /opt/cni/bin \
    4.   /var/lib/kubelet \
    5.   /var/lib/kube-proxy \
    6.   /var/lib/kubernetes \
    7.   /var/run/kubernetes

    安装 worker 二进制文件

    1. sudo mv runsc-50c283b9f56bb7200938d9e207355f05f79f0d17 runsc
    2. sudo mv runc.amd64 runc
    3. chmod +x kubectl kube-proxy kubelet runc runsc
    4. sudo mv kubectl kube-proxy kubelet runc runsc /usr/local/bin/
    5. sudo tar -xvf crictl-v1.12.0-linux-amd64.tar.gz -C /usr/local/bin/
    6. sudo tar -xvf cni-plugins-amd64-v0.6.0.tgz -C /opt/cni/bin/
    7. sudo tar -xvf containerd-1.2.0-rc.0.linux-amd64.tar.gz -C /

    配置 CNI 网路

    查询当前计算节点的 Pod CIDR 范围：

    生成 bridge 网络插件配置文件

    1. cat <<EOF | sudo tee /etc/cni/net.d/10-bridge.conf
    2. {
    3.     "cniVersion": "0.3.1",
    4.     "name": "bridge",
    5.     "type": "bridge",
    6.     "bridge": "cnio0",
    7.     "isGateway": true,
    8.     "ipMasq": true,
    9.     "ipam": {
    10.         "ranges": [
    11.           [{"subnet": "${POD_CIDR}"}]
    12.         ],
    13.         "routes": [{"dst": "0.0.0.0/0"}]
    15. }
    16. EOF

    生成 loopback 网络插件配置文件

    1. cat <<EOF | sudo tee /etc/cni/net.d/99-loopback.conf
    2. {
    3.     "cniVersion": "0.3.1",
    4.     "type": "loopback"
    5. }
    6. EOF
    1. sudo mkdir -p /etc/containerd/
    3. # Untrusted workloads will be run using the gVisor (runsc) runtime.
    4. cat << EOF | sudo tee /etc/containerd/config.toml
    5. [plugins]
    6.   [plugins.cri.containerd]
    7.     snapshotter = "overlayfs"
    8.     [plugins.cri.containerd.default_runtime]
    9.       runtime_type = "io.containerd.runtime.v1.linux"
    10.       runtime_engine = "/usr/local/bin/runc"
    11.       runtime_root = ""
    12.     [plugins.cri.containerd.untrusted_workload_runtime]
    13.       runtime_type = "io.containerd.runtime.v1.linux"
    14.       runtime_engine = "/usr/local/bin/runsc"
    15.       runtime_root = "/run/containerd/runsc"
    16.     [plugins.cri.containerd.gvisor]
    17.       runtime_type = "io.containerd.runtime.v1.linux"
    18.       runtime_engine = "/usr/local/bin/runsc"
    19.       runtime_root = "/run/containerd/runsc"
    20. EOF
    22. # Create the containerd.service systemd unit file
    23. cat <<EOF | sudo tee /etc/systemd/system/containerd.service
    24. [Unit]
    25. Description=containerd container runtime
    26. Documentation=https://containerd.io
    27. After=network.target
    29. [Service]
    30. ExecStartPre=/sbin/modprobe overlay
    31. Restart=always
    32. RestartSec=5
    33. Delegate=yes
    34. KillMode=process
    36. LimitNOFILE=1048576
    37. LimitNPROC=infinity
    38. LimitCORE=infinity
    40. [Install]
    41. WantedBy=multi-user.target
    42. EOF

    配置 Kubelet

    1. sudo mv ${HOSTNAME}-key.pem ${HOSTNAME}.pem /var/lib/kubelet/
    2. sudo mv ${HOSTNAME}.kubeconfig /var/lib/kubelet/kubeconfig
    3. sudo mv ca.pem /var/lib/kubernetes/
    1. sudo mv kube-proxy.kubeconfig /var/lib/kube-proxy/kubeconfig

    生成 kube-proxy.service systemd 配置文件：

    1. cat <<EOF | sudo tee /var/lib/kube-proxy/kube-proxy-config.yaml
    2. kind: KubeProxyConfiguration
    3. apiVersion: kubeproxy.config.k8s.io/v1alpha1
    4. clientConnection:
    5.   kubeconfig: "/var/lib/kube-proxy/kubeconfig"
    6. mode: "iptables"
    7. clusterCIDR: "10.200.0.0/16"
    8. EOF
    10. cat <<EOF | sudo tee /etc/systemd/system/kube-proxy.service
    11. [Unit]
    12. Description=Kubernetes Kube Proxy
    13. Documentation=https://github.com/kubernetes/kubernetes
    15. [Service]
    16. ExecStart=/usr/local/bin/kube-proxy \\
    17.   --config=/var/lib/kube-proxy/kube-proxy-config.yaml
    18. Restart=on-failure
    19. RestartSec=5
    21. [Install]
    22. WantedBy=multi-user.target
    23. EOF

    启动 worker 服务

    1. sudo systemctl daemon-reload
    2. sudo systemctl enable containerd kubelet kube-proxy
    3. sudo systemctl start containerd kubelet kube-proxy

    记得在所有 worker 节点上面都运行一遍，包括 worker-0, worker-1 和 worker-2。

    登入任意一台控制节点查询 Nodes 列表

    1. gcloud compute ssh controller-0 \

    输出为