Frakti

    • 特权容器以Docker container的方式运行
    • 而普通容器则以hyper container的方法运行在VM内

    Frakti提供了一个简便的安装脚本，可以一键在Ubuntu或CentOS上启动一个本机的Kubernetes+frakti集群。

    首先需要在所有机器上安装hyperd, docker, frakti, CNI 和 kubelet。

    Ubuntu 16.04+:

    2. curl -sSL https://hypercontainer.io/install | bash

    CentOS 7:

    1. curl -sSL https://hypercontainer.io/install | bash
    1. echo -e "Kernel=/var/lib/hyper/kernel\n\
    2. Initrd=/var/lib/hyper/hyper-initrd.img\n\
    3. Hypervisor=qemu\n\
    4. StorageDriver=overlay\n\
    5. gRPCHost=127.0.0.1:22318" > /etc/hyper/config
    6. systemctl enable hyperd
    7. systemctl restart hyperd

    安装docker

    Ubuntu 16.04+:

    1. apt-get update
    2. apt-get install -y docker.io

    CentOS 7:

    1. yum install -y docker

    启动docker:

    1. curl -sSL https://github.com/kubernetes/frakti/releases/download/v0.2/frakti -o /usr/bin/frakti
    2. chmod +x /usr/bin/frakti
    3. cgroup_driver=$(docker info | awk '/Cgroup Driver/{print $3}')
    4. cat <<EOF > /lib/systemd/system/frakti.service
    5. [Unit]
    6. Description=Hypervisor-based container runtime for Kubernetes
    7. Documentation=https://github.com/kubernetes/frakti
    8. After=network.target
    10. [Service]
    11. ExecStart=/usr/bin/frakti --v=3 \
    12.           --log-dir=/var/log/frakti \
    13.           --logtostderr=false \
    14.           --cgroup-driver=${cgroup_driver} \
    15.           --listen=/var/run/frakti.sock \
    16.           --hyper-endpoint=127.0.0.1:22318
    17. MountFlags=shared
    18. TasksMax=8192
    19. LimitNOFILE=1048576
    20. LimitNPROC=1048576
    21. LimitCORE=infinity
    22. TimeoutStartSec=0
    23. Restart=on-abnormal
    26. WantedBy=multi-user.target
    27. EOF

    安装CNI

    Ubuntu 16.04+:

    1. apt-get update && apt-get install -y apt-transport-https
    2. curl -s https://packages.cloud.google.com/apt/doc/apt-key.gpg | apt-key add -
    3. cat <<EOF > /etc/apt/sources.list.d/kubernetes.list
    4. deb http://apt.kubernetes.io/ kubernetes-xenial main
    5. EOF
    6. apt-get update
    7. apt-get install -y kubernetes-cni
    1. cat <<EOF > /etc/yum.repos.d/kubernetes.repo
    2. [kubernetes]
    3. name=Kubernetes
    4. baseurl=http://yum.kubernetes.io/repos/kubernetes-el7-x86_64
    5. enabled=1
    6. gpgcheck=1
    7. repo_gpgcheck=1
    8. gpgkey=https://packages.cloud.google.com/yum/doc/yum-key.gpg
    9.        https://packages.cloud.google.com/yum/doc/rpm-package-key.gpg
    10. EOF
    11. setenforce 0
    12. yum install -y kubernetes-cni

    配置CNI网络，注意

    • frakti目前仅支持bridge插件
    • 所有机器上Pod的子网不能相同，比如master上可以用10.244.1.0/24，而第一个Node上可以用10.244.2.0/24
    1. mkdir -p /etc/cni/net.d
    2. cat >/etc/cni/net.d/10-mynet.conf <<-EOF
    3. {
    4.     "cniVersion": "0.3.0",
    5.     "name": "mynet",
    6.     "type": "bridge",
    7.     "bridge": "cni0",
    8.     "isGateway": true,
    9.     "ipMasq": true,
    10.         "type": "host-local",
    11.         "subnet": "10.244.1.0/24",
    12.         "routes": [
    13.             { "dst": "0.0.0.0/0"  }
    15.     }
    16. }
    17. EOF
    18. cat >/etc/cni/net.d/99-loopback.conf <<-EOF
    19. {
    20.     "cniVersion": "0.3.0",
    21.     "type": "loopback"
    22. }
    23. EOF

    Ubuntu 16.04+:

    1. apt-get install -y kubelet kubeadm kubectl

    CentOS 7:

    配置Kubelet使用frakti runtime:

    1. sed -i '2 i\Environment="KUBELET_EXTRA_ARGS=--container-runtime=remote --container-runtime-endpoint=/var/run/frakti.sock --feature-gates=AllAlpha=true"' /etc/systemd/system/kubelet.service.d/10-kubeadm.conf
    2. systemctl daemon-reload

    配置Master

    1. kubeadm init kubeadm init --pod-network-cidr 10.244.0.0/16 --kubernetes-version latest
    3. # Optional: enable schedule pods on the master
    4. export KUBECONFIG=/etc/kubernetes/admin.conf
    5. kubectl taint nodes --all node-role.kubernetes.io/master:NoSchedule-
    1. # get token on master node
    2. token=$(kubeadm token list | grep authentication,signing | awk '{print $1}')
    4. # join master on worker nodes
    5. kubeadm join --token $token ${master_ip}

    配置CNI网络路由

    1. NODE   IP_ADDRESS   CONTAINER_CIDR
    2. master 10.140.0.1  10.244.1.0/24
    3. node-1 10.140.0.2  10.244.2.0/24
    4. node-2 10.140.0.3  10.244.3.0/24

    CNI的网络路由可以这么配置：

    1. # on master
    2. ip route add 10.244.2.0/24 via 10.140.0.2
    3. ip route add 10.244.3.0/24 via 10.140.0.3
    5. # on node-1
    6. ip route add 10.244.1.0/24 via 10.140.0.1
    7. ip route add 10.244.3.0/24 via 10.140.0.3
    9. # on node-2
    10. ip route add 10.244.1.0/24 via 10.140.0.1
    11. ip route add 10.244.2.0/24 via 10.140.0.2