k8s部署
k8s删除操作: yum -y remove kubelet kubeadm kubectl sudo kubeadm reset -f sudo rm -rvf $HOME/.kube sudo rm -rvf ~/.kube/ sudo rm -rvf /etc/kubernetes/ sudo rm -rvf /etc/systemd/system/kubelet.service.d sudo rm -rvf /etc/systemd/system/kubelet.service sudo rm -rvf /usr/bin/kube* sudo rm -rvf /etc/cni sudo rm -rvf /opt/cni sudo rm -rvf /var/lib/etcd sudo rm -rvf /var/etcd
docker版本必须与k8s对应
k8s安装部署:
1.安装k8s临时关闭swap ,若不关闭执行kubeadm有些命令会报错
[root@hhdcloudrd7 /]# cat /etc/fstab # # /etc/fstab # Created by anaconda on Tue Apr 19 11:43:17 2022 # # Accessible filesystems, by reference, are maintained under '/dev/disk' # See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info # /dev/mapper/centos_hhdcloudrd6-root / xfs defaults 0 0 UUID=13a8fe45-33c8-4258-a434-133ce183d3c3 /boot xfs defaults 0 0 #/dev/mapper/centos_hhdcloudrd6-swap swap swap defaults 0 0
2.安装k8s可临时关闭selinux,减少额外配置
[root@localhost /]# cat /etc/sysconfig/selinux # This file controls the state of SELinux on the system. # SELINUX= can take one of these three values: # enforcing - SELinux security policy is enforced. # permissive - SELinux prints warnings instead of enforcing. # disabled - No SELinux policy is loaded. SELINUX=disabled # SELINUXTYPE= can take one of three values: # targeted - Targeted processes are protected, # minimum - Modification of targeted policy. Only selected processes are protected. # mls - Multi Level Security protection. SELINUXTYPE=targeted
3.关闭防火墙:
systemctl stop firewalld systemctl disable firewalld
4 启用 bridge-nf-call-iptables 预防网络问题
echo 1 > /proc/sys/net/bridge/bridge-nf-call-iptables
5.设置网桥参数
cat << EOF > /etc/sysctl.d/k8s.conf net.bridge.bridge-nf-call-ip6tables = 1 net.bridge.bridge-nf-call-iptables = 1 net.ipv4.ip_forward = 1 EOF
5.修改hosts查看域名映射文件方便
[root@hhdcloudrd7 /]# cat /etc/hosts 127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 192.168.34.7 k8s-master 192.168.5.129 k8s-node1 192.168.34.8 k8s-node2
6.查看系统版本的信息修改hosename
[root@localhost /]# hostnamectl Static hostname: localhost.localdomain Icon name: computer-vm Chassis: vm Machine ID: 5c2c4826a7cd442a85c37d3b4dba39e0 Boot ID: 3f70bab69c37412da8eada29d50cc12c Virtualization: vmware Operating System: CentOS Linux 7 (Core) CPE OS Name: cpe:/o:centos:centos:7 Kernel: Linux 3.10.0-1160.el7.x86_64 Architecture: x86-64 hostnamectl set-hostname k8s-node1 su root
7.查看cpu信息 k8s至少需要2核2G环境,否则安装失败(lscpu)
curl -fsSL https://get.docker.com | bash -s docker --mirror Aliyun
8.修改docker的 /etc/docker/daemon.json文件
[root@localhost /]# cat /etc/docker/daemon.json { "registry-mirrors": ["https://t81qmnz6.mirror.aliyuncs.com"], "exec-opts": ["native.cgroupdriver=systemd"] }
9.修改后 重启docker ,使docker与kubelet的cgroup 驱动一致
systemctl daemon-reload systemctl restart docker systemctl enable docker
10.查看kubelet驱动(不算)
cat /var/lib/kubelet/config.yaml |grep group
安装kubeadm kubelet kubectl
1.配置k8s下载资源配置文件
cat >> /etc/yum.repos.d/kubernetes.repo < EOF [kubernetes] name=Kubernetes baseurl=https://mirrors.aliyun.com/kubernetes/yum/repos/kubernetes-el7-x86_64/ enabled=1 gpgcheck=1 repo_gpgcheck=1 gpgkey=https://mirrors.aliyun.com/kubernetes/yum/doc/yum-key.gpg https://mirrors.aliyun.com/kubernetes/yum/doc/rpm-package-key.gpg EOF
- 安装 kubelet kubeadm kubectl(这里一定要注意版本问题)
yum install -y --nogpgcheck kubelet-1.23.5 kubeadm-1.23.5 kubectl-1.23.5
kubelet :运行在cluster,负责启动pod管理容器 kubeadm :k8s用于初始化的快速施工工具cluster kubectl :k8s命令工具,部署和管理应用程序,维护组件
3.检查安装是否成功
kubelet --version kubectl version kubeadm version
4.启动kubelet
systemctl daemon-reload
systemctl start kubelet
systemctl enable kubelet
5.拉取init-config配置 并修改配置 ps. init-config 主要是由 api server、etcd、scheduler、controller-manager、coredns等镜像构成
kubeadm config print init-defaults > init-config.yaml
6.修改 刚才拉取的init-config.yaml文件
[root@localhost /]# cat init-config.yaml
apiVersion: kubeadm.k8s.io/v1beta3
bootstrapTokens:
- groups:
- system:bootstrappers:kubeadm:default-node-token
token: abcdef.0123456789abcdef
ttl: 24h0m0s
usages:
- signing
- authentication
kind: InitConfiguration
localAPIEndpoint:
advertiseAddress: 192.168.34.7 #master节点IP地址
bindPort: 6443
nodeRegistration:
criSocket: /var/run/dockershim.sock
imagePullPolicy: IfNotPresent
name: master #master节点node的名称
taints: null
---
apiServer:
timeoutForControlPlane: 4m0s
apiVersion: kubeadm.k8s.io/v1beta3
certificatesDir: /etc/kubernetes/pki
clusterName: kubernetes
controllerManager: {}
dns: {}
etcd:
local:
dataDir: /var/lib/etcd
imageRepository: registry.aliyuncs.com/google_containers #修改为阿里云地址
kind: ClusterConfiguration
kubernetesVersion: 1.23.0
networking:
dnsDomain: cluster.local
serviceSubnet: 10.96.0.0/12
scheduler: {}
7.拉取k8s相关镜像
kubeadm config images pull --config=init-config.yaml
8.部署k8s(master)
kubeadm init \
--apiserver-advertise-address=192.168.31.61 \
--image-repository registry.aliyuncs.com/google_containers \
--kubernetes-version v1.17.0 \
--service-cidr=10.96.0.0/12 \
--pod-network-cidr=10.244.0.0/16
如果下载失败执行 kubeadm reset
如果是使用1.24版本需要安装对应的CRI容器要不然就会报这个错误(最先开始我遇到这个问题是直接删了从部署的,请一定看好版本)
[ERROR CRI]: container runtime is not running: output: time=“2022-05-19T16:02:33+08:00” level=fatal msg=“getting status of runtime: rpc error: code = Unimplemented desc = unknown service runtime.v1alpha2.RuntimeService”
端口占用错误:
sudo lsof -i:8081 //查看被占用端口
kill -9 pid //pid杀死端口
文件存在错误:rm -rf 文件
[ERROR DirAvailable--var-lib-etcd]: /var/lib/etcd is not empty //删除该文件
在master节点运行以下三行命令 执行完成后可以通过 kubeadm token list获取token
mkdir -p $HOME/.kube
sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
sudo chown $(id -u):$(id -g) $HOME/.kube/config
kubectl get nodes
9.安装网络插件(此处会发生dns解析错误在/etc/hosts文件中重定向域名
185.199.109.133 raw.githubusercontent.com)
kubectl apply –f
https://raw.githubusercontent.com/coreos/flannel/master/Documentation/kube-
flannel.yml
10.向k8s集群中添加节点
kubeadm join 192.168.197.168:6443 --token usmphm.018gei3h7fd2zey7 \
--discovery-token-ca-cert-hash sha256:561785321d0305d65def82ab00a09e3a4b3db08c990cc62484d6396b2cd9d224
11.在 Kubernetes 集群中创建一个 pod,验证是否正常运行:
$ kubectl create deployment nginx --image=nginx
$ kubectl expose deployment nginx --port=80 --type=NodePort
$ kubectl get pod,svc
访问地址:http://NodeIP:Port
如果出现容器无法初始化状态(ContainerCreating)执行:
kubectl apply -f https://raw.githubusercontent.com/coreos/flannel/2140ac876ef134e0ed5af15c65e414cf26827915/Documentation/kube-flannel.yml