title: Kubernetes Deployment sidebar_position: 1.4

This article describes how to deploy a Linkis service in a Kind Kubernetes environment for easier learning and debugging.

1. Dependencies and versions

kind github：https://github.com/kubernetes-sigs/kind
kind web site：kind.sigs.k8s.io/

1.1 Versions

  • kind 0.14.0
  • docker 20.10.17
  • centos 7.6
  • helm 3.x

1.2 Notice

    1. Ensure that the component depends on the version
    1. kind means that the machine simulating node with docker container is restarted and the container has changed and the scheduler is not working anymore. This is a kind limitation and there is a detailed explanation in the official document.

2.Install the docker

2.1 Install the tutorial

sudo yum install -y yum-utils device-mapper-persistent-data lvm2
sudo yum-config-manager --add-repo https://mirrors.aliyun.com/docker-ce/linux/centos/docker-ce.repo
sudo sed -i 's+download.docker.com+mirrors.aliyun.com/docker-ce+' /etc/yum.repos.d/docker-ce.repo
sudo yum makecache fast
sudo yum -y install docker-ce
systemctl start docker
systemctl enable docker

2.2 Setting a Domestic Image

vi /etc/docker/daemon.json
{
"registry-mirrors": ["http://hub-mirror.c.163.com"],
"insecure-registries": ["https://registry.mydomain.com","http://hub-mirror.c.163.com"]
}

3. Install the kind

3.1 Manually download the kind binary

https://github.com/kubernetes-sigs/kind/releases

3.2 Install kind Binary

chmod +x ./kind
mv kind-linux-amd64 /usr/bin/kind

4. Install linkis

4.1 Download linkis1.3.0 deployment package

apache-linkis-1.3.0-incubating-bin.tar.gz

4.2 Build directory

mkdir -p /opt/data/common/extendlib

4.3 Copy driver to /opt/data/common/extendlib

curl https://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.28/mysql-connector-java-8.0.28.jar -o /opt/data/common/extendlib/[mysql-connector-java-8.0.28.jar](https://repo1.maven.org/maven2/mysql/mysql-connector-java/8.0.28/mysql-connector-java-8.0.28.jar)

4.4 Reset kind (not necessary)

./bin/install-linkis-to-kubernetes.sh reset

4.5 Pull the image

./bin/install-linkis-to-kubernetes.sh pull -mghcr.dockerproxy.com

4.6 Install linkis to kind

./bin/install-linkis-to-kubernetes.sh install -l -mghcr.dockerproxy.com

4.7 Run commands to view services and wait until all services are successfully started

kubectl get pods -A

4.8 Copy the ldh environment to linkis

./helm/scripts/prepare-for-spark.sh

4.9 Enabling Port Mapping

./helm/scripts/remote-proxy.sh start

4.10 Access to the system

linkis-web: http://10.0.2.101:8088/
eureka: http://10.0.2.101:20303/

4.11 Into the container

./helm/scripts/login-pod.sh cg-engineconnmanager
Executing shell tests
sh ./bin/linkis-cli -engineType shell-1 -codeType shell -code "echo "hello" "  -submitUser hadoop -proxyUser hadoop
Executing hive Tests
sh ./bin/linkis-cli -engineType hive-2.3.3 -codeType hql -code "show tables"  -submitUser hadoop -proxyUser hadoop
Executing spark Tests
sh ./bin/linkis-cli -engineType spark-2.4.3 -codeType sql -code "show tables"  -submitUser hadoop -proxyUser hadoop
Executing python Tests
sh ./bin/linkis-cli -engineType python-python2 -codeType python -code "print(\"hello\")"  -submitUser hadoop -proxyUser hadoop  -confMap  python.version=python