Seata Kubernetes Operations Tool

Clone this repo:
  1. f629513 feature: add volume cleanup behaviour and optimize setup defaults procedure (#21) by Xiangkun Yin · 3 months ago master
  2. 433dd3f feature: enable debugging locally without building images (#20) by Xiangkun Yin · 5 months ago
  3. 7dc9f73 bugfix: close the response body for changeCluster http request (#22) by Iceber Gu · 5 months ago
  4. ee6eef5 feature: support ConfigMap and Secret by changing env from map to EnvVar (#17) by Xiangkun Yin · 6 months ago
  5. 38aa162 chore: change notifications mailbox (#19) by Xiangkun Yin · 9 months ago

seata-k8s

中文文档

Associated Projects:

Method 1: Using Operator

Usage

To deploy Seata Server using the Operator method, follow these steps:

  1. Clone this repository:

    git clone https://github.com/apache/incubator-seata-k8s.git
    
  2. Deploy Controller, CRD, RBAC, and other resources to the Kubernetes cluster:

    make deploy
    kubectl get deployment -n seata-k8s-controller-manager  # check if exists
    
  3. You can now deploy your CR to the cluster. An example can be found here seata-server-cluster.yaml:

    apiVersion: operator.seata.apache.org/v1alpha1
    kind: SeataServer
    metadata:
      name: seata-server
      namespace: default
    spec:
      serviceName: seata-server-cluster
      replicas: 3
      image: seataio/seata-server:latest
      persistence:
    	  volumeReclaimPolicy: Retain
        spec:
          resources:
            requests:
            	storage: 5Gi
    

    For the example above, if everything is correct, the controller will deploy 3 StatefulSet resources and a Headless Service to the cluster. You can access the Seata Server cluster in the cluster through seata-server-0.seata-server-cluster.default.svc.

Reference

For CRD details, you can visit operator.seata.apache.org_seataservers.yaml. Here are some important configurations:

  1. serviceName: Used to define the name of the Headless Service deployed by the controller. This will affect how you access the server cluster. In the example above, you can access the Seata Server cluster through seata-server-0.seata-server-cluster.default.svc.

  2. replicas: Defines the number of Seata Server replicas. Adjusting this field achieves scaling without the need for additional HTTP requests to change the Seata raft cluster list.

  3. image: Defines the Seata Server image name.

  4. ports: Three ports need to be set under the ports property: consolePort, servicePort, and raftPort, with default values of 7091, 8091, and 9091, respectively.

  5. resources: Used to define container resource requirements.

  6. persistence.spec: Used to define mounted storage resource requirements.

  7. persistence.volumeReclaimPolicy: Used to control volume reclaim behavior, possible choices include Retain or Delete, which infer retain volumes or delete volumes after deletion respectively.

  8. env: Environment variables passed to the container. You can use this field to define Seata Server configuration. For example:

    apiVersion: operator.seata.apache.org/v1alpha1
    kind: SeataServer
    metadata:
      name: seata-server
      namespace: default
    spec:
      image: seataio/seata-server:latest
      store:
        resources:
          requests:
            storage: 5Gi
      env:
      - name: console.user.username
        value: seata
      - name: console.user.password
        valueFrom:
          secretKeyRef:
            name: seata
            key: password
    ---
    apiVersion: v1
    kind: Secret
    metadata:
      name: seata
    type: Opaque
    data:
      password: seata
    

For Developer

To debug this operator locally, we suggest you use a test k8s environment like minikube.

  1. Method 1. Modify code and build the controller image:

    Assume you are using minikube for testing,

    eval $(minikube docker-env)
    make docker-build deploy
    
  2. Method 2. Locally debug without building images

    You need to use telepresence to proxy traffic to the k8s cluster, see telepresence tutorial to install its cli tool and traffic manager. After installing telepresence, you can connect to minikube by following commands:

    telepresence connect
    # Check if traffic manager connected
    telepresence status
    

    By executing above commands, you can use in-cluster DNS resolution and proxy your requests to the cluster. And then you can use IDE to run or debug locally:

    # Make sure generate proper resources first
    make manifests generate fmt vet
    
    go run .
    # Or you can use IDE to run locally instead
    

Method 2: Example without Using Operator

Due to certain reasons, Seata Docker images currently do not support external container calls. Therefore, the example projects should also be kept in link mode with the Seata image inside the container.

# Start Seata deployment (nacos,seata,mysql)
kubectl create -f deploy/seata-deploy.yaml
# Start Seata service (nacos,seata,mysql)
kubectl create -f deploy/seata-service.yaml
# Get a NodePort IP (kubectl get service)
# Modify the IP in examples/examples-deploy for DNS addressing
# Connect to MySQL and import table structure
# Start example deployment (samples-account,samples-storage)
kubectl create -f example/example-deploy.yaml
# Start example service (samples-account,samples-storage)
kubectl create -f example/example-service.yaml
# Start order deployment (samples-order)
kubectl create -f example/example-deploy.yaml
# Start order service (samples-order)
kubectl create -f example/example-service.yaml
# Start business deployment (samples-dubbo-business-call)
kubectl create -f example/business-deploy.yaml
# Start business deployment (samples-dubbo-service-call)
kubectl create -f example/business-service.yaml

Open the Nacos console in your browser [http://localhost:8848/nacos/] to check if all instances are registered successfully.

Testing

# Account service - Deduct amount
curl -H "Content-Type: application/json" -X POST --data "{\"id\":1,\"userId\":\"1\",\"amount\":100}" cluster-ip:8102/account/dec_account
# Storage service - Deduct stock
curl -H "Content-Type: application/json" -X POST --data "{\"commodityCode\":\"C201901140001\",\"count\":100}" cluster-ip:8100/storage/dec_storage
# Order service - Add order and deduct amount
curl -H "Content-Type: application/json" -X POST --data "{\"userId\":\"1\",\"commodityCode\":\"C201901140001\",\"orderCount\":10,\"orderAmount\":100}" cluster-ip:8101/order/create_order
# Business service - Client Seata version too low
curl -H "Content-Type: application/json" -X POST --data "{\"userId\":\"1\",\"commodityCode\":\"C201901140001\",\"count\":10,\"amount\":100}" cluster-ip:8104/business/dubbo/buy