云原生CI/CD框架Tekton国内部署方式

Tekton 是一款功能非常强大而灵活的 CI/CD 开源的云原生框架。致力于提供全功能、标准化的云原生 CI/CD 解决方案。【本文主要是通过流水线自动化的将tekton镜像同步到腾讯云仓库，并部署tekton】

应用镜像

阿里云镜像仓库居然有限制...这次转到腾讯云镜像仓库了;ccr.ccs.tencentyun.com/tektons/dashboard

Pipeline

借助GitHub Actions:

1. 同步镜像并生成镜像映射文件(json):
2. 收集镜像映射文件为制品;

1. This is a basic workflow to help you get started with Actions
3. name: Get Tekton Images
4. env:
5. VERSION: v0.29.0
7. on:
8. push:
9. paths:
10. - '.github/workflows/tekton.yaml'
11. - 'tekton/**'
13. jobs:
14. build:
15. runs-on: ubuntu-18.04
16. steps:
17. - uses: actions/checkout@v2
18. - name: build
19. run: |
21. curl https://storage.googleapis.com/tekton-releases/pipeline/previous/${{ env.VERSION }}/release.yaml -o release.yaml
22. grep -v "#" release.yaml | grep -v "^$" > release1.yaml ; sed -i 's/\-\-\-/###/g' release1.yaml
23. python3 tekton/get_tekton_images.py ${{ secrets.DOCKER_USER}} ${{ secrets.DOCKER_PASSWD}}
24. - uses: actions/upload-artifact@v2
25. with:
26. name: ${{ env.VERSION }}-tekton-images
27. path: tekton_images.json

部署文件解析

1.下载release部署yaml;

2.解析Deployments对象中的images;

a.tekton-pipelines-controller

b.tekton-pipelines-webhook

c.tekton-dashboard(最新tag)

1. gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/controller:v0.29.0@sha256:72f79471f06d096cc53e51385017c9f0f7edbc87379bf415f99d4bd11cf7bc2b
2. gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/kubeconfigwriter:v0.29.0@sha256:6d058f2203b9ab66f538cb586c7dc3b7cc31ae958a4135dd99e51799f24b06c9
3. gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/git-init:v0.29.0@sha256:c0b0ed1cd81090ce8eecf60b936e9345089d9dfdb6ebdd2fd7b4a0341ef4f2b9
4. gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/entrypoint:v0.29.0@sha256:66958b78766741c25e31954f47bc9fd53eaa28263506b262bf2cc6df04f18561
5. gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/nop:v0.29.0@sha256:6a037d5ba27d9c6be32a9038bfe676fb67d2e4145b4f53e9c61fb3e69f06e816
6. gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/imagedigestexporter:v0.29.0@sha256:e38dd0d32253fce5aaf1e501c0bc71facc3720564b7e97055921cc5390d612e0
7. gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/pullrequest-init:v0.29.0@sha256:d28202fb8b33a1d4c05f261ef8dcbcdcf3b469887d4dad256ce91f73c917420e
8. gcr.io/google.com/cloudsdktool/cloud-sdk@sha256:27b2c22bf259d9bc1a291e99c63791ba0c27a04d2db0a43241ba0f1f20f4067f
9. gcr.io/distroless/base@sha256:aa4fd987555ea10e1a4ec8765da8158b5ffdfef1e72da512c7ede509bc9966c4
10. mcr.microsoft.com/powershell:nanoserver@sha256:b6d5ff841b78bdf2dfed7550000fd4f3437385b8fa686ec0f010be24777654d6
11. gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/webhook:v0.29.0@sha256:46d5b90a7f4e9996351ad893a26bcbd27216676ad4d5316088ce351fb2c2c3dd

用Python编写一个数据解析脚本：

1. import yaml
2. import json
3. import sys
4. import os
6. class Tekton :
7. def __init__(self, file_name, registry_user, registry_passwd):
8. self.yaml_file = file_name
9. self.arg_imgs = ["gcr.io/tekton-releases/github.com/tektoncd/dashboard/cmd/dashboard@sha256:95f71a2568ced67ec370b5360f88bec3280601908cac9e62dfbb801114480437"]
10. self.split_str = "###"
11. self.deployments = ["tekton-pipelines-controller", "tekton-pipelines-webhook"]
12. self.kind_type = "Deployment"
13. self.target_registry = "ccr.ccs.tencentyun.com/tektons/"
14. self.repos = [ "controller", "kubeconfigwriter", "git-init",
15. "entrypoint","nop","imagedigestexporter",
16. "pullrequest-init", "cloud-sdk", "base", "powershell", "webhook"]
17. self.result = []
18. self.registry_user = registry_user
19. self.registry_passwd = registry_passwd
21. def load_yaml(self, data):
22. content = yaml.load(data)
23. return content
25. def load_json(self, data):
26. content = json.loads(data)
27. return content
29. def get_images(self):
30. f = open(self.yaml_file, 'r').read()
31. for i in f.split("###")[:-1]:
32. try:
33. content = self.load_yaml(i.replace("###", ""))
34. if content["kind"] == self.kind_type:
35. deploy_name = content["metadata"]["name"]
36. # 获取image
37. if deploy_name in self.deployments:
38. img = content["spec"]["template"]["spec"]["containers"][0]["image"]
39. self.arg_imgs.append(img)
40. # 获取参数中的images
41. if deploy_name == "tekton-pipelines-controller":
42. arg_img = content["spec"]["template"]["spec"]["containers"][0]["args"]
43. for a in arg_img:
44. if not a.startswith("-"):
45. self.arg_imgs.append(a)
46. except Exception as e:
47. print(e)
48. return self.arg_imgs
50. def save_json_file(self, data, file_name):
51. for i in self.arg_imgs:
52. self.result.append({
53. "s_image": i,
54. "t_image": self.target_registry + i.split("/")[-1].split("@")[0]
55. })
56. newdata = json.dumps(self.result, indent=4)
57. a=open(file_name, 'w')
58. a.write(newdata)
59. a.close()
61. def sync_images(self):
62. f = open("tekton_images.json", 'r').read()
63. content = self.load_json(f)
64. docker_login_cmd = "docker login -u {0} -p {1} {2}".format(
65. self.registry_user,
66. self.registry_passwd,
67. self.target_registry.split("/")[0])
68. os.system(docker_login_cmd)
69. for item in content:
70. print("[GetImages] {}".format(item))
71. docker_pull_cmd = "docker pull {0}".format(item["s_image"])
72. docker_tag_cmd = "docker tag {0} {1}".format(item["s_image"], item["t_image"])
73. docker_push_cmd = "docker push {0}".format(item["t_image"])
74. os.system(docker_pull_cmd + "&&" + docker_tag_cmd + "&&" + docker_push_cmd )
75. print("[GetImagesDone] {}".format(item))
77. if __name__ == '__main__':
78. tekton = Tekton("release1.yaml", sys.argv[1], sys.argv[2])
79. images = tekton.get_images()
80. tekton.save_json_file(images, "tekton_images.json")
81. tekton.sync_images()

镜像映射文件

s_image 原始镜像名称， t_image 目标镜像名称; 这里使用腾讯云的镜像仓库;

1. [
2. {
3. "s_image": "gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/controller:v0.29.0@sha256:72f79471f06d096cc53e51385017c9f0f7edbc87379bf415f99d4bd11cf7bc2b",
4. "t_image": "ccr.ccs.tencentyun.com/tektons/controller:v0.29.0"
5. },
6. {
7. "s_image": "gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/kubeconfigwriter:v0.29.0@sha256:6d058f2203b9ab66f538cb586c7dc3b7cc31ae958a4135dd99e51799f24b06c9",
8. "t_image": "ccr.ccs.tencentyun.com/tektons/kubeconfigwriter:v0.29.0"
9. },
10. {
11. "s_image": "gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/git-init:v0.29.0@sha256:c0b0ed1cd81090ce8eecf60b936e9345089d9dfdb6ebdd2fd7b4a0341ef4f2b9",
12. "t_image": "ccr.ccs.tencentyun.com/tektons/git-init:v0.29.0"
13. },
14. {
15. "s_image": "gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/entrypoint:v0.29.0@sha256:66958b78766741c25e31954f47bc9fd53eaa28263506b262bf2cc6df04f18561",
16. "t_image": "ccr.ccs.tencentyun.com/tektons/entrypoint:v0.29.0"
17. },
18. {
19. "s_image": "gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/nop:v0.29.0@sha256:6a037d5ba27d9c6be32a9038bfe676fb67d2e4145b4f53e9c61fb3e69f06e816",
20. "t_image": "ccr.ccs.tencentyun.com/tektons/nop:v0.29.0"
21. },
22. {
23. "s_image": "gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/imagedigestexporter:v0.29.0@sha256:e38dd0d32253fce5aaf1e501c0bc71facc3720564b7e97055921cc5390d612e0",
24. "t_image": "ccr.ccs.tencentyun.com/tektons/imagedigestexporter:v0.29.0"
25. },
26. {
27. "s_image": "gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/pullrequest-init:v0.29.0@sha256:d28202fb8b33a1d4c05f261ef8dcbcdcf3b469887d4dad256ce91f73c917420e",
28. "t_image": "ccr.ccs.tencentyun.com/tektons/pullrequest-init:v0.29.0"
29. },
30. {
31. "s_image": "gcr.io/google.com/cloudsdktool/cloud-sdk@sha256:27b2c22bf259d9bc1a291e99c63791ba0c27a04d2db0a43241ba0f1f20f4067f",
32. "t_image": "ccr.ccs.tencentyun.com/tektons/cloud-sdk"
33. },
34. {
35. "s_image": "gcr.io/distroless/base@sha256:aa4fd987555ea10e1a4ec8765da8158b5ffdfef1e72da512c7ede509bc9966c4",
36. "t_image": "ccr.ccs.tencentyun.com/tektons/base"
37. },
38. {
39. "s_image": "mcr.microsoft.com/powershell:nanoserver@sha256:b6d5ff841b78bdf2dfed7550000fd4f3437385b8fa686ec0f010be24777654d6",
40. "t_image": "ccr.ccs.tencentyun.com/tektons/powershell:nanoserver"
41. },
42. {
43. "s_image": "gcr.io/tekton-releases/github.com/tektoncd/pipeline/cmd/webhook:v0.29.0@sha256:46d5b90a7f4e9996351ad893a26bcbd27216676ad4d5316088ce351fb2c2c3dd",
44. "t_image": "ccr.ccs.tencentyun.com/tektons/webhook:v0.29.0"
45. },
46. {
47. "s_image": "gcr.io/tekton-releases/github.com/tektoncd/dashboard/cmd/dashboard@sha256:95f71a2568ced67ec370b5360f88bec3280601908cac9e62dfbb801114480437",
48. "t_image": "ccr.ccs.tencentyun.com/tektons/dashboard"
50. }
51. ]

镜像映射文件可以在GitHubActions页面下载：

下载镜像脚本

解析上面生成的镜像文件，docker pull下载对应的镜像到本地;

1. import json
2. import os
4. class Tekton:
5. def __init__(self):
6. self.json_file = "tekton_images.json"
7. self.target_registry = "ccr.ccs.tencentyun.com/tektons/"
8. # self.registry_user = registry_user
9. # self.registry_passwd = registry_passwd
11. def load_json(self, data):
12. content = json.loads(data)
13. return content
15. def down_images(self):
16. f = open(self.json_file, 'r').read()
17. content = self.load_json(f)
19. # docker_login_cmd = "docker login -u {0} -p {1} {2}".format(
20. # self.registry_user,
21. # self.registry_passwd,
22. # self.target_registry.split("/")[0])
23. for item in content:
24. print("[GetImages] {}".format(item["t_image"]))
25. docker_pull_cmd = "docker pull {0}".format(item["t_image"])
26. # docker_tag_cmd = "docker tag {0} {1}".format(item["t_image"], item["s_image"].split("@")[0])
27. os.system(docker_pull_cmd + "&&" + docker_tag_cmd )
28. print("[GetImagesDone] {}".format(item))
30. if __name__ == '__main__':
31. t = Tekton().down_images()

部署Tekton

替换部署文件中的镜像:

1. 手动更新release.yaml中的镜像;然后kubectl apply release.yaml 部署(后续有时间再优化脚本，实现自动更新release.yaml)
2. 手动更新tekton-dashboard-release.yaml中的镜像;然后部署;

1. [root@master ~]# kubectl -n tekton-pipelines get pod
2. NAME READY STATUS RESTARTS AGE
3. tekton-dashboard-5c4b89d9-2z8g7 1/1 Running 0 21m
4. tekton-pipelines-controller-b96f647bb-gff69 1/1 Running 0 13h
5. tekton-pipelines-webhook-76bc9c97b9-cd2m4 1/1 Running 0 13h

编写一个Ingress来暴露tekton dashboard：

1. apiVersion: extensions/v1beta1
2. kind: Ingress
3. metadata:
4. name: tekton-service
5. namespace: tekton-pipelines
6. annotations:
7. kubernetes.io/ingress.class: nginx
8. nginx.ingress.kubernetes.io/proxy-body-size: 256m
9. spec:
10. rules:
11. - host: tekton.idevops.site
12. http:
13. paths:
14. - path: /
15. backend:
16. serviceName: tekton-dashboard
17. servicePort: 9097

访问UI页面：

编写Pipeline

1. apiVersion: tekton.dev/v1beta1
2. kind: Task
3. metadata:
4. name: tektoncd-task
5. spec:
6. resources:
7. inputs:
8. - name: repo
9. type: git
10. steps:
11. - name: run-test
12. image: maven:3-jdk-8
13. workingDir: /workspace/repo
14. command: ["mvn"]
15. args: ["clean", "package"]
16. ---
17. apiVersion: tekton.dev/v1alpha1
18. kind: PipelineResource
19. metadata:
20. name: tektoncd-resource
21. spec:
22. type: git
23. params:
24. - name: url
25. value: http://192.168.1.200/devops/devops-maven-service.git
26. - name: revision
27. value: master
28. ---
29. apiVersion: tekton.dev/v1beta1
30. kind: TaskRun
31. metadata:
32. name: cdpipeline
33. spec:
34. taskRef:
35. name: tektoncd-task
36. resources:
37. inputs:
38. - name: repo
39. resourceRef:
40. name: tektoncd-resource

原文链接：https://mp.weixin.qq.com/s/Rn44lRhaEC4YkUi2dD7TKg