Project to bring Kubeflow Pipelines DSL and Tekton together. The work is being driven in accordance with this evolving design doc specifications. The work is split in phases. While the details of the phases are listed in the design doc, the current effort in this repository is focused on creating a Kubeflow Pipeline compiler for Tekton, which can take KFP DSL, and compile it to Tekton YAML. You can then run those Pipelines on Tekton directly.
If you would like to take the compiled output to Kubeflow Pipelines (KFP) engine and run it through KFP SDK and UI, please follow the evolving code in the backend repository
The Tekton Pipelines project provides Kubernetes-style resources for declaring CI/CD-style pipelines. Tekton introduces several new CRDs including Task, Pipeline, TaskRun, and PipelineRun. A PipelineRun represents a single running instance of a Pipeline and is responsible for creating a Pod for each of its Tasks and as many containers within each Pod as it has Steps. Please look for more details in Tekton repo.
We are currently using Kubeflow Pipelines 0.5.0 and Tekton 0.13.0 for this project.
Getting started with KFP Tekton Compiler SDK
Available Features and Implementation Details
Compilation Tests Status Report
Samples being run end to end for verification