divloic / edml-cicd-base

Gitlab runner image from the event-driven ml experiment

EDML CI/CD Base

Gitlab runner image from the event driven ml experiment

About EDML

Event-Driven Machine Learning is an experiment ran by @DivLoic and @Giulbia. The idea is to bring together all the components to build a system serving prediction in realtime. From exploring the data with interactive tools like Ai Platform to deploying streaming application in the cloud with Confluent Cloud the EDML project discuss the important points leading to model serving automation.

Why?

The EMDL runners serve multiple purposes, such as: packaging maven projects, creating python artifacts or submitting model trainings on Google Cloud AI Platform. To create a single image with all the necessary dependencies (e.g. maven, python, gcloud SDK) this module use Github Actions and push the result to docker hub. In addition, the image contains a few scripts carrying the CI logic of project. It helps write the Gitlab CI stages for each module from event-driven-ml.

How?

See also

• EDMl at Xebicon'19
• EDML: Event-driven ml slides (2019)
• EDMl on Confluent Webinar
• EDML: Event-driven ml slides (2020)