Coder Social home page Coder Social logo

batch-scoring-deep-learning-models-with-kubernetes's Introduction

Batch Scoring Deep Learning Models With Kubernetes

Based on Batch Scoring Deep Learning Models With AKS

Overview

In this repository, we use the scenario of applying vehicle detection onto a video (collection of images). This architecture can be generalized for any batch scoring with deep learning scenario.

Design

Reference Architecture Diagram

The above architecture works as follows:

  1. Upload a video file to storage.
  2. The video file will trigger Logic App to send a request to the flask endpoint hosted on one of the nodes of the AKS cluster.
  3. That node will first preprocess the video file by splitting the video into individual images and extracting the audio file.
  4. That node will then add all images to the Service Bus queue.
  5. The other nodes in the AKS cluster are continuously polling the Service Bus queue - as soon as any images are in the queue, it will pull it off the queue and apply style transfer to the image.
  6. When all frames have been processed, the images will be stitched back together into a video with the audio file.

Prerequsites

Local/Working Machine:

Accounts:

While it is not required, it is also useful to use the Azure Storage Explorer to inspect your storage account.e az cli installed and logged into

Setup

  1. Clone the repo git clone https://github.com/Azure/Batch-Scoring-Deep-Learning-Models-With-AKS
  2. cd into the repo
  3. Setup your conda env using the environment.yml file conda env create -f environment.yml - this will create a conda environment called batchscoringdl
  4. Activate your environment source activate batchscoringdl
  5. Log in to Azure using the az cli az login

Steps

Run throught the following notebooks:

  1. Test the vechicle detection script
  2. Setup Azure - Resource group, Storage, Service Bus.
  3. Test the model locally
  4. Create the AKS cluster
  5. Run vehicle detection on the cluster
  6. Deploy Logic Apps
  7. Clean up

Clean up

To clean up your working directory, you can run the clean_up.sh script that comes with this repo. This will remove all temporary directories that were generated as well as any configuration (such as Dockerfiles) that were created during the tutorials. This script will not remove the .env file.

To clean up your Azure resources, you can simply delete the resource group that all your resources were deployed into. This can be done in the az cli using the command az group delete --name <name-of-your-resource-group>, or in the portal. If you want to keep certain resources, you can also use the az cli or the Azure portal to cherry pick the ones you want to deprovision. Finally, you should also delete the service principle using the az ad sp delete command.

All the step above are covered in the final notebook.

batch-scoring-deep-learning-models-with-kubernetes's People

Contributors

danielleodean avatar ewyuanzhang avatar jiata avatar microsoftopensource avatar msftgits avatar

Stargazers

 avatar

Watchers

 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.