mustafamerttunali / deep-learning-training-gui

Train and predict your model on pre-trained deep learning models through the GUI (web app). No more many parameters, no more data preprocessing.

Description

My goal is to simplify the installation and training of pre-trained deep learning models through the GUI (or you can call web app) without writing extra code. Set your dataset and start the training right away and monitor it with TensorBoard or DLTGUI tool. No more many parameters, no more data preprocessing.

While developing this application, I was inspired by the DIGITS system developed by NVIDIA.

• You won't have any problems for training image classification algorithms.
• It is easy to train a image classification model, save the model, and make predictions from the saved model.
• A few parameters!
• You will be able to train on pre-trained models.
• It doesn't exist for 1.0 but, it will be much easier to train and use object detection algortihms.
• You can train your model on GPU or CPU.
• Parallel operation is possible.
• You won't be needing a second terminal and a script code to run TensorBoard.

In the words of Stephen Hawking:

Science is beautiful when it makes simple explanations of phenomena or connections between different observations. Examples include the double helix in biology and the fundamental equations of physics.

Guide - Youtube Video (Coming Soon)

Updates

DLTGUI Version 1.0.9

• Bug Fixes (There was a problem about showing heatmap for Cuda >= 10.0, fixed).

DLTGUI Version 1.0.8

• Bug fixes.

DLTGUI Version 1.0.7

• Many bugs have been solved.

• You will be able to Fine-Tuning your model. In this way, you can easily increase the success rate of the model.

• You will be able to see which parts your model focuses on while classifying images (Class activation map, heat map - heatmap - available for MobileNetV2 only)

DLTGUI Version 1.0.6

• Bug fixes.

DLTGUI Version 1.0.5

• Now you can do data augmentation using Augmentor.

DLTGUI Version 1.0.4

• Now you can choose CPU or GPU before the training.
• You are able to choose activation function for singe-class training. (Sigmoid and ReLu [new])
• Added SimpleCNNModel
• Fixed bugs

DLTGUI Version 1.0.2

• Fixed single class problem, now you can train one-class model,
• Added sigmoid as activation function and binary_crossentropy as loss function,
• Added new function to DLGUI (prepare_data, sigmoid and more)
• Added new example dataset.

DLTGUI Version 1.0.1:

• Now you can use InceptionV3, VGG16, VGG19 and NASNetMobile models. [Image Classification]

Getting started

Prerequisites

• Anaconda 64-bit
• Python 3.7.3
• Tensorflow 2.0.1
• CUDA and CUDNN ( Minimum Cuda 10.0 - for gpu usage)
• Numpy 1.16.4
• Matplotlib
• PIL
• subprocess
• pathlib
• Augmentor

Available models

• MobileNetV2
• Inception V3
• VGG16
• VGG19
• NASNetMobile
• SimpleCnnModel

Dataset Folder Structure

The following is an example of how a dataset should be structured. Before you train a deep learning model, put all your dataset into datasets directory.

├──datasets/
    ├──example_dataset/
        ├── cat
        │   ├── img_1.jpg/png
        │   └── img_2.jpg/png
    ├──flower_photos/
        ├── daisy
        │── dandelion
        │── roses
        │── sunflowers
        │── tulips
        
For image classification.

Usage

Page - Home

1. Clone this repo.
2. cd Deep-Learning-Training-GUI
3. On your conda terminal: pip install -r requirements.txt
4. Set your dataset directory as I show above.
5. When you set your dataset, go to the terminal and run python app.py. You can access the program on localhost:5000
6. Now you will see the home page.

Page - Training - Parameters

7. You must enter the path where your dataset is located. For example, I want to select the flower_photos folder in the datasets and I will write to the form element like this: datasets/flower_photos
8. Split the dataset, we need to specify what percentage of the training data we will use as a test.
9. Pre-trained Models - Currently only MobileNetV2 is available, but in future versions you can easily select other pre-trained models for fine-tuning [not available yet].
10. CPU / GPU - You need to specify whether you want to train on the GPU or CPU (the first version will automatically run on the GPU).
11. Number Of Classes - I'll go again from the flower_photos example. There are 5 separate folders under the flower_photos folder. This is our class count. When you train your own data set, you have to create as many folders here as you have classes.
12. Batch Size - Specifies whether the training samples are uploaded to the training network in escapes. If you have a 1080 Ti or better GPU, you can set it to 64 or 128. The higher Batch Size, less noise that the model learns.
13. Epoch - The number of training data shown to the model network. So if you make 10 Epoch, the training data will be shown to the model network 10 times.

Training and TensorBoard

When you start to training, you will be able to access TensorBoard without writing any script on terminal! Check localhost:6006

Prediction

Result

Contributing

Contributions with example scripts for other frameworks (PyTorch or Caffe 2) and other pre-trained models are welcome!

Guidelines

Coming soon.

Contributors

• I would like to thank impROS for giving me feedbacks.
• LexCybermac

To-Do List

• Release 5 pre-trained models.
• Choosing CPU or GPU before the training.
• Choosing Activation Function for singe-class training. (Sigmoid and ReLu)
• Data Augmentation
• Fine-Tuning
• Heatmap on predicted images.
• Object Detection - Mask RCNN.

References 📚

• Google - TensorFlow Datasets [1]

• Google - TensorFlow Models [2]

• Google - TensorFlow Transfer Learning [3]

• Font Awesome [4]

• Boostrap V4 [5]

• How to Easily Deploy Machine Learning Models Using Flask [6]

• Graphing Pretty Charts With Python Flask and Chartjs [7]

• Simple and efficient data augmentations using the Tensorfow tf.Data and Dataset API [8]

• Marcus D Bloice, Peter M Roth, Andreas Holzinger, Biomedical image augmentation using Augmentor, Bioinformatics, https://doi.org/10.1093/bioinformatics/btz259 [9]

deep-learning-training-gui's Issues

[Feature request] Add documentation on the functional differences between the available pretrained models

As it stands there 6 pre-trained models availible for fine tuning:

• MobileNetV2
• InceptionV3
• VGG16
• VGG19
• NASNetMobile
• SimpleCnnModel

It is not however from that which I can see communicated within the webUI what the functional differences between these are, while broad inferences can be made based on the names there is possibly room for clearer communication of the pros and cons of each model.

really like this idea, hope it is well maintained.

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Is this project still under development?

Just curious about whether there is any further plan for this project, because it is really a good idea