splendidsummer / dl_project1

Deep learning CNN Assignment

dl_project1

Deep learning CNN Assignment

How to design a CNN network

Incomplete Hyperparameter List

Incomplete Hyperparameter list

• Batch size
• Number of epochs
• Learning Rate
• Weight decay
• Activation function
• Input normalization
• Weight initialization
• Data augmentation
• Network Capacity(layers and neurons)
• Early stopping policy
• Normalization layer + hyperparameters
• Loss function

Convolution

kernel size, stride, padding, dilated rate

Pooling

kernel size, stride, padding, avg/max/global average

Dilated convolution

Set in the normal convolution

Skip Connection

Inception block

CBR or CRB Block

CCC Block