tjummg / siamdmu

SiamDMU

This is the official implementation with training code for 'SiamDMU: Siamese Dual Mask Update Networkfor Visual Object Tracking'.

Introduction

We propose a novel tracker named Siamese Dual Mask Update (SiamDMU), which utilizes motion and semantic information to generate the enhanced tracking results for updating the template.

The Results of SiamDMU are here. Baidu:2333

Requirements

1. Ubuntu 20.04
2. Pytorch 1.3.1
3. Python 3.7

Installation

Please refer to PySOT_INSTALL.md, FlowNet_README.md and DeepMask_README.md for installation.

You can also download the code of SiamDMU from BaiduYun password: ofed. This file has included the model of SiamRPN++, FlowNet and DeepMask in the dirctory.

Usage

Download models

1. Please download the SiamRPN++ and SiamRPN++_otb model.pth to the path './experiments/siamrpn_r50_l234_dwxcorr/' and './experiments/siamrpn_r50_l234_dwxcorr_otb/', respectively.
2. Download the FlowNet2-C_checkpoint.pth.tar to the './FlowWrapping/pretrained_model/'.
3. Download the DeepMask.pth.tar to the './deepmask/pretrained/'.

Test

1. Modify the dataset path 'dataset_root'.
2. run the './tools/test_SiamDMU_VOT.py'.

Train

1. run the './updatenet/create_template.py'.
2. run the './updatenet/train_upd.py'.

Acknowledgments

1. PySOT
2. deepmask-pytorch
3. flownet2-pytorch
4. SiamTrackers