aoluming / idkg

This is the repo of 'Incorporating Domain Knowledge Graph into Multimodal Movie Genre Classification with Self-Supervised Attention and Contrastive Learning' in MM 2023.

please download the MM-IMDB 2.0 dataset in the following link:https://drive.google.com/file/d/1fmU3ZKM3ieTDeTAeyK1uT9sFVvaGplIp/view?usp=sharing and change the path in IDKG/processor/dataset.py

We have train the Open KG in advance and download it in :https://drive.google.com/file/d/1-yszovzxKTXi1284HUuJz-sNjs1dFfZQ/view?usp=sharing. Also you need to change the kgparam_path in the dataset.py.

For training the code: sh run_imdbclip.sh

idkg's Issues

question of clipweightTrainer

in the run_clipimdb.py “from module.train import clipweightTrainer” I can't find the module.train.py and the class clipweightTrainer in your project. I don't know whether you forgot to upload it. Looking forward to your reply!