dawn-lx / openvoc-vidvrd

Official code for the ICLR2023 paper Compositional Prompt Tuning with Motion Cues for Open-vocabulary Video Relation Detection

openvoc-vidvrd's Issues

object tracking代码

请问object tracking部分是没有公布代码吗？tracklet是用什么模型提取的呢？

VidOR data results

Hi,

Congrats on the great work, and thanks for releasing the code! Can you release the code for VidOR as well.

About VidOR dataset

Thank you for your great work! How can I obtain the file pre-prepared_data/vidor_ObjectTextEmbeddings_v2.pth? And are you planning to release the relation classfication experiment config code?

GPU

Hi,

I'm curious about the specific GPU model you utilized for training during your research.

Thank you!

[Errno 2] No such file or directory: 'datasets/gt_jsons/VidVRDtest_segment_gts.json'

Hi, could you help me how to obtain the file VidVRDtest_segment_gts.json used in train_relation_cls.py ?
Thank you very much!

How to extract RoI features

Hi, thank you for your excellent work!
The released RoI features have been averaged of all the bounding boxes along the temporal axis of the tracklets. So could you release the RoI features for each bounding box without averaging? Thank you very much.

About VidOR dataset

Hi, I find a file not found: /home/gkf/project/VidVRD_VidOR/statistics/VidORtrain_triplet_bias.json. And would you plan to release the pre-trained RelCls model on VidOR, as well as the segment-level annotations? Thanks !

Different traj_info_dir during train & eval stage

Hi, I find that during object tracklet classification stage, traj_info_dir in config file (such as experiment/TrajCls_VidVRD/NoBgEmb/cfg_.py) is data0/VidVRD-II/tracklets_results/VidVRD_segment30_tracking_results_th-15-5. When comes to relation classification stage, traj_info_dir in config file (such as experiment/RelationCls_VidVRD/RePro/stage2/cfg_.py) is data0/VidVRD-II/tracklets_results/VidVRD_segment30_tracking_results. Why filtered trajs are only used for TrajCls module?