However, the top-1 accuracy is much lower than the reported score. I guess there was some mismatch between the saved checkpoint and the model (fc), could you tell me how can I get reported score?
Here is the code that I ran and the log.
args==>> Namespace(checkpoint='pretrained/sthv2_tpn.pth', config='config_files/sthv2/tsm_tpn.py', fcn_testing=True, flip=False, gpus=8, ignore_cache=True, launcher='none', local_rank=0, log=None, out='test.pkl', proc_per_gpu=1, tmpdir=None)
unexpected key in source state_dict: fc.weight, fc.bias
missing keys in source state_dict: layer4.2.bn2.num_batches_tracked, layer1.1.bn1.num_batches_tracked, layer2.0.bn2.num_batches_tracked, layer3.0.bn2.num_batches_tracked, layer2.3.bn1.num_batches_tracked, layer1.1.bn2.num_batches_tracked, layer4.2.bn3.num_batches_tracked, layer4.2.bn1.num_batches_tracked, layer4.0.bn1.num_batches_tracked, layer4.0.downsample.1.num_batches_tracked, layer3.5.bn2.num_batches_tracked, layer1.2.bn1.num_batches_tracked, layer1.1.bn3.num_batches_tracked, layer2.2.bn1.num_batches_tracked, layer4.1.bn3.num_batches_tracked, layer3.1.bn1.num_batches_tracked, layer2.1.bn3.num_batches_tracked, layer2.0.bn1.num_batches_tracked, layer2.1.bn1.num_batches_tracked, layer3.4.bn2.num_batches_tracked, layer1.2.bn2.num_batches_tracked, layer1.2.bn3.num_batches_tracked, layer2.0.downsample.1.num_batches_tracked, layer3.5.bn3.num_batches_tracked, layer3.4.bn3.num_batches_tracked, layer3.5.bn1.num_batches_tracked, layer2.2.bn2.num_batches_tracked, layer3.2.bn2.num_batches_tracked, layer3.2.bn3.num_batches_tracked, layer1.0.bn3.num_batches_tracked, bn1.num_batches_tracked, layer4.1.bn2.num_batches_tracked, layer4.1.bn1.num_batches_tracked, layer2.0.bn3.num_batches_tracked, layer3.0.bn1.num_batches_tracked, layer4.0.bn2.num_batches_tracked, layer2.3.bn3.num_batches_tracked, layer3.3.bn2.num_batches_tracked, layer1.0.bn1.num_batches_tracked, layer3.2.bn1.num_batches_tracked, layer2.2.bn3.num_batches_tracked, layer1.0.downsample.1.num_batches_tracked, layer3.3.bn1.num_batches_tracked, layer3.1.bn2.num_batches_tracked, layer3.1.bn3.num_batches_tracked, layer2.1.bn2.num_batches_tracked, layer3.0.bn3.num_batches_tracked, layer3.3.bn3.num_batches_tracked, layer3.0.downsample.1.num_batches_tracked, layer3.4.bn1.num_batches_tracked, layer4.0.bn3.num_batches_tracked, layer1.0.bn2.num_batches_tracked, layer2.3.bn2.num_batches_tracked
unexpected key in source state_dict: fc.weight, fc.bias
missing keys in source state_dict: layer3.2.bn1.num_batches_tracked, layer1.1.bn2.num_batches_tracked, layer3.3.bn2.num_batches_tracked, layer4.2.bn3.num_batches_tracked, layer3.0.bn2.num_batches_tracked, layer4.2.bn1.num_batches_tracked, layer4.0.bn1.num_batches_tracked, layer3.0.bn1.num_batches_tracked, layer1.2.bn1.num_batches_tracked, layer3.4.bn2.num_batches_tracked, layer2.1.bn2.num_batches_tracked, layer3.3.bn3.num_batches_tracked, layer4.0.bn2.num_batches_tracked, layer2.3.bn1.num_batches_tracked, layer4.0.downsample.1.num_batches_tracked, layer1.0.downsample.1.num_batches_tracked, layer3.5.bn3.num_batches_tracked, layer4.1.bn3.num_batches_tracked, layer1.2.bn3.num_batches_tracked, layer3.5.bn1.num_batches_tracked, layer3.1.bn2.num_batches_tracked, layer3.4.bn3.num_batches_tracked, layer1.0.bn3.num_batches_tracked, layer2.2.bn1.num_batches_tracked, layer3.5.bn2.num_batches_tracked, layer2.1.bn1.num_batches_tracked, layer2.0.downsample.1.num_batches_tracked, layer3.3.bn1.num_batches_tracked, layer3.2.bn2.num_batches_tracked, layer1.0.bn1.num_batches_tracked, bn1.num_batches_tracked, layer4.1.bn2.num_batches_tracked, layer2.0.bn1.num_batches_tracked, layer2.3.bn3.num_batches_tracked, layer2.3.bn2.num_batches_tracked, layer3.1.bn1.num_batches_tracked, layer3.1.bn3.num_batches_tracked, layer4.0.bn3.num_batches_tracked, layer2.0.bn2.num_batches_tracked, layer1.1.bn3.num_batches_tracked, layer1.0.bn2.num_batches_tracked, layer1.2.bn2.num_batches_tracked, layer2.2.bn2.num_batches_tracked, layer2.1.bn3.num_batches_tracked, layer3.2.bn3.num_batches_tracked, layer2.2.bn3.num_batches_tracked, layer4.2.bn2.num_batches_tracked, layer3.0.downsample.1.num_batches_tracked, layer1.1.bn1.num_batches_tracked, layer4.1.bn1.num_batches_tracked, layer3.4.bn1.num_batches_tracked, layer3.0.bn3.num_batches_tracked, layer2.0.bn3.num_batches_tracked
unexpected key in source state_dict: fc.weight, fc.bias
missing keys in source state_dict: layer3.2.bn2.num_batches_tracked, layer4.1.bn1.num_batches_tracked, layer1.1.bn1.num_batches_tracked, layer4.2.bn2.num_batches_tracked, layer2.3.bn1.num_batches_tracked, layer2.1.bn1.num_batches_tracked, layer3.4.bn3.num_batches_tracked, layer3.0.bn3.num_batches_tracked, bn1.num_batches_tracked, layer3.1.bn2.num_batches_tracked, layer2.1.bn2.num_batches_tracked, layer3.2.bn3.num_batches_tracked, layer4.1.bn2.num_batches_tracked, layer3.1.bn1.num_batches_tracked, layer1.1.bn2.num_batches_tracked, layer2.0.bn2.num_batches_tracked, layer3.0.bn1.num_batches_tracked, layer3.0.downsample.1.num_batches_tracked, layer4.0.bn1.num_batches_tracked, layer3.4.bn2.num_batches_tracked, layer3.3.bn3.num_batches_tracked, layer3.5.bn3.num_batches_tracked, layer3.3.bn2.num_batches_tracked, layer3.1.bn3.num_batches_tracked, layer4.1.bn3.num_batches_tracked, layer1.2.bn2.num_batches_tracked, layer2.2.bn2.num_batches_tracked, layer3.0.bn2.num_batches_tracked, layer2.0.downsample.1.num_batches_tracked, layer4.2.bn1.num_batches_tracked, layer4.0.bn3.num_batches_tracked, layer1.2.bn1.num_batches_tracked, layer4.2.bn3.num_batches_tracked, layer3.5.bn1.num_batches_tracked, layer3.2.bn1.num_batches_tracked, layer2.2.bn1.num_batches_tracked, layer2.0.bn1.num_batches_tracked, layer1.0.downsample.1.num_batches_tracked, layer1.0.bn3.num_batches_tracked, layer2.2.bn3.num_batches_tracked, layer2.3.bn3.num_batches_tracked, layer4.0.bn2.num_batches_tracked, layer2.0.bn3.num_batches_tracked, layer2.3.bn2.num_batches_tracked, layer1.0.bn1.num_batches_tracked, layer3.4.bn1.num_batches_tracked, layer3.5.bn2.num_batches_tracked, layer1.2.bn3.num_batches_tracked, layer2.1.bn3.num_batches_tracked, layer4.0.downsample.1.num_batches_tracked, layer1.1.bn3.num_batches_tracked, layer1.0.bn2.num_batches_tracked, layer3.3.bn1.num_batches_tracked
unexpected key in source state_dict: fc.weight, fc.bias
missing keys in source state_dict: layer2.1.bn2.num_batches_tracked, layer3.0.bn3.num_batches_tracked, layer3.4.bn2.num_batches_tracked, layer4.1.bn3.num_batches_tracked, layer1.0.bn3.num_batches_tracked, layer3.5.bn3.num_batches_tracked, layer2.1.bn1.num_batches_tracked, layer3.2.bn2.num_batches_tracked, layer4.0.downsample.1.num_batches_tracked, layer1.0.bn1.num_batches_tracked, layer2.3.bn1.num_batches_tracked, layer3.3.bn3.num_batches_tracked, layer2.2.bn1.num_batches_tracked, layer4.0.bn1.num_batches_tracked, layer3.1.bn1.num_batches_tracked, layer4.2.bn2.num_batches_tracked, layer3.3.bn2.num_batches_tracked, layer3.5.bn2.num_batches_tracked, layer2.2.bn2.num_batches_tracked, layer3.1.bn3.num_batches_tracked, layer1.1.bn2.num_batches_tracked, layer3.1.bn2.num_batches_tracked, layer2.3.bn2.num_batches_tracked, layer2.1.bn3.num_batches_tracked, layer1.1.bn1.num_batches_tracked, layer1.2.bn1.num_batches_tracked, layer3.0.downsample.1.num_batches_tracked, layer2.0.bn3.num_batches_tracked, layer2.0.downsample.1.num_batches_tracked, layer4.0.bn3.num_batches_tracked, layer3.3.bn1.num_batches_tracked, layer1.2.bn2.num_batches_tracked, bn1.num_batches_tracked, layer1.2.bn3.num_batches_tracked, layer2.2.bn3.num_batches_tracked, layer1.0.bn2.num_batches_tracked, layer2.0.bn2.num_batches_tracked, layer2.0.bn1.num_batches_tracked, layer4.1.bn2.num_batches_tracked, layer3.0.bn2.num_batches_tracked, layer4.0.bn2.num_batches_tracked, layer1.0.downsample.1.num_batches_tracked, layer3.4.bn1.num_batches_tracked, layer4.1.bn1.num_batches_tracked, layer3.2.bn3.num_batches_tracked, layer1.1.bn3.num_batches_tracked, layer3.4.bn3.num_batches_tracked, layer4.2.bn1.num_batches_tracked, layer3.2.bn1.num_batches_tracked, layer3.5.bn1.num_batches_tracked, layer2.3.bn3.num_batches_tracked, layer3.0.bn1.num_batches_tracked, layer4.2.bn3.num_batches_tracked
unexpected key in source state_dict: fc.weight, fc.bias
missing keys in source state_dict: layer1.0.bn3.num_batches_tracked, layer4.1.bn2.num_batches_tracked, layer4.2.bn2.num_batches_tracked, layer3.2.bn2.num_batches_tracked, layer4.0.bn2.num_batches_tracked, layer3.0.bn3.num_batches_tracked, layer4.0.downsample.1.num_batches_tracked, layer3.0.bn2.num_batches_tracked, layer4.1.bn1.num_batches_tracked, layer3.5.bn3.num_batches_tracked, layer3.1.bn3.num_batches_tracked, layer3.1.bn1.num_batches_tracked, layer1.2.bn2.num_batches_tracked, layer2.0.bn3.num_batches_tracked, layer4.0.bn1.num_batches_tracked, layer3.5.bn1.num_batches_tracked, layer1.0.bn1.num_batches_tracked, layer3.3.bn1.num_batches_tracked, layer2.0.bn1.num_batches_tracked, layer3.1.bn2.num_batches_tracked, layer3.3.bn2.num_batches_tracked, layer2.0.downsample.1.num_batches_tracked, layer1.1.bn3.num_batches_tracked, layer4.1.bn3.num_batches_tracked, layer2.1.bn3.num_batches_tracked, layer1.2.bn1.num_batches_tracked, layer2.0.bn2.num_batches_tracked, layer3.4.bn3.num_batches_tracked, layer4.2.bn1.num_batches_tracked, layer3.0.downsample.1.num_batches_tracked, layer3.4.bn2.num_batches_tracked, layer3.3.bn3.num_batches_tracked, bn1.num_batches_tracked, layer2.1.bn1.num_batches_tracked, layer2.3.bn2.num_batches_tracked, layer2.3.bn1.num_batches_tracked, layer3.2.bn3.num_batches_tracked, layer4.2.bn3.num_batches_tracked, layer1.2.bn3.num_batches_tracked, layer1.0.downsample.1.num_batches_tracked, layer4.0.bn3.num_batches_tracked, layer2.1.bn2.num_batches_tracked, layer3.2.bn1.num_batches_tracked, layer2.3.bn3.num_batches_tracked, layer1.1.bn2.num_batches_tracked, layer3.0.bn1.num_batches_tracked, layer1.0.bn2.num_batches_tracked, layer2.2.bn3.num_batches_tracked, layer2.2.bn2.num_batches_tracked, layer3.4.bn1.num_batches_tracked, layer2.2.bn1.num_batches_tracked, layer3.5.bn2.num_batches_tracked, layer1.1.bn1.num_batches_tracked
unexpected key in source state_dict: fc.weight, fc.bias
missing keys in source state_dict: layer2.3.bn1.num_batches_tracked, layer1.1.bn2.num_batches_tracked, layer4.2.bn3.num_batches_tracked, layer1.0.bn1.num_batches_tracked, layer4.1.bn2.num_batches_tracked, layer3.0.bn3.num_batches_tracked, layer3.3.bn3.num_batches_tracked, layer4.0.bn2.num_batches_tracked, layer1.2.bn2.num_batches_tracked, layer3.2.bn2.num_batches_tracked, layer1.0.bn2.num_batches_tracked, layer3.5.bn3.num_batches_tracked, layer3.4.bn2.num_batches_tracked, layer3.1.bn3.num_batches_tracked, layer3.5.bn2.num_batches_tracked, layer3.1.bn1.num_batches_tracked, layer4.1.bn1.num_batches_tracked, layer3.3.bn2.num_batches_tracked, layer2.2.bn3.num_batches_tracked, layer2.1.bn3.num_batches_tracked, layer4.1.bn3.num_batches_tracked, layer2.0.bn3.num_batches_tracked, layer3.2.bn1.num_batches_tracked, layer2.1.bn2.num_batches_tracked, layer3.0.bn2.num_batches_tracked, bn1.num_batches_tracked, layer1.0.bn3.num_batches_tracked, layer2.0.bn2.num_batches_tracked, layer4.2.bn2.num_batches_tracked, layer1.1.bn3.num_batches_tracked, layer3.0.bn1.num_batches_tracked, layer2.3.bn3.num_batches_tracked, layer2.1.bn1.num_batches_tracked, layer2.2.bn2.num_batches_tracked, layer1.0.downsample.1.num_batches_tracked, layer2.0.bn1.num_batches_tracked, layer2.3.bn2.num_batches_tracked, layer4.2.bn1.num_batches_tracked, layer3.1.bn2.num_batches_tracked, layer2.0.downsample.1.num_batches_tracked, layer4.0.downsample.1.num_batches_tracked, layer3.5.bn1.num_batches_tracked, layer3.4.bn1.num_batches_tracked, layer3.0.downsample.1.num_batches_tracked, layer2.2.bn1.num_batches_tracked, layer1.1.bn1.num_batches_tracked, layer3.2.bn3.num_batches_tracked, layer4.0.bn3.num_batches_tracked, layer3.3.bn1.num_batches_tracked, layer1.2.bn3.num_batches_tracked, layer3.4.bn3.num_batches_tracked, layer1.2.bn1.num_batches_tracked, layer4.0.bn1.num_batches_tracked
unexpected key in source state_dict: fc.weight, fc.bias
missing keys in source state_dict: layer1.1.bn1.num_batches_tracked, layer2.3.bn3.num_batches_tracked, layer4.0.bn2.num_batches_tracked, layer4.0.downsample.1.num_batches_tracked, layer3.4.bn2.num_batches_tracked, layer1.1.bn2.num_batches_tracked, layer2.1.bn1.num_batches_tracked, layer4.2.bn3.num_batches_tracked, layer2.1.bn3.num_batches_tracked, layer3.1.bn2.num_batches_tracked, layer4.2.bn1.num_batches_tracked, layer1.0.bn3.num_batches_tracked, layer4.1.bn2.num_batches_tracked, layer2.0.bn3.num_batches_tracked, layer3.2.bn3.num_batches_tracked, layer1.2.bn2.num_batches_tracked, layer1.1.bn3.num_batches_tracked, layer3.0.downsample.1.num_batches_tracked, layer2.2.bn1.num_batches_tracked, layer1.2.bn3.num_batches_tracked, layer4.2.bn2.num_batches_tracked, layer3.1.bn3.num_batches_tracked, layer2.0.downsample.1.num_batches_tracked, layer2.2.bn3.num_batches_tracked, layer3.4.bn3.num_batches_tracked, layer3.2.bn2.num_batches_tracked, layer2.0.bn2.num_batches_tracked, layer4.0.bn1.num_batches_tracked, layer3.3.bn2.num_batches_tracked, layer2.3.bn1.num_batches_tracked, layer1.0.bn2.num_batches_tracked, layer2.1.bn2.num_batches_tracked, layer1.2.bn1.num_batches_tracked, layer3.5.bn1.num_batches_tracked, layer2.0.bn1.num_batches_tracked, layer4.1.bn1.num_batches_tracked, layer3.0.bn1.num_batches_tracked, layer1.0.bn1.num_batches_tracked, layer2.3.bn2.num_batches_tracked, layer3.3.bn1.num_batches_tracked, layer4.0.bn3.num_batches_tracked, layer3.4.bn1.num_batches_tracked, layer3.5.bn3.num_batches_tracked, layer3.0.bn3.num_batches_tracked, layer3.3.bn3.num_batches_tracked, layer3.0.bn2.num_batches_tracked, layer2.2.bn2.num_batches_tracked, layer3.5.bn2.num_batches_tracked, layer4.1.bn3.num_batches_tracked, layer3.1.bn1.num_batches_tracked, bn1.num_batches_tracked, layer3.2.bn1.num_batches_tracked, layer1.0.downsample.1.num_batches_tracked
[ ] 0/24777, elapsed: 0s, ETA:unexpected key in source state_dict: fc.weight, fc.bias
missing keys in source state_dict: layer1.0.bn1.num_batches_tracked, layer2.0.bn3.num_batches_tracked, layer2.2.bn1.num_batches_tracked, layer3.4.bn3.num_batches_tracked, layer2.3.bn3.num_batches_tracked, layer1.1.bn2.num_batches_tracked, layer2.1.bn2.num_batches_tracked, layer3.1.bn1.num_batches_tracked, layer4.1.bn2.num_batches_tracked, bn1.num_batches_tracked, layer2.3.bn1.num_batches_tracked, layer2.0.bn2.num_batches_tracked, layer4.0.downsample.1.num_batches_tracked, layer3.0.downsample.1.num_batches_tracked, layer2.2.bn2.num_batches_tracked, layer3.3.bn2.num_batches_tracked, layer2.3.bn2.num_batches_tracked, layer3.3.bn3.num_batches_tracked, layer4.1.bn1.num_batches_tracked, layer1.0.downsample.1.num_batches_tracked, layer3.3.bn1.num_batches_tracked, layer1.1.bn1.num_batches_tracked, layer3.0.bn2.num_batches_tracked, layer1.2.bn1.num_batches_tracked, layer1.2.bn3.num_batches_tracked, layer3.4.bn2.num_batches_tracked, layer1.0.bn2.num_batches_tracked, layer4.2.bn3.num_batches_tracked, layer2.1.bn1.num_batches_tracked, layer4.0.bn1.num_batches_tracked, layer3.1.bn2.num_batches_tracked, layer2.1.bn3.num_batches_tracked, layer3.5.bn3.num_batches_tracked, layer2.2.bn3.num_batches_tracked, layer3.5.bn1.num_batches_tracked, layer3.2.bn1.num_batches_tracked, layer1.0.bn3.num_batches_tracked, layer1.2.bn2.num_batches_tracked, layer3.5.bn2.num_batches_tracked, layer4.0.bn3.num_batches_tracked, layer3.4.bn1.num_batches_tracked, layer3.0.bn1.num_batches_tracked, layer4.1.bn3.num_batches_tracked, layer4.2.bn1.num_batches_tracked, layer2.0.bn1.num_batches_tracked, layer4.0.bn2.num_batches_tracked, layer3.2.bn3.num_batches_tracked, layer3.2.bn2.num_batches_tracked, layer1.1.bn3.num_batches_tracked, layer4.2.bn2.num_batches_tracked, layer3.0.bn3.num_batches_tracked, layer3.1.bn3.num_batches_tracked, layer2.0.downsample.1.num_batches_tracked
[>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>] 24777/24777, 15.9 task/s, elapsed: 1558s, ETA: 0s
writing results to test.pkl
results_length 24777
Mean Class Accuracy = 44.67
Top-1 Accuracy = 50.03
Top-5 Accuracy = 77.49
Non mean Class Accuracy [0.88793103 0.29605263 0.15686275 0.48543689 0.23076923 0.77631579
0.74100719 0.54545455 0.51968504 0.54966887 0.57303371 0.68613139
0.47008547 0.3 0.62105263 0.49361702 0.37055838 0.26973684
0.30962343 0.33175355 0.40944882 0.31578947 0.40697674 0.53191489
0.5 0.73684211 0.475 0.78217822 0.8 0.37931034
0.67567568 0.6036036 0.86363636 0.0776699 0.03614458 0.015625
0.77419355 0.7148289 0.12962963 0.58823529 0.5136612 0.73214286
0.54929577 0.56913183 0.74324324 0.53481894 0.60542169 0.09045226
0.20496894 0.68172043 0.60759494 0. 0.21875 0.6
0.29166667 0.83333333 0.12328767 0.70754717 0. 0.6294964
0.78 0.35294118 0.34177215 0.14953271 0.02702703 0.25
0.38679245 0.36318408 0.79824561 0.12 0.32142857 0.47826087
0.44117647 0.41025641 0.75471698 0.13157895 0.22222222 0.26923077
0.22222222 0.62068966 0.09375 0.056 0.25531915 0.19148936
0.69333333 0.55555556 0.88235294 0.816 0.16666667 0.15662651
0.20289855 0.66666667 0.26315789 0.28 0.79237288 0.125
0.08823529 0.11570248 0.6122449 0.6959707 0.24528302 0.44505495
0.18103448 0.66071429 0.68503937 0.76296296 0.32191781 0.64039409
0.08108108 0.72 0.32394366 0. 0.34532374 0.47222222
0.65972222 0.39130435 0.40740741 0.53174603 0.25423729 0.45544554
0.79527559 0.67045455 0.22167488 0.46153846 0.73076923 0.34862385
0.39805825 0.28695652 0.23754789 0.3125 0.13571429 0.16438356
0.49425287 0.28070175 0.7173913 0.29447853 0.05882353 0.41666667
0.13761468 0.76076555 0.45348837 0.15625 0.53125 0.50324675
0.67515924 0.48024316 0.57222222 0.03125 0.31380753 0.79245283
0.53532609 0.20652174 0.2755102 0.89908257 0.64566929 0.52439024
0.30769231 0.35869565 0.26146789 0.29090909 0.10091743 0.32894737
0.51401869 0.275 0.83887468 0.90322581 0.92857143 0.91975309
0.86666667 0.58666667 0.29901961 0.73717949 0.73023256 0.5620438 ]
saving non_mean acc