Having trouble installing apex and getting the result for the basic snippet about deepinversion

[hongxuyin]

The snippet can generate image batch without AMP but 2x faster once installed. The verifier accuracy will start to increase once the losses begin to drop after several hundreds of itrs, and images will be saved accordingly. AMP installation can be found here https://github.com/NVIDIA/apex.

[haripriyaharikumar]

okay, Thanks. I have another question about the student network you used in the CIFAR-10 experiments. Are they trained on any data or not trained on any data? Bit confusing when it comes to the adaptive deep inversion where you find the most dissimilar images between student and teacher networks.

[hongxuyin]

For CIFAR-10, all students start as reinitialized models pretrained on no data. ADI is iterative given intermediate students during optimization at specs in the paper. An initial set of DI images are generated to kick start the KD process, where ADI samples are newly generated iteratively during KD and then mixed with original sets.