The model you use to validate?

[julycetc]

In the code, it seems that you use the model stored in ema to do the validation and get the final result.Here i have two questions:
1.Why do you use the ema model to do the validation, but do not use the model_wrapper which is directely preuned?
2.Is it supposed that ema model will get better result than model_wrapper?And why?
Thanks very much for your reply!

[meijieru]

1. It's part of the Mnasnet's training schedule and consistently improves the performance.
2. Yeah. In my opinion, it's a kindle of ensemble along time.

[julycetc]

Thanks very much for your reply!
I am quite interested in this phenomenon.
However, It seems that there is no discription about this problem in your paper? Does there have any other papers which mentioned about this problem?

[meijieru]

It's a part of the Mnasnet training schedule which is mentioned in the paper. We also give MobileNetV2's performance for reference (73.6 top-1).
Single-Path NAS: Designing Hardware-Efficient ConvNets in less than 4 Hours mentioned this phenomenon.