Implementation of Deep Mutual Learning by Pytorch to do classification on cifar100.
The algorithm was proposed in 《Deep Mutual Learning》 (CVPR 2017).
Pytorch 1.0.0
tensorboard 1.14.0
Overview of the algorithm:
The default network for DML is ResNet32.
Train 2 models using DML by main.py:
python train.py --model_num 2
Use tensorboard to monitor training process on choosing port:
tensorboard --logdir logs --port 6006
Network | ind_avg_acc | Dml_avg_acc |
---|---|---|
ResNet32 | 69.83% | 71.03% |