AMC: AutoML for Model Compression and Acceleration on Mobile Devices

Yihui He*    Ji Lin*    Zhijian Liu    Hanrui Wang    Li-Jia Li    Song Han
Massachusetts Institute of Technology

Abstract

Model compression is a critical technique to efficiently deploy neural network models on mobile devices which have limited computation resources and tight power budgets. Conventional model compression techniques rely on hand-crafted heuristics and rule-based policies that require domain experts to explore the large design space trading off among model size, speed, and accuracy, which is usually sub-optimal and time-consuming. In this paper, we propose AutoML for Model Compression (AMC) which leverage reinforcement learning to provide the model compression policy. This learning-based compression policy outperforms conventional rule-based compression policy by having higher compression ratio, better preserving the accuracy and freeing human labor. Under 4x FLOPs reduction, we achieved 2.7% better accuracy than the hand-crafted model compression policy for VGG-16 on ImageNet. We applied this automated, push-the-button compression pipeline to MobileNet and achieved 1.81x speedup of measured inference latency on an Android phone and 1.43x speedup on the Titan XP GPU, with only 0.1% loss of ImageNet Top-1 accuracy.

Publication

BibTeX

If you find our work useful in your research, please consider citing: 

@inproceedings{amc,
  title={AMC: AutoML for Model Compression and Acceleration on Mobile Devices},
  author={He, Yihui and Lin, Ji and Liu, Zhijian and Wang, Hanrui and Li, Li-Jia and Han, Song},
  booktitle={European Conference on Computer Vision (ECCV)},
  year={2018}
}

Related Publications

  • Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding
    Song Han, Huizi Mao, and William J. Dally
    International Conference for Learning Representations (ICLR), 2016
    Paper  /  arXiv