Robust architecture search using network adaptation
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Experts have designed popular and successful model architectures, which, however, were not the optimal option for different scenarios. Despite the remarkable performances achieved by deep neural networks, manually designed networks for classification tasks are the backbone of object detection. One major challenge is the ImageNet pre-training of the search space representation; moreover, the searched network incurs huge computational cost. Therefore, to overcome the obstacle of the pre-training process, we introduce a networkadaptation technique using a pre-trained backbone model tested on ImageNet. The adaptation method can efficiently adapt the manually designed network on ImageNet to the new object-detection task. Neural architecture search (NAS) is adopted to adapt the architecture of the network. The adaptation is conducted on the MobileNetV2 network. The proposed NAS is tested using SSDLite detector. The results demonstrate increased performance compared to existing network architecture in terms of search cost, total number of adder arithmetics (Madds), and mean Average Precision(mAP). The total computational cost of the proposed NAS is much less than that of the State Of The Art (SOTA) NAS method.
Abstract
Experts have designed popular and successful model architectures, which, however, were not the optimal option for different scenarios. Despite the remarkable performances achieved by deep neural networks, manually designed networks for classification tasks are the backbone of object detection. One major challenge is the ImageNet pre-training of the search space representation; moreover, the searched network incurs huge computational cost. Therefore, to overcome the obstacle of the pre-training process, we introduce a networkadaptation technique using a pre-trained backbone model tested on ImageNet. The adaptation method can efficiently adapt the manually designed network on ImageNet to the new object-detection task. Neural architecture search (NAS) is adopted to adapt the architecture of the network. The adaptation is conducted on the MobileNetV2 network. The proposed NAS is tested using SSDLite detector. The results demonstrate increased performance compared to existing network architecture in terms of search cost, total number of adder arithmetics (Madds), and mean Average Precision(mAP). The total computational cost of the proposed NAS is much less than that of the State Of The Art (SOTA) NAS method.
참고문헌 (14)
- T. Elsken, "Neural architecture search : A survey", J. Mach. Learn. Res., 20(1), pp.1~21 (2019)
- B. Zoph, "Neural architecture search with reinforcement learning", Proc. of Int. Conf. on Learn. Representations, pp.1611.0157~1611.01578 (2017)
- H. Pham, "Efficient neural architecture search via parameter sharing", Proc. of Int. Conf. on Mach. Learn., pp.4095~4104 (2018)
- B. Zoph, "Learning transferable architectures for scalable image recognition", Proc. of IEEE Conf. on Comput. Vis. Pattern Recognit, pp.8697~8710 (2018)
- E. Real, "Regularized evolution for image classifier architecture search", Proc. of AAAI Conf. on artif. intel., pp.4780~4789 (2019)
- H. Liu, "DARTS : Differentiable architecture search", Proc. of Int. Conf. on Learn. Representations, pp.1806.09055~1806.09055 (2019)
- R. J. Wang, "Pelee : A real-time object detection system on mobile devices", Proc. of Adv. Neural. Inf. Process. Syst, pp.184.06882~184.06882(10) (2018)
- G. Huang, "Densely connected convolutional networks", Proc. of IEEE Conf. on Comput. Vis. Pattern Recognit, pp.4700~4708 (2017)
- Z. Li, "Detnet : Design backbone for object detection", Proc. of Comput. Vis. ECCV, pp.334~350 (2018)
- Y. Chen, "DetNAS : Backbone search for object detection", Proc. of Adv. Neural. Inf. Process. Syst., pp.6642~6652 (2019)
- J. Deng, "Imagenet : A large-scale hierarchical image database", Proc. IEEE Conf. on Comput. Vis. Pattern Recognit., pp.248~255 (2009)
- M. Sandler, "MobilenetV2 : Inverted residuals and linear bottlenecks", Proc. of IEEE Conf. on Comput. Vis. Pattern Recognit., pp.4510~4520 (2018)
- W. Liu, "SSD : Single shot multibox detector", Proc. of Comput. Vis. ECCV, pp.21~37 (2016)
- T. Lin, "Microsoft coco : Common objects in context", Proc. of Comput. Vis. ECCV, pp.740~755 (2014)