Presentation + Paper
12 April 2021 Heuristic approaches for porting deep neural networks onto mobile devices
Author Affiliations +
Abstract
Deep Neural Networks (DNNs) although promising for image processing, have significant computational complexity. This impedes implementation in resource-constrained systems. This paper presents effective heuristic approaches for porting DNNs onto mobile devices. Four sets of heuristics are studied: (1) heuristics based on the reuse of transferred weight matrices and weight pruning; (2) heuristics based on parameter reduction, network acceleration and non-tensor layer improvements; (3) a suite of heuristics for low power acceleration of DNNs based on dataflow, near memory and in-memory processing, transform schemes and analog based approaches; and (4) heuristics based on feature and feature map pruning utilizing cosine distances. These sets of heuristics achieve significant complexity, memory and power reductions with minimal reduction of accuracy across an assortment of state-of-the-art DNNs and applications.
Conference Presentation
© (2021) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Christos Grecos, Mukul Shirvaikar, and Nasser Kehtarnavaz "Heuristic approaches for porting deep neural networks onto mobile devices", Proc. SPIE 11736, Real-Time Image Processing and Deep Learning 2021, 1173602 (12 April 2021); https://doi.org/10.1117/12.2580047
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Neural networks

Mobile devices

Convolutional neural networks

Image processing

Performance modeling

Optical character recognition

Pattern recognition

Back to Top