Microarchitectural analysis of image quality assessment algorithms

Thien D. Phan; Siddharth K. Shah; Damon M. Chandler; Sohum Sohoni

doi:10.1117/1.JEI.23.1.013030

26 February 2014 Microarchitectural analysis of image quality assessment algorithms

Thien D. Phan, Siddharth K. Shah, Damon M. Chandler, Sohum Sohoni

Author Affiliations +

Journal of Electronic Imaging, Vol. 23, Issue 1, 013030 (February 2014). https://doi.org/10.1117/1.JEI.23.1.013030

Abstract

Algorithms for image quality assessment (IQA) aim to predict the qualities of images in a manner that agrees with subjective quality ratings. Over the last several decades, the major impetus in IQA research has focused on improving predictive performance; very few studies have focused on analyzing and improving the runtime performance of IQA algorithms. This paper is the first to examine IQA algorithms from the perspective of their interaction with the underlying hardware and microarchitectural resources, and to perform a systematic performance analysis using state-of-the-art tools and techniques from other computing disciplines. We implemented four popular full-reference IQA algorithms (most apparent distortion, multiscale structural similarity, visual information fidelity, and visual signal-to-noise ratio) and two no-reference algorithms (blind image integrity notator using DCT statistics and blind/referenceless image spatial quality evaluator) in C++ based on the code provided by their respective authors. We then conducted a hotspot analysis to identify sections of code that were performance bottlenecks and performed microarchitectural analysis to identify the underlying causes for these bottlenecks. Despite the fact that all six algorithms share common algorithmic operations (e.g., filterbanks and statistical computations), our results revealed that different IQA algorithms overwhelm different microarchitectural resources and give rise to different types of bottlenecks. Based on these results, we propose microarchitectural-conscious coding techniques and custom hardware recommendations for performance improvement.

CC BY: © The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.

Citation Download Citation

Thien D. Phan, Siddharth K. Shah, Damon M. Chandler, and Sohum Sohoni "Microarchitectural analysis of image quality assessment algorithms," Journal of Electronic Imaging 23(1), 013030 (26 February 2014). https://doi.org/10.1117/1.JEI.23.1.013030

Published: 26 February 2014

ACCESS THE FULL ARTICLE

JOURNAL ARTICLE
25 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY