Categories of observer error from eye tracking and AFROC data

David Manning; Susan Ethell; Tim Donovan

doi:10.1117/12.533489

4 May 2004 Categories of observer error from eye tracking and AFROC data

David Manning, Susan Ethell, Tim Donovan

Proceedings Volume 5372, Medical Imaging 2004: Image Perception, Observer Performance, and Technology Assessment; (2004) https://doi.org/10.1117/12.533489
Event: Medical Imaging 2004, 2004, San Diego, California, United States

Abstract

Twenty-four volunteer observers were divided into groups of eight radiologists, eight radiographers and eight novices to carry out a pulmonary nodule detection task on a test bank of 120 digitized PA chest radiographs. The eight radiographers were tested twice: before and after a six-month training program in interpretation of the adult chest radiograph. During each test session the observers eye movements were tracked. Data on the observers' decisions through AFROC methodology were correlated to their eye-movement and fixation patterns. False negative error-rates were recorded as 41% for the radiologists, 45% for the novices, 47% for the radiographers before training and 42% for the radiographers after training. The errors were sub-classified into search, recognition and decision errors depending on the duration of the fixation-time for each faulty response. Errors due to satisfaction of search were determined from images with multiple nodules. Differences between the groups were shown. Errors due to inefficient search were in the minority for all the observer groups and the dominant cause of unreported nodules was incorrect decision-making. True negative decisions from all observers were associated with shorter fixation times than false negative decisions. No correct negative decisions were made after fixations exceeding three seconds.

Citation Download Citation

David Manning, Susan Ethell, and Tim Donovan "Categories of observer error from eye tracking and AFROC data", Proc. SPIE 5372, Medical Imaging 2004: Image Perception, Observer Performance, and Technology Assessment, (4 May 2004); https://doi.org/10.1117/12.533489

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available