Multi-scale visual words for hierarchical medical image categorisation

Dimitrios Markonis; Alba G. Seco de Herrera; Ivan Eggel; Henning Müller

doi:10.1117/12.911550

16 February 2012 Multi-scale visual words for hierarchical medical image categorisation

Dimitrios Markonis, Alba G. Seco de Herrera, Ivan Eggel, Henning Müller

Proceedings Volume 8319, Medical Imaging 2012: Advanced PACS-based Imaging Informatics and Therapeutic Applications; 83190F (2012) https://doi.org/10.1117/12.911550
Event: SPIE Medical Imaging, 2012, San Diego, California, United States

Abstract

The biomedical literature published regularly has increased strongly in past years and keeping updated even in narrow domains is difficult. Images represent essential information of their articles and can help to quicker browse through large volumes of articles in connection with keyword search. Content-based image retrieval is helping the retrieval of visual content. To facilitate retrieval of visual information, image categorisation can be an important first step. To represent scientific articles visually, medical images need to be separated from general images such as flowcharts or graphs to facilitate browsing, as graphs contain little information. Medical modality classification is a second step to focus search. The techniques described in this article first classify images into broad categories. In a second step the images are further classified into the exact medical modalities. The system combines the Scale-Invariant Feature Transform (SIFT) and density-based clustering (DENCLUE). Visual words are first created globally to differentiate broad categories and then within each category a new visual vocabulary is created for modality classification. The results show the difficulties to differentiate between some modalities by visual means alone. On the other hand the improvement of the accuracy of the two-step approach shows the usefulness of the method. The system is currently being integrated into the Goldminer image search engine of the ARRS (American Roentgen Ray Society) as a web service, allowing concentrating image search onto clinically relevant images automatically.

Citation Download Citation

Dimitrios Markonis, Alba G. Seco de Herrera, Ivan Eggel, and Henning Müller "Multi-scale visual words for hierarchical medical image categorisation", Proc. SPIE 8319, Medical Imaging 2012: Advanced PACS-based Imaging Informatics and Therapeutic Applications, 83190F (16 February 2012); https://doi.org/10.1117/12.911550

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available