Human object annotation for surveillance video forensics

Muhammad Fraz; Iffat Zafar; Giounona Tzanidou; Eran Anusha Edirisinghe; Muhammad Saquib Sarfraz

doi:10.1117/1.JEI.22.4.041115

29 August 2013 Human object annotation for surveillance video forensics

Muhammad Fraz, Iffat Zafar, Giounona Tzanidou, Eran Anusha Edirisinghe, Muhammad Saquib Sarfraz

Author Affiliations +

Journal of Electronic Imaging, Vol. 22, Issue 4, 041115 (August 2013). https://doi.org/10.1117/1.JEI.22.4.041115

Abstract

A system that can automatically annotate surveillance video in a manner useful for locating a person with a given description of clothing is presented. Each human is annotated based on two appearance features: primary colors of clothes and the presence of text/logos on clothes. The annotation occurs after a robust foreground extraction stage employing a modified Gaussian mixture model-based approach. The proposed pipeline consists of a preprocessing stage where color appearance of an image is improved using a color constancy algorithm. In order to annotate color information for human clothes, we use the color histogram feature in HSV space and find local maxima to extract dominant colors for different parts of a segmented human object. To detect text/logos on clothes, we begin with the extraction of connected components of enhanced horizontal, vertical, and diagonal edges in the frames. These candidate regions are classified as text or nontext on the basis of their local energy-based shape histogram features. Further, to detect humans, a novel technique has been proposed that uses contourlet transform-based local binary pattern (CLBP) features. In the proposed method, we extract the uniform direction invariant LBP feature descriptor for contourlet transformed high-pass subimages from vertical and diagonal directional bands. In the final stage, extracted CLBP descriptors are classified by a trained support vector machine. Experimental results illustrate the superiority of our method on large-scale surveillance video data.

Citation Download Citation

Muhammad Fraz, Iffat Zafar, Giounona Tzanidou, Eran Anusha Edirisinghe, and Muhammad Saquib Sarfraz "Human object annotation for surveillance video forensics," Journal of Electronic Imaging 22(4), 041115 (29 August 2013). https://doi.org/10.1117/1.JEI.22.4.041115

Published: 29 August 2013

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available