9 September 2014 Fast-rolling shutter compensation based on piecewise quadratic approximation of a camera trajectory
Yun Gu Lee, Guo Kai
Author Affiliations +
Abstract
Rolling shutter effect commonly exists in a video camera or a mobile phone equipped with a complementary metal-oxide semiconductor sensor, caused by a row-by-row exposure mechanism. As video resolution in both spatial and temporal domains increases dramatically, removing rolling shutter effect fast and effectively becomes a challenging problem, especially for devices with limited hardware resources. We propose a fast method to compensate rolling shutter effect, which uses a piecewise quadratic function to approximate a camera trajectory. The duration of a quadratic function in each segment is equal to one frame (or half-frame), and each quadratic function is described by an initial velocity and a constant acceleration. The velocity and acceleration of each segment are estimated using only a few global (or semiglobal) motion vectors, which can be simply predicted from fast motion estimation algorithms. Then geometric image distortion at each scanline is inferred from the predicted camera trajectory for compensation. Experimental results on mobile phones with full-HD video demonstrate that our method can not only be implemented in real time, but also achieve satisfactory visual quality.
© 2014 Society of Photo-Optical Instrumentation Engineers (SPIE) 0091-3286/2014/$25.00 © 2014 SPIE
Yun Gu Lee and Guo Kai "Fast-rolling shutter compensation based on piecewise quadratic approximation of a camera trajectory," Optical Engineering 53(9), 093101 (9 September 2014). https://doi.org/10.1117/1.OE.53.9.093101
Published: 9 September 2014
Lens.org Logo
CITATIONS
Cited by 10 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Cameras

Video

Camera shutters

Motion models

Distortion

CMOS sensors

Motion estimation

RELATED CONTENT

Rolling shutter distortion correction
Proceedings of SPIE (June 24 2005)
Real-time global motion estimation for video stabilization
Proceedings of SPIE (February 04 2009)
Gain fixed-pattern-noise correction via optical flow
Proceedings of SPIE (April 24 2002)

Back to Top