Calibration between a 3D camera and an aerial information screen

Shusei Ito; Nao Kurokawa; Hirotsugu Yamamoto

doi:10.1117/12.2270469

26 June 2017 Calibration between a 3D camera and an aerial information screen

Shusei Ito, Nao Kurokawa, Hirotsugu Yamamoto

Proceedings Volume 10335, Digital Optical Technologies 2017; 103351S (2017) https://doi.org/10.1117/12.2270469
Event: SPIE Digital Optical Technologies, 2017, Munich, Germany

Abstract

We have formed an aerial screen with aerial imaging by retro reflection (AIRR) and detected gestures of a user with a 3D gesture recognition camera. This paper deals with a calibration problem between the coordinate systems of the aerial screen and the camera. We propose a calibration method of the 3D camera and the aerial information screen. We used a Kinect v2 for 3D gesture recognition. The Kinect detects positions of users’ hands up to two users. We developed a calibration software and interactive applications by using Unity. In Unity, we prepared a camera for rendering, objects, and two squares that show hands’ positions. The objects are displayed in the mid-air. Our developed program detects collision between one of the hands and one of the objects. The collision is determined after calibration. The calibration is automatically conducted by adjusting the view angle and the position of the camera in Unity to match the Kinect. In the calibration process, a user is instructed to place one of the hands on four corners of an aerial calibration pattern, one after another. The x-coordinate and y-coordinate of the hand position in the Kinect coordinate system are used to calibrate the central position in Unity. The z-coordinate is used to judge collision because it shows the distance from the hand to the aerial image. We have formed a 43-inch aerial screen. The aerial screen, tilting by 30 degrees, is floating at 35 cm above a reflective polarizer. We have realized aerial interaction.

Citation Download Citation

Shusei Ito, Nao Kurokawa, and Hirotsugu Yamamoto "Calibration between a 3D camera and an aerial information screen", Proc. SPIE 10335, Digital Optical Technologies 2017, 103351S (26 June 2017); https://doi.org/10.1117/12.2270469

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Calibration

Cameras

Stereoscopic cameras

Retroreflectors

Gesture recognition

Reflectivity

Imaging systems

Show All Keywords

Keywords/Phrases

Search In:

Publication Years