Dynamic projection mapping onto non-rigid objects using markers and skeletal information

Yukine Taya; Tokiichiro Takahashi

doi:10.1117/12.2666971

25 March 2023 Dynamic projection mapping onto non-rigid objects using markers and skeletal information

Yukine Taya, Tokiichiro Takahashi

Proceedings Volume 12592, International Workshop on Advanced Imaging Technology (IWAIT) 2023; 125922H (2023) https://doi.org/10.1117/12.2666971
Event: International Workshop on Advanced Imaging Technology (IWAIT) 2023, 2023, Jeju, Korea, Republic of

Abstract

Costumes are one of the major elements of the excitement in a live music performance. Although it is ideal to change the costumes to match the music theme each time, it is not practical because of the time and effort required to change the costume. In this paper, we propose a dynamic projection mapping method onto the costumes instead of “real” costume changes. Our method generates mapping images in advance, which are deformed and/or occluded in accordance with the dance choreography. Then, the projection positions are slightly adjusted in real time based on the difference between expected and actual standing position. This technique enables dynamic projection mapping onto a non-rigid object. Several experimental results verified the feasibility of the dynamic projection mapping.

Citation Download Citation

Yukine Taya and Tokiichiro Takahashi "Dynamic projection mapping onto non-rigid objects using markers and skeletal information", Proc. SPIE 12592, International Workshop on Advanced Imaging Technology (IWAIT) 2023, 125922H (25 March 2023); https://doi.org/10.1117/12.2666971

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available