Takakoki Co., Ltd., Kyoto University Hospital, and Panasonic Corporation have applied projection mapping technology, which has been widely used only in entertainment, to move or deform organs, which has been a problem in the medical field. Even so, we have developed the world's first support system that follows in real time and guides surgery.
Devices for performing simulations such as lesion position confirmation and intraoperative navigation have been developed based on body tissue information such as CT and MRI acquired before surgery.However, it was difficult to guide the surgery in real time due to the problem of misalignment due to deformation of body tissue during surgery.
By using the projection mapping technique, the operator can concentrate on the affected area by directly projecting the blood flow information of the body tissue obtained by the near-infrared fluorescence observation onto the organ.In addition, we thought that it would be possible to solve the problem by using an unprecedented intuitive real-time guide by projection mapping and an arm system that can accurately point the device at the affected area according to the situation.
Therefore, by arranging the fluorescence observation camera and the projector for mapping on the coaxial optical path, we have developed a mechanism that does not cause a deviation (± 2 mm or less) between the affected area observation information and the projected image.This made it possible to follow the movement of organs and deformation of body tissues in real time (within 0.2 seconds) and continue surgery under direct vision.
