Associate Professor Keisuke Shima of Yokohama National University Graduate School of Environment and Information Sciences and Milus Co., Ltd. jointly developed a system that visualizes the emotions of doctors during surgery using an electrocardiogram sensor and AI.
This system visualizes emotions during surgery from the waveform of an electrocardiogram sensor attached to the chest of the doctor, using an AI emotion estimation model developed in-house.It is empirically known that emotions greatly affect people's performance, so it is particularly important to visualize the emotions of doctors during surgery, which is a life-saving operation.
As a result of using this system to estimate the emotions of doctors during surgery using AI, it was found that although the emotions were relatively calm at the start of the operation, the nervousness was reduced in the latter half of the operation, when the surgical field reached the brain. It was observed that the number of emotions expressed increased.As for emotional ups and downs, it was confirmed that the intervals between the ups and downs were shortened when the subjects were tense.Such data are also useful for psychological analysis by psychologists.
This system makes it possible to visualize how experienced doctors control their emotions at each stage during surgery, and to extract surgical stages that make even experienced doctors nervous. , it is expected that it will be possible to share knowledge based on objective data.
In addition to the visualization of the emotions of surgeons, the emotion estimation technology is expected to have a wide range of applications. Emotional expressions of people, medical applications such as early detection of dementia, etc.In the future, the AI emotion estimation system will be repeatedly evaluated and improved, aiming to be used in various scenes.
