A group at the University of Tokyo has developed a system that enables real-time, high-quality virtual fitting.By utilizing this technology, you can try on clothes of various sizes and designs as if you were looking in the mirror in the dressing room in online shopping, or you can virtually wear your favorite clothes (composite display) in a video conference. Etc. are possible.

 With this technology, when a customer wears measurement clothing and stands in front of the camera, an image of the product's clothing is generated in real time.In the conventional method of realizing virtual fitting, it was common to build one deep learning model for various kinds of clothes, but with this, smooth and high-quality real-time generation of fitting images can be achieved. difficult.Therefore, this group made it possible to generate fitting images corresponding to various body shapes and posture changes by constructing a deep learning model focusing on the generation of images of specific clothes.

 The training of the image conversion network that realizes this technology required a huge amount of input images (images of humans wearing measurement clothes) and output images (images of humans wearing clothes to be tried on). The group has also developed a robot mannequin dedicated to shooting training data that can numerically control body shape and posture.By acquiring and learning a large number of images while changing the body shape and posture using a robot mannequin, a deep learning model that generates high-quality images was completed.

 With the accelerating spread of online purchasing and meetings, the system developed in this research can generate detailed clothes deformation according to various poses and clothes sizes in real time, and for various purposes. Can be expected to be utilized.The research group aims to further optimize and improve the degree of freedom for practical use.

Paper information:[ACM UIST 2021] Per Garment Capture and Synthesis for Real-time Virtual Try-on

Tokyo University

Established in the 10th year of the Meiji era.A university with the longest history in Japan and at the forefront of Japanese knowledge

The University of Tokyo was established in 1877 (Meiji 10) by integrating the Tokyo Kaisei School and the Tokyo Medical School.Since its establishment, it has developed education and research in a unique way in the world as a leading university in Japan and an academic center for the fusion of East and West cultures.As a result, many human resources have been produced in a wide range of fields, and many research achievements […]

University Journal Online Editorial Department

This is the online editorial department of the university journal.
Articles are written by editorial staff who have a high level of knowledge and interest in universities and education.