Softbank is developing a new technology, “Virtual Fitting”. It is a technology that digitally generates an avatar that replicates your body shape with great precision. Also, by putting on realistic clothing for the avatar, we try to achieve a more precise digital fit. Clothing can replicate not only size but also color and texture with high accuracy.
This technology was announced by ZOZO NEXT on February 21, 2022 as a digital adaptation service in conjunction with Softbank and others. Speaking of ZOZO, I’m thinking “ZOZO costume”, but that’s completely different. Additionally, of the services jointly announced with ZOZO NEXT, only some of the technology SoftBank is researching is used internally.
ZOZO NEXT develops in collaboration “Alterm”, an application to try a virtual with a 3D avatar, with Softbank, etc.
The company’s technology is not limited to trial and should be widely used in the future, such as Metaverse and digital twins.
This is being tackled by a Softbank team studying neuroscience that mimics the human brain. This time, let’s dive into this technology and bring it back.
Issue EC Apparel “Contrary to the texture I imagined, the size did not suit me”
According to company data, apparel e-commerce is growing steadily, and the market is growing steadily even during the corona disaster. On the other hand, 86.7% of consumers answered, “I bought clothes through online shopping and failed or made it public.” It is clear that this is due to the impossibility of trying, and therefore the return rate in CE clothing is relatively high, which is a significant issue in terms of business.
“Avatar Generation SDK” and “Dressing SDK”
Therefore, the technology explained at the beginning is desired. The technology developed by SoftBank is broadly divided into two innovations, the “Avatar Generation SDK” and the “Port SDK”.
Avatar Generation SDK
“Avatar generation SDK” is a technology that automatically generates avatars in real time based on measurement data input, and we will provide it as an SDK.
Technology to map input measurement data using Unity Multipurpose Avatar (UMA)
By using the parametric model of the human body, which is one of the CAD technologies, the measurement data that can be input can be extended to any number of places depending on the application. As a model, we prepared an environment for modeling by designating 8 and 24 parts. Based on the input data, the avatar’s body shape changes in real time, and a new avatar can be generated automatically.
You can freely transform your body shape on the app (GIF)
Since this technology is a technology to generate an avatar with a specified data system, it is technically free to create the generated avatar as yourself, make it look like a movie actor, or generate it as than animation character.
Also, until now, modeling using 3D CAD required high CPU and GPU processing power, but we aim to operate in a low power and low resource environment so that ‘it can also work on the company’s technology and smartphones. development is in progress.
Clothing Development Kit
Once your avatar is complete, it’s time to try it out. “Dressing SDK” is a technology that allows you to see your own fitting from an objective point of view by putting on the generated avatar clothes that faithfully reproduce the material, size and design.
In addition to just wearing clothes, there is also a heat map that shows where the clothes are tight by changing the color, and after trying on you can check which part is tight (blue heat map in the video below below). In addition, the layering and coordination between shirts and jackets can be reproduced digitally with realistic dimensions.
■ Vertical video fit
Main functions during research and development
・ Multiple layers (coordination)
・ Heat map display in restricted areas
・ Opening and closing buttons and zippers
・Adjust the position of the waist where the pants are worn
・Cross simulation with character animation
It should also be noted that the texture is expressed realistically. The coefficient of friction is also taken into account and jolts are reproduced realistically. Please also watch the video below.
■Virtual fit – Custom avatar and real-time cloth simulation –
Technically speaking, “a simulation that generates a highly accurate avatar and wears it in real time to objectively see the image and hardware coordination.” It’s also great that these can be deployed as SDKs and implemented in smartphone apps.
ZOZO NEXT develops in collaboration “Alterm”, an application to try a virtual with a 3D avatar, with Softbank, etc.
