connected 3d fashion experiences consultation workshop - 19 january 2010, brussels

University of GenevaMIRALab - www.miralab.chWhere Research Means Creativity

Connected 3D Fashion Experiences

Connected 3D Fashion Connected 3D Fashion ExperiencesExperiencesConsultation Workshop - 19 January 2010, Brussels

Prof. Nadia Magnenat-Thalmann & Dr. Dimitris ProtopsaltouProf. Nadia Magnenat-Thalmann & Dr. Dimitris Protopsaltou

MIRALab – University of GenevaMIRALab – University of [email protected]@miralab.unige.ch

mailto:[email protected]




MIRALabMIRALab

MIRALab was founded in 1989at the University of Geneva

MIRALab director : Prof. Nadia Magnenat-Thalmann

[email protected] MIRALab team:

8 post doc and senior researchers ~20 researchers and PhD students ~10 MSc students




Expertise of MIRALab A pluridisciplinary lab working on virtual human

simulation and virtual worlds

Facial animation

Virtual clothing

Mixed realities

Virtual heritageHair simulation

Web 3D

Graphics standardizationMotion captureUser centric Multimedia Medical simulation

Body animation

Multidevices platform (PDAs & cellphones)

Collaborative virtual environments

Personality and emotion simulation



The User-Centric approach in FashionThe User-Centric approach in Fashion

Collaborative Design

Virtual Try-On

Connected 3D Fashion Experiences is about:Connected 3D Fashion Experiences is about: Garments, Shoes, Jewellery and HairstyleGarments, Shoes, Jewellery and Hairstyle



5

grading and fitting• made by grading specialists• house specific grading system• grading heuristics2D patterns

• made by pattern developers• based on technical sketches

prototyping • single size• use samples of fabric or• fabric printed in-house

2D pattern making• fabric cut optimization• marker design

production• in-house or outsourced• cutting, sewing, finishing

accessories • buttons, zippers, laces

Traditional Garment processTraditional Garment process

fabric specs• structure, weaved, knitted • colors and prints

apparel concept• feel and look• fabrics

technical sketches • style and form• color and shape composition• pockets, embroidery, finishing

The EU textile and clothing sector is one of the two biggest

players in the world market.

Represents 29% of the world exports

http://www.bjcraftsupplies.com/buttons/images/buttons%20real.jpg



6

Virtual Garment Design in Collaborative EnvironmentVirtual Garment Design in Collaborative Environment



7

• A new working paradigm

A Collaborative Working Environment that supports people in their individual and cooperative work.




8

• Different level of navigation Local workspace (Individual work)

Shared workspace (cooperative work)

Level 02

Level 01




9

User Centric “Virtual Try-On”User Centric “Virtual Try-On”

VTO is an online application, allowing anybody to try-on virtual garments For consumers

Online shopping: “I like this garment, but how does it look on my body and will it fit?”

For designers Rapid prototyping/evaluation of a design in various

sizes and with various fabrics



10

Existing Virtual Try-On for consumersExisting Virtual Try-On for consumers

2-Dimensional images• Synthetic models

• Garments overlaid on body image

• Limited adjustment of body

• Fixed viewpoints

3-Dimensional model• Free view of entire static 3D model

• Garments are 3D Meshes

• Garments deformed (skinned) to body

In general there is no animation, a very limited personalization of body measurements and there is no physical simulation of the garments

Photo-based approaches• Images of real garments

• Garments overlaid on bodies

• No adjustment of body

• Fixed viewpoints



11

The Virtual TryOn (VTO)The Virtual TryOn (VTO) Combines three different modules into a

single coherent applicationBody sizing

• 23 Parameters

• Animation automatically retargeted to new sizes

Garment sizing

• On-the-fly switching between different sizes

• No new files needed

High quality simulation

• Highly accurate simulation

• Generates video output



12

Virtual Try-On for designers and consumersVirtual Try-On for designers and consumers

the Zegna outfitthe Zegna outfit



13

An example: Zegna outfitAn example: Zegna outfit

Garment Prototyping



Next possible Scenario…Next possible Scenario…

Walking outside a display window; you take a photo

of dressed mannequin

Entering a fashion store; you take a photo of garment draped

in the hanger

Attending a fashion show; you take a photo of a model

walking on the catwalk

You are using your phone to customise a 3D garment

to fit your body size

You and your friends experience real-time 3D

interactive virtual dressed humans

You evaluate how tight is a garment style and how it interacts with your body

skin.



Future challenges 1

Virtual fashion environments tightly coupled to the physical world Enabled by context-aware wearable and mobile devices

that will become “a viewfinder for our fashion style” Holistic and scalable “social shopping” platform for mobile

users Searches and retrieves pertinent 3D fashion styles with

integrated fit and comfort knowledge Multi-modal search of deformed 3D objects

Deformable 3D garment recognition and retrieval based on multi-modal (photos and/or sketches) search queries

Realise the “extended fashion store” that enables mobile and social shopping Seamless session migration enables personal mobility Allows the store-based services and content to follow the

consumer



Future challenges 2

3D content workflow supporting mobile environments Enable interoperable styles and personas to be shared

between various mobile devices and multiple connected worlds

Visualisation of large number of virtual objects composed of large and complex data sets Body scans, deformation maps, motion capture, 3D

garments and virtual fabrics Real-time interaction protocol preserves the real-

time interactive performance of users. A real-time interactive media flow protocol ensures:

low latency, end-to-end peering capability, security and scalability



Future challenges 3

Robust and real time simulation GPU-optimised virtual prototyping tools automated 2D-to-3D design process and animation of 3D scanned

bodies Haptic interfaces, which convey a sense of touch,

enabling users to “feel” the virtual 3D fabrics they are manipulating New models for online collaboration

Collaborators can develop a simulation jointly in real time but they also can contribute to the simulation at different times.

Raise issues of ownership and trading of virtual garments as well as privacy data protection and fair right of use.

Social ad-hoc interaction platform can support “spontaneous interactions” among users Share contents and users’ experiences Without trespassing privacy and as well as extend and enrich users’

social relationships with their interests and emotions.



18

Thank you for your attention

Contact:

Dimitris [email protected] Nadia [email protected]



connected 3d fashion experiences consultation workshop - 19 january 2010, brussels

Documents