achieving a realistic colour appearance for 3-d printed skin · achieving a realistic colour...

40
Achieving a realistic colour appearance for 3 - D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool) Julian Yates (Manchester) Chang Li (Anshan, China) Mengmeng Wang, Jingjing Yin (Leeds)

Upload: others

Post on 29-May-2020

6 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Achieving a realistic colour

appearance for 3-D printed skin

Kaida Xiao, Tushar Chauhan, Sophie Wuerger

(Liverpool)

Julian Yates (Manchester)

Chang Li (Anshan, China)

Mengmeng Wang, Jingjing Yin (Leeds)

Page 2: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

PURPOSE OF PROJECT

Advanced Method of Facial Prostheses

Page 3: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

IMAGE ACQUISITION SKIN COLOUR DATABASE

SPECTRAL RECONSTRUCTION TOLERANCE LIMITS

ab

L

For different ethnicities

RGB -> XYZ-> SPECTRAPerceptual experiments

Reliability and repeatability

Page 4: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Problems to consider with skin appearance- textured = polychromatic

- non-flat material

- 3D facial structure

Page 5: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Problems to consider with skin appearance- textured = polychromatic

- non-flat material

- 3D facial structure

Complicated structure

Page 6: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

COLOR SIGNAL = ILLUMINANT * REFLECTANCE

(Source: Wandell; Foundation of Vision)

Page 7: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Problems to consider with skin appearance• Metamerism

Skin changes under changes in illumination is a serious problem

for skin prostheses.

Solution: use spectral-based evaluation, instead of colorimetric

Page 8: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Metamerism: two physically different spectra appear the same

the observer

Illumination Metamerism

Page 9: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

IMAGE ACQUISITION SKIN COLOUR DATABASE

SPECTRAL RECONSTRUCTION TOLERANCE LIMITS

ab

L

For different ethnicities

RGB -> XYZ-> SPECTRAPerceptual experiments

Reliability and repeatability

Page 10: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Nikon D7000 camera with DigiEye imaging system

Tele-spectroradiometer: PhotoResearchSpectraScan PR650

3D camera: 3dMDTriosystem Spectrophotometer: Konica Minolta CM-700d

with CM-SA skin analysis software Verivide facial imaging lighting booth

IMAGE ACQUISITION

Page 11: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

10 locations were measured

1. Forehead

2. Zygomatic (cheekbone)

3. Nose tip

4. Chin

5. Cheek

6. Neck

7. Inner forearm

8. Ringfinger pulp

9. Outer forearm

10. Back of hand

IMAGE ACQUISITION

Page 12: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

• 4 ethnic groups:• Chinese 86

• Caucasian 79

• African 10

• Sub-Asian 13

• Totally measured 188 People

• Collected over 10000 spectra and 900

2D images

IMAGE ACQUISITION

Page 13: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

MCDM LP-3mm HP-3mm LP-6mm HP-6mm Mean

Subjects 0.75 0.98 0.56 0.85 0.79

Panton 0.06 0.08 0.05 0.07 0.07

IMAGE ACQUISITION

Page 14: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

IMAGE ACQUISITION SKIN COLOUR DATABASE

SPECTRAL RECONSTRUCTION TOLERANCE LIMITS

ab

L

For different ethnicities

RGB -> XYZ-> SPECTRAPerceptual experiments

Reliability and repeatability

Page 15: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Caucasians Chinese Kurdish Thai

217 288 146 426

Spectrophotometer measurement (same protocol)

Location: UK, China, Iraq, Thailand

Body area: facial and arm colours

SKIN COLOUR DATABASE

Page 16: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SKIN COLOUR DATABASE

Page 17: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Face

SKIN COLOUR DATABASE

Page 18: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Arm

SKIN COLOUR DATABASE

Page 19: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SKIN COLOUR DATABASE

Most significant ethnic differences in yellowness; followed by

lightness; less so in redness

***

Page 20: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SKIN COLOUR DATABASE

Page 21: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

IMAGE ACQUISITION SKIN COLOUR DATABASE

SPECTRAL RECONSTRUCTION TOLERANCE LIMITS

ab

L

For different ethnicities

RGB -> XYZ-> SPECTRAPerceptual experiments

Reliability and repeatability

Page 22: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Skin Spectra

SPECTRAL RECONSTRUCTION

Page 23: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SPECTRAL RECONSTRUCTION

PCA

Page 24: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SPECTRAL RECONSTRUCTION

Page 25: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SPECTRAL RECONSTRUCTION

Page 26: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

PCA

CCP (%)First

Component

Second

Component

Third

Component

Sum

Chinese 84.1 12.3 2.2 98.5

Kurdish 86.6 7.9 3.1 97.6

Caucasians 87.4 8.4 2.6 98.5

All 85.4 9.4 2.3 97.1

SPECTRAL RECONSTRUCTION

Page 27: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SPECTRAL RECONSTRUCTION

RGB->spectra

Page 28: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

0

1

2

3

4

5

6

1 2 3 4 5

Mea

n C

olo

ur

Dif

fere

nce

(D

E*ab

)

No. of order for Polynomial Regression

3 basis functions 4 basis functions

5 basis functions 6 basis functions

SPECTRAL RECONSTRUCTION

Page 29: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Skin spectral prediction

• Colour chart for training colours

- Conventional colour chart, skin colour chart

• Mathematic Model

- Camera rgb to Reflectance

- Camera rgb to CIE XYZ and to spectral

reflectance

- PCA, ICA, Wiener

• Skin spectral database

- Local

- Globe

Page 30: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

IMAGE ACQUISITION SKIN COLOUR DATABASE

SPECTRAL RECONSTRUCTION TOLERANCE LIMITS

ab

L

For different ethnicities

RGB -> XYZ-> SPECTRAPerceptual experiments

Reliability and repeatability

Page 31: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SKIN TOLERANCE LIMITS

Develop a metric optimised for skin colours:

Psychophysical experiment to determine thresholds for

skin patches - 4AFC – adaptive procedure

Page 32: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SKIN TOLERANCE LIMITS

ELLIPSOID - threshold contours

Page 33: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SKIN TOLERANCE LIMITS

Page 34: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SKIN TOLERANCE LIMITS

Page 35: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SKIN TOLERANCE LIMITS

Page 36: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SKIN TOLERANCE LIMITS

Page 37: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

SKIN TOLERANCE LIMITS

Page 38: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Further improvements of 3D printing of skin?

- Development of pigments with material &

spectral properties closer to skin

- Pigments optimised for small skin gamut

- New materials responsive to temperature?

Page 39: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

Colour Gamut of Z-corp 3D printer

Optimising gamut

Page 40: Achieving a realistic colour appearance for 3-D printed skin · Achieving a realistic colour appearance for 3-D printed skin Kaida Xiao, Tushar Chauhan, Sophie Wuerger (Liverpool)

0

20

40

60

80

100

360 420 480 540 600 660 720

Ref

lect

an

ce R

ati

o

wavelength (nm)

Spectral Reflectance

Printing Skin

Human Skin

OPTIMISING PIGMENTS’ SPECTRA