in painting

7/25/2019 In Painting

1/26

Image Inpainting

M. Bertalmio, A.L. Sapiro, V. Caselles,C. Ballester

M. Bertalmio, A.L. Bertozzi & G. Sapiro

presented byRoman Stanca!

"a#ier Sto!es, $l%idynamics and Image and

Video Inpainting

"a#ier Sto!es, $l%idynamics and Image and

Video Inpainting


2/26

Goal

Gi#en image 'it signi(cant portionsmissing or damaged

Reconstit%te missing regions 'it dataconsistent 'it te rest o) te image


3/26


4/26


5/26

Crac!s in *otos


6/26

Scratces in $ilm


7/26

Add or remo#e elements


8/26

*ro)essional Inpainters

Approac Goal+

S%becti#ely restore %nity to art'or!

General Approac+ Str%ct%re o) s%rro%nding area contin%ed

into gap

Color o) s%rro%nding area is contin%edinto gap

-et%re is added


9/26

Gestalt La' o) Contin%ation

*rinciple olding tat tere is aninnate tendence to percei#e a line ascontin%ing its establised direction


10/26

General Algoritm

Iterati#ely

Contin%e str%ct%re o) s%rro%nding area

into gap Contin%e color o) s%rro%nding area into

gap


11/26

Algoritm

e(ne image %pdate as )ollo's+

It/i,0 1 dL/i,0 . "/i,0

It/i,0 is cange in intensity to %sed to%pdate te image

L/i,0 is te in)ormation to propagate

"/i,0 is te propagation direction dL/i,0 . "/i,0 is te cange in in)ormation

along te propagation direction


12/26

*ropagation irection

2ant to preser#e angle o) 3arri#al3

*ropagate along isopotes

lines o) e4%i#alent intensity le#els

Isopotes


13/26

*ropagation irection

More )ormally+

Image gradient

largest cange *erpindic%lar

smallest cange

tis is te isopote

Isopote is tis bo%ndary

= N(i,j)


14/26

Algoritm

2at in)ormation to propagate5

3smootness3

Laplacian 11 I/i,0 6Iyy/i,0 1 L/i,0


15/26

Algoritm

Repeat tis image %pdate step torestore image

2en to stop5 Stop 'en %pdate #al%e is negligible

i.e. It/i,0 7 epsilon )or all i,

Stop a)ter n iterations


16/26

Some res%lts


17/26

Some res%lts


18/26

Some res%lts


19/26

More res%lts


20/26

More res%lts


21/26

More res%lts


22/26

"a#ier8Sto!es e4%ations

"onlinear partial di9erential e4%ations

escribe te :o' o) :%ids s%c as

li4%ids and gasesAir c%rrents

;cean c%rrents

2ater :o' in a pipe


23/26

"a#ier8Sto!es e4%ations


24/26

Relation to Inpainting

Inpainting

*ropagation o) intensity along isopoteaccording to smootness

$l%id mecanics

Con#ection o) :%id along #elocity (eldaccording to #orticity


25/26

Relation to Inpainting

Mapping

Image intensity 11 Stream )%nction

Isopote direction 11 :%id #elocity Smootness 11 #orticity

*ropels inpainting into an establised(eld 'it a 'ealt o) teoretical andn%merical literat%re

in painting

Documents