chapter 8 – shape representation and descriptionzduric/cs682/slides/regiondescriptors.pdfthe shape...

52
Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8- 8-0 8.1 Region identification 8.1 Region identification 8.2 Contour-based shape 8.2 Contour-based shape representation representation 8.3 Region-based shape 8.3 Region-based shape representation and representation and description description 8.4 Shape classes 8.4 Shape classes Chapter 8 Chapter 8 Shape Shape representation representation and description and description

Upload: others

Post on 30-May-2020

5 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-00

8.1 Region identification8.1 Region identification8.2 Contour-based shape8.2 Contour-based shape

representationrepresentation8.3 Region-based shape 8.3 Region-based shape representation and representation and descriptiondescription8.4 Shape classes8.4 Shape classes

Chapter 8 Chapter 8 ––ShapeShape

representationrepresentationand descriptionand description

Page 2: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-11

Page 3: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-22

Page 4: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-33

Page 5: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-44

Page 6: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-55

Page 7: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-66

Page 8: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-77

Page 9: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-88

Page 10: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-99

Page 11: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-1010

Page 12: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-1111

Page 13: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-1212

Page 14: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-1313

Page 15: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-1414

Page 16: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-1515

Page 17: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-1616

Page 18: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-1717

Page 19: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-1818

Page 20: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-1919

Page 21: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-2020

Page 22: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-2121

Page 23: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-2222

Page 24: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-2323

Page 25: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-2424

Page 26: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-2525

Page 27: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-2626

Page 28: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-2727

Page 29: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-2828

Page 30: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-2929

Page 31: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-3030

Page 32: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-3131

Page 33: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-3232

Page 34: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-3333

Page 35: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-3434

Page 36: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-3535

Page 37: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-3636

Page 38: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-3737

Page 39: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-3838

Page 40: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-3939

Page 41: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-4040

Page 42: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-4141

Page 43: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-4242

Page 44: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-4343

Page 45: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-4444

Page 46: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-4545

SummaryShape representation and description Region description generates a numeric feature vector or a non-

numeric syntactic description word, which characterize properties (forexample, shape) of the described region.

While many practical shape description methods exist, there is nogenerally accepted methodology of shape description. Further, it is notknown what is important in shape.

Shape may change substantially with image resolution. Conventionalshape descriptions change discontinuously with changes in resolution.A scale-space approach aims to obtain continuous shape descriptionsfor continuous resolution changes.

The shape classes represent the generic shapes of the objectsbelonging to the same classes. Shape classes should emphasizeshape differences among classes, while the shape variations withinclasses should not be reflected in the shape class description.

Page 47: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-4646

SummaryRegion identification Region identification assigns unique labels to image regions. If nonrepeating ordered numerical labels are used, the largest integer

label gives the number of regions in the image.

Contour-based shape descriptors Chain codes describe an object by a sequence of unit-size line

segments with a given orientation, called Freeman’s code. Simple geometric border representations are based on geometric

properties of described regions, e.g.:* Boundary length.* Curvature.* Bending energy.* Signature.* Chord distribution.

Page 48: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-4747

SummaryContour-based shape descriptors cont. Fourier shape descriptors can be applied to closed curves, co-

ordinates of which can be treated as periodic signals.

Shape can be represented as a sequence of segments with specifiedproperties. If the segment type is known for all segments, the boundarycan be described as a chain of segment types, a code word consistingof representatives of a type alphabet.

B-splines are piecewise polynomial curves whose shape is closelyrelated to their control polygon—a chain of vertices giving a polygonalrepresentation of a curve. B-splines of third order are most common,representing the lowest order which includes the change of curvature.

Shape invariants represent properties of geometric configurations thatremain unchanged under an appropriate class of transforms; machinevision is especially concerned with the class of projective transforms.

Page 49: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-4848

SummaryRegion-based shape descriptors Simple geometric region descriptors use geometric properties of

described regions:* Area. * Elongatedness.* Euler’s number. * Rectangularity.* Projections. * Direction.* Height, width. * Compactness.* Eccentricity.

Statistical moments interpret a normalized gray-level image functionas a probability density of a 2D random variable. Properties of thisrandom variable can be described using statisticalcharacteristics—moments. Moment-based descriptors can be definedto be independent of scaling, translation, and rotation.

Page 50: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-4949

Summary

Region-based shape descriptors cont. The convex hull of a region is the smallest convex region H which

satisfies the condition R H.

More complicated shapes can be described using regiondecomposition into smaller and simpler sub-regions. Objects can berepresented by a planar graph with nodes representing sub-regionsresulting from region decomposition. Region shape can then bedescribed by the graph properties. There are two general approachesto acquiring a graph of sub-regions:

* Region thinning.* Region decomposition.

Page 51: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-5050

SummaryRegion-based shape descriptors cont. Region thinning leads to the region skeleton that can be described

by a graph. Thinning procedures often use a medial axis transform toconstruct a region skeleton. Under the medial axis definition, theskeleton is the set of all region points which have the same minimumdistance from the region boundary for at least two separate boundarypoints.

Region decomposition considers shape recognition to be ahierarchical process. Shape primitives are defined at the lower level,primitives being the simplest elements which form the region. A graphis constructed at the higher level—nodes result from primitives, arcsdescribe the mutual primitive relations.

Page 52: Chapter 8 – Shape representation and descriptionzduric/cs682/Slides/RegionDescriptors.pdfThe shape classes represent the generic shapes of the objects belonging to the same classes

Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd. 8-8-5151

SummaryRegion-based shape descriptors cont. Region neighborhood graphs represents every region as a graph

node, and nodes of neighboring regions are connected by edges. Theregion adjacency graph is a special case of the region neighborhoodgraph.

Shape classes Shape classes represent the generic shapes of the objects belonging

to the class and emphasize shape differences among classes.

A widely used representation of in-class shape variations isdetermination of class-specific regions in the feature space.