3d photorealistic modeling process
DESCRIPTION
3D Photorealistic Modeling Process. Different Sensors. Scanners Local coordinate system Cameras Local camera coordinate system GPS Global coordinate system. Coordinate Systems. Individual local scanner coordinates (each scan) - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/1.jpg)
3D Photorealistic Modeling Process
![Page 2: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/2.jpg)
Different Sensors
• Scanners • Local coordinate system
• Cameras• Local camera coordinate system
• GPS• Global coordinate system
![Page 3: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/3.jpg)
Coordinate Systems
• Individual local scanner coordinates (each scan)
• Object coordinate system (single coordinate system aligning all scans)
• Camera coordinate system (each photograph)
• Global coordinates
![Page 4: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/4.jpg)
Scanner Coordinate
• Individual scanner local coordinate
– Not necessary to level
Y
X
Z
![Page 5: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/5.jpg)
Y
X
Z
Camera Coordinate System
• Each photograph has its own coordinates– Units: mm or pixel
![Page 6: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/6.jpg)
Putting it together
• From individual scan coordinates to object coordinates
• From object (or global) coordinates to camera coordinates
• From object coordinates to global coordinates
![Page 7: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/7.jpg)
Individual coordinates to object coordinates (1/2)
• Traditional survey approaches– Need to level the scanner– set up backsight– Knowing scanner location and backsight angle
• transform each point to the object coordinate system, usually global.
– Advantage: • easy to set up• one-step from local to global coordinates.
– Disadvantage:• problem in generating mesh models.
![Page 8: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/8.jpg)
From individual coordinates to object coordinates (2/2)
• Use mesh alignment techniques (Polyworks)– No need to level.– Requires overlap with common
features to minimize the distance.
Z
X
Ysc1 sc2
T =
![Page 9: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/9.jpg)
From Object to Camera (1/2)
• Two approaches– Polynomial fit (rubber sheeting)
• Low accuracy,• No need to know camera intrinsic parameters
– Projection transform (pinhole model)• High accuracy
![Page 10: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/10.jpg)
From Object to Camera (2/2)
1. From object to camera coordinate system (pin hole model)
2. Perspective projection to convert to image coordinates (uv, pixel, or mm)
6 unknowns assuming known fNonlinear-needs initial value
![Page 11: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/11.jpg)
Camera Calibration
• Correct lens distortion– Radial distortion– Tangential distortion
– Calculate f, k1, k2, p2, p2 in the lab for each lens.
![Page 12: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/12.jpg)
Example of the calibration (Canon 17mm)
1 2
3
1) Radial distortion2) Tangential distortion3) Complete model
![Page 13: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/13.jpg)
ExampleIteration = 8
Residualspts51 = -0.0027 -0.0065pts50 = 0.0045 0.0085pts2034 = 0.0050 0.0087pts 2010 = -0.0066 -0.0100
omage:0.08839938218814phi:1.36816786714242kappa: 1.45634479894558X: -0.975Y: 0.519Z: -0.013
![Page 14: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/14.jpg)
Bundle Adjustment
Adjust the bundle of light raysto fit each photo
![Page 15: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/15.jpg)
Bundle Adjustment (2/2)Photo no : 7734 pt no U V 201 -0.000 -0.000 202 0.000 0.003 203 -0.000 -0.006 14 -0.003 0.012 15 0.000 0.001 204 0.001 -0.004 205 0.001 -0.009 302 0.001 0.004
Photo no omega phi kappa X Y Z 7733 3.5147 78.25411 85.03737 -1.031 0.628 0.046 7734 21.026 79.86519 68.09084 0.419 14.735 -1.055
Photo no : 7735 pt no U V 14 0.003 -0.006 15 0.003 -0.001 204 -0.001 0.004 205 -0.001 0.009 16 0.017 0.005 206 0.000 0.001 207 -0.001 -0.009 208 0.001 0.010 302 -0.006 -0.009
![Page 16: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/16.jpg)
From Object to Global (1/2)
• 7-parameter conformal transformation
s
Where m11 = cos(phi) * cos(kappa);m12 = -cos(phi) * sin(kappa);m13 = sin(phi)m21 = cos(omega) * sin(kappa) + sin(omage) * sin(phi) * cos(kappa);m22 = cos(omage) * cos(kappa) – sin(omega) * sin(phi) * sin(kappa);m23 = -sin(omage) * cos(phi);m31 = sin(omage) * sin(kappa) – cos(omage) * sin(phi) * cos(kappa);m32 = siin(omage) * cos(kappa) + cos(omage) * sin(phi) * sin(kappa);m33 = cos(omage) * cos(phi);and s is scale factor
![Page 17: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/17.jpg)
Transform to Global (2/2)
Object GPS
Iteration:5scale : 0.998986 (*****)omega : 0.22279535phi : -0.04740587 kappa : 1.45393837X trans: 24.834 Y trans: 11.698Z trans: 2.142
Pt: 1, X -0.012 Y 0.042 Z 0.010Pt: 2, X 0.008 Y -0.004 Z -0.012Pt: 3, X 0.011 Y 0.012 Z 0.004Pt: 4, X -0.017 Y -0.032 Z -0.007Pt: 5, X 0.010 Y -0.018 Z 0.006
![Page 18: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/18.jpg)
REDUCTION TO THE ELLIPSOID
h
NH
R Earth Radius 6,372,161 m
20,906,000 ft.
Earth Center
S
D
S = D x R R + h
h = N + H
S = D x R + N + H
R
![Page 19: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/19.jpg)
REDUCTION TO GRID
Sg = S (Geodetic Distance) x k (Grid Scale Factor)
Sg = 1010.366 x 0.99991176
= 1010.277 meters
![Page 20: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/20.jpg)
REDUCTION TO ELLIPSOID
S = D x [R / (R + h)] D = 1010.387 meters (Measured Horizontal Distance) R = 6,372,162 meters (Mean Radius of the Earth) h = H + N (H = 158 m, N = - 24 m) = 134 meters (Ellipsoidal Height)
S = 1010.387 [6,372,162 / 6,372,162 + 134] S = 1010.387 x 0.999978971 S = 1010.366 meters
![Page 21: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/21.jpg)
COMBINED FACTOR
CF = Ellipsoidal Reduction x Grid Scale Factor (k)
= 0. 0.999978971 x 0.99991176
= 0.999890733
CF x D = Sg
0.999890733 x 1010.387 = 1010.277 meters
![Page 22: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/22.jpg)
Surface Generation
• Through merge process in Polyworks
• Through fitting through GoCad
• Through direct triangulation (Delauney triangulation, TIN)
![Page 23: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/23.jpg)
Surface cleaning (in Polyworks)• The single most time
consuming part of entire process (90% of time).– Filling the holes
(because of scan shadow)
– Correct triangles
![Page 24: 3D Photorealistic Modeling Process](https://reader038.vdocuments.net/reader038/viewer/2022103101/5681446f550346895db10185/html5/thumbnails/24.jpg)
Summarize