rs at event synchronization task
TRANSCRIPT
![Page 1: RS at Event Synchronization Task](https://reader036.vdocuments.net/reader036/viewer/2022062515/55c1f722bb61eb026d8b4729/html5/thumbnails/1.jpg)
Sychronising event photos by approximating a set of pairwise time constraints
Paweł Nowak, Marcus Thaler, Harald Stiegler, Werner BailerMediaEval Workshop, Barcelona, Oct. 2014
![Page 2: RS at Event Synchronization Task](https://reader036.vdocuments.net/reader036/viewer/2022062515/55c1f722bb61eb026d8b4729/html5/thumbnails/2.jpg)
2Approach: Determine offsets
determine the visual similarity of image pairs
based on full matching of SIFT descriptors and based on VLAD
GPS is used optionally (if available)
Assuming constant offsets between galleries, a matching pair contributes a constraint δp- δq = τij
Iteratively solve equation system using Jacobi method, and discard up to 10% largest outliers
![Page 3: RS at Event Synchronization Task](https://reader036.vdocuments.net/reader036/viewer/2022062515/55c1f722bb61eb026d8b4729/html5/thumbnails/3.jpg)
3Approach: Determine offsets
Gallery 2 Gallery 3 Gallery 4 ... Gallery n
𝛿2
𝛿3
𝛿𝑛
𝛿𝑛−1
¿
. . .
. . .
. . .
. . .
. . .
0
0 0
0 τij
τkl
. . .
-
-
![Page 4: RS at Event Synchronization Task](https://reader036.vdocuments.net/reader036/viewer/2022062515/55c1f722bb61eb026d8b4729/html5/thumbnails/4.jpg)
4Challenges of visual matching
![Page 5: RS at Event Synchronization Task](https://reader036.vdocuments.net/reader036/viewer/2022062515/55c1f722bb61eb026d8b4729/html5/thumbnails/5.jpg)
5Approach: Cluster sub-events
Initialize from subsequent images with high similarity: oversegmentation
Merge clusters based on visual similarity, weighted by time distance
![Page 6: RS at Event Synchronization Task](https://reader036.vdocuments.net/reader036/viewer/2022062515/55c1f722bb61eb026d8b4729/html5/thumbnails/6.jpg)
6Results: Offsets
![Page 7: RS at Event Synchronization Task](https://reader036.vdocuments.net/reader036/viewer/2022062515/55c1f722bb61eb026d8b4729/html5/thumbnails/7.jpg)
7Results: Clustering
![Page 8: RS at Event Synchronization Task](https://reader036.vdocuments.net/reader036/viewer/2022062515/55c1f722bb61eb026d8b4729/html5/thumbnails/8.jpg)
8Conclusion
Winter Olympics is more challenging
VLAD useful for events clustering, but not discriminative enough for determining offsets
If galleries are aligned, accuracy is quite high
Clustering often oversegments with our methods – not all measures seem to handle this equally well
Dependency of correct segmentation from correct offsets not well reflected in results
![Page 9: RS at Event Synchronization Task](https://reader036.vdocuments.net/reader036/viewer/2022062515/55c1f722bb61eb026d8b4729/html5/thumbnails/9.jpg)
The research leading to these results has received funding from the European Union's Seventh Framework Programme (FP7/2007-2013) under grant agreement n° 610370, ICoSOLE (Immersive Coverage of Spatially Outspread Live Events“ (http://www.icosole.eu/).
Werner BailerJOANNEUM RESEARCH – DIGITAL
[email protected]://www.joanneum.at/digital