ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 1
ORFEO Methodology
Status & Future work
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 2
Contents
�OTB
�R&D Studies
�ORFEO data base setting up
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 3
OTB
OTB
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 4
Orfeo Toolbox
• Goals : make easier the development of new algorith ms, their validation
and capitalisation, fill the gap between researcher s and ORFEO users.
• CNES is responsible for design and specification.
• Open source software for Image Processing labs, use rs and the industry.
• Contractor : Communications et Systèmes, CS
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 5
Orfeo Toolbox
• C++ library based on existing developments
���
������
���� �������
Developpers
���������
Users�������������
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 6
External Libraries
������������� �������� ����� ��
������� �������
�� ������������ ������� ���������� ��� ��
�����������!�"�������
�#������$��
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 7
Orfeo Toolbox
• Library (Phase 1)– IO
– Visualisation
– Features, descriptors
– Change detection
– Supervised learning
• Utilities (Phase 1) – Quick look
– ROI extraction
– Meta-data access
– Pseudo-ortho-rectif
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 8
Orfeo Toolbox : Roadmap
�Version 1 (2006):
� core of the system,
� IO,
� basic filtering, segmentation and classification,
� basic feature extraction,
� basic change detection.
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 9
Orfeo Toolbox : Roadmap
�Version 2 (2007):
� geometric corrections,
� radiometric corrections,
� registration.
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 10
Orfeo Toolbox : Roadmap
�Version 3 (2008):
� multi-scale and multi-resolution analysis,
� object detection and recognition,
� supervised learning.
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 11
Orfeo Toolbox : Roadmap
�Version 4 (2009):
� data fusion,
� spatial reasoning.
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 12
Examples of functionnalities
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 13
Supervised classification
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 14
Markov random fields segmentation
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 15
Line detection on SAR images
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 16
Perceptual alignment detection
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 17
Anti-speckle filtering
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 18
Salient point detection
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 19
Object segmentation
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 20
Change detection
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 21
Original Blurring Edge preserving
Denoising
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 22
Watershed segmentation
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 23
Vehicle detection
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 24
Object detection
Reference
Scene image
•Similarity measure•Rotation•Scale
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 25
Object detection (2)
Correlation matching
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 26
Object detection (3)
Segmentation using the seeds from object matching
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 27
Circle extraction
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 28
Other functionnalities and features
�Generic I/O
�Streaming, threading
�Synchronized pipeline (processing on demand)
�Type genericity (int, float, double, complex)
�Multi-platform
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 29
OTB Users
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 30
OTB Users
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 31
OTB Users
�100+ downloads since June 2006
�Many methodology developers, some thematic users
� Different needs, different difficulties, different ways of using OTB
�25% from private companies
�47% France, 9% Belgium, 6% USA, 4% China, Spain, Ca nada,
Germany, Portugal, ...
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 32
OTB Users
�Sea & coast: 1. Risk: 2. Carto: 3. Geophys: 3. Hydr o: 2. Forest: 1. Agri:
3. Defence: 4.
�Optical Change Det: 5. Optical/radar fusion: 3. Opt ical registration: 3.
Object recognition: 2. Segmentation (opt. 7; radar 2). Remote sensing
25 (opt. 20; radar 1). Image Processing 39 (opt. 31 ).
�Linux: 35. MVC++: 62.
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 33
OTB: Feedback?
�Bug correction
�Install / use improvements
�Suggestions of functionalities
�How would you like to use it?
� GUI
� Tools for specific applications: ship detection, ro ad extraction, etc.
� Integrated application for building processing chai ns
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 34
R&D Studies
OTB
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 35
Means
�CNES' R&D program
� 2006: 6 contracts
� 2007: 3 contracts
�Grants: PhD, post-doc
�Internal Studies
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 36
CNES' R&D program (ongoing, 492 k€)
�Similarity measures. ENST-B + TeSA. 3 years contrac t (160k€).
�Optical/radar registration for 3D extraction. ENST. 1 year contract (35
k€).
�Active contours for network extraction (roads, hydr o, etc.). INRIA. 3
years contract (96 k€).
�PMP parameter estimation. INRIA. 3 years contract ( 96 k€).
�Gestalts. CMLA. 2 years contract (60 k€).
�3D Change detection. IGN. 1 year contract (45 k€).
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 37
CNES' R&D program (to come, 150 k€)
�Mutistrategy & multi-resolution classification.
�3D extraction & 3D model evaluation.
�Spatial reasoning for object recognition.
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 38
R&D budget synthesis
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 39
CNES' internal studies
�Completed
� Spatial reasoning for object recognition
� Target identification on HR SAR images
� Road extraction
�Carried on in 2007
� Progressive/adaptive image compression
� Image / data base change detection
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 40
ORFEO data base setting up
OTB
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 41
VHR image object data base
�Main goal: methodology development
�List of objects: taken from WG's reports, meant to be balanced
(generic-specific)
� WG's members will be asked for validation
� Interesting object examples may be proposed
�Restricted: optical only, for the thematic test s ites, not all kinds of
objects
ORFEO GT1ORFEO GT1--22--3 meeting 3 meeting –– January18th, 2007 January18th, 2007 –– CNES ParisCNES Paris 42