researching - setup enviroment and sift image

18
MULTI-CAMERA APPLICATION SUCH AS MULTI-FOCUS OR MULTI-CUE FOR CAPTURE IMAGE WEEKLY REPORT: NOV 8 2016 Professor: Pei-Jun Lee Researcher: Bui Trong An

Upload: an-bui-trong

Post on 09-Jan-2017

23 views

Category:

Mobile


0 download

TRANSCRIPT

Page 1: Researching - Setup Enviroment and SIFT Image

MULTI-CAMERA APPLICATION

SUCH AS MULTI-FOCUS OR MULTI-CUE FOR CAPTURE IMAGE

WEEKLY REPORT: NOV 8 2016

Professor: Pei-Jun LeeResearcher: Bui Trong An

Page 2: Researching - Setup Enviroment and SIFT Image

OUTLINE

• Introduce topic• Issue• Progressing• In Progressing• To do

Page 3: Researching - Setup Enviroment and SIFT Image

INTRODUCE RESEARCH TOPIC

Multi-cameras application, such as multi-focus or multi-cue for capture image.

Page 4: Researching - Setup Enviroment and SIFT Image

ISSUE

• The limit of depth-of-focus if optical lenses in Charged Coupled Device (CCD) devices is possible to obtain an image that contains all of the relevant object in focus.

CCDs are sensors used in digital cameras and video cameras to record still and moving images. The CCD captures light and converts it to digital data that is recorded by the camera.

Page 5: Researching - Setup Enviroment and SIFT Image

PROGRESSING Published: Information Fusion · May 2015

Page 6: Researching - Setup Enviroment and SIFT Image

IN PROGRESS

• SIFT algorithm

• OpenCV for Mobile Environment

• Convert Original image to SIFT Image ( Step 1 in Progressing)

• Result ( SIFT Demo)

Page 7: Researching - Setup Enviroment and SIFT Image

SIFT ALGORITHMThere are mainly four steps involved in SIFT algorithm:

* IDEA OF ALGORITHM

1. Scale-space Extrema Detection

2. Keypoint Localization

3. Orientation Assignment

4. Keypoint Descriptor

http://docs.opencv.org/3.1.0/da/df5/tutorial_py_sift_intro.html

Page 8: Researching - Setup Enviroment and SIFT Image

IDEA

Page 9: Researching - Setup Enviroment and SIFT Image

SCALE-SPACE EXTREMA DETECTION

Search over multiple scales and image locations.

Detail: SIFT algorithm uses Difference of Gaussians

Page 10: Researching - Setup Enviroment and SIFT Image

KEYPOINT LOCALIZATION• Fit a model to detrmine location and scale.

• Select keypoints based on a measure of stability.

Page 11: Researching - Setup Enviroment and SIFT Image

ORIENTATION ASSIGNMENT• Compute best orientation(s) for each key point region.

Page 12: Researching - Setup Enviroment and SIFT Image

KEY POINT DESCRIPTION• Use local image gradients at selected scale and rotation to describe each keypoint region.

Page 13: Researching - Setup Enviroment and SIFT Image

OPENCV FOR MOBILE APP (ANDROID)

Page 14: Researching - Setup Enviroment and SIFT Image

FUNCTION CONVERT

Page 15: Researching - Setup Enviroment and SIFT Image

SIFT DEMO

Page 16: Researching - Setup Enviroment and SIFT Image

SIFT DEMO

Page 17: Researching - Setup Enviroment and SIFT Image

TO DO

• RESEARCH P1 AND P2 IN A PROGRESSING

Page 18: Researching - Setup Enviroment and SIFT Image

PROBLEM

• SIFT PUBLISHED MAY 2015

• Robust Multi-Focus Image Fusion Using Multi-Task Sparse Representation and Spatial Context (MAY 2016)

8.0 MP -> 3~5s

20.7 MP -> ~20s