image processing from uas sensor data: prospects and
TRANSCRIPT
![Page 1: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/1.jpg)
Brainlike, Inc. 1
Image Processing from UAS Sensor Data: Prospects and Challenges*
Robert J. (Bob) Jannarone, Gregory Schaefer, and Ciani Sparks, Brainlike, Inc.
Darren Ireland, Kathleen Leonard, and Dale Funk,
LGL Alaska Research Associates
* Some results are based on images that were kindly supplied by Resource Management, LLC and Shell Exploration & Science.
![Page 2: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/2.jpg)
Brainlike, Inc. 2
Presentation Roadmap
1) Wildlife Detection Scenario 2) Added Value Analysis : two examples 3) Operational Prospects 4) Product Operation: a peak under the hood
(time permitting)
![Page 3: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/3.jpg)
Brainlike, Inc. 3
Can you find caribou in this image?
![Page 4: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/4.jpg)
Brainlike, Inc. 4
Can you find them in these “chips?”
![Page 5: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/5.jpg)
Brainlike, Inc. 5
Can you identify them in these chips?
![Page 6: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/6.jpg)
Brainlike, Inc. 6
Caribou Image: detail location
Area of Detail (next slide)
![Page 7: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/7.jpg)
Brainlike, Inc. 7
Caribou Image: detail
![Page 8: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/8.jpg)
Brainlike, Inc. 8
Caribou Detection: “alert map”
![Page 9: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/9.jpg)
Brainlike, Inc. 9
Can you find whales in these images?
A.
B.
C.
![Page 10: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/10.jpg)
Brainlike, Inc. 10
Can you find them in these image chips?
A.
B.
C.
![Page 11: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/11.jpg)
Brainlike, Inc. 11
Can you identify them in these chips?
![Page 12: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/12.jpg)
Brainlike, Inc. 12
Whale Image “Alert Map”
![Page 13: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/13.jpg)
Brainlike, Inc. 13
Independent Validation (LGL et. al: Society for Marine Mammalogy 2015)
“Testing of the detection software occurred on images from surveys that contained tens-of-thousands of images without whales as well as tens of images with whales that had been withheld from the detector development phase. The overall successful detection rate was approximately 70%, with 100% of whales being detected on many surveys. The time required to manually review the automated processing output was less than 2% of the full manual analysis time.
![Page 14: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/14.jpg)
Brainlike, Inc. 14
Presentation Roadmap
1) Wildlife Detection Scenario 2) Added Value Analysis: two examples 3) Operational Prospects 4) Product Operation: a peak under the hood
(time permitting)
![Page 15: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/15.jpg)
Brainlike, Inc. 15
Effort Reduction Example (36 Mpix RGB)
![Page 16: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/16.jpg)
Brainlike, Inc. 16
Continuous Monitoring Example: monetized benefit analysis:
![Page 17: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/17.jpg)
Brainlike, Inc. 17
Monetized Benefit Analysis Detail
Likelihoods
Component Costs
Overall Risk/Utility
![Page 18: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/18.jpg)
Brainlike, Inc. 18
Presentation Roadmap
1) Wildlife Detection Scenario 2) Added Value Analysis: two examples 3) Operational Prospects 4) Product Operation: a peak under the hood
(time permitting)
![Page 19: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/19.jpg)
Brainlike, Inc.
Triage Extended Definition
19
3. (in data processing) The rapid reduction of massive data streams to actionable information.
![Page 20: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/20.jpg)
Brainlike, Inc.
Whale Detection Triage (and beyond)
20
2014 Product: • Locates most targets automatically • Reduces analysis time by over 90% • Processes images in near real-time
2014 Objective: Deliver an automated alternative to manual, post-flight methods for detecting marine mammals from airborne images in a cluttered environment
2015-16 Goals: • General-purpose image–based target detection • Fully automated in-flight/post-flight detection • On-board, real-time processing • Full resolution, real-time “chip” (VGA-sized sub-frame) transmission • Small packet size • Low SWaP profile
Payoffs: • Reduced analyst/operator effort • Real-time, high resolution chip display • Low transmission bandwidth • Low transmission power • High sensor persistence • Low development/integration cost • Big return on investment
![Page 21: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/21.jpg)
Brainlike, Inc. 21
On-Board Triage: UAS “Vision”
21
High Resolution
Sensors
A P I
D
r i v e r
Triage
Processor Low Bandwidth Information
High Bandwidth
Data
Telemetry Control
Sensor Control
![Page 22: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/22.jpg)
Brainlike, Inc. 22
Presentation Roadmap
1) Wildlife Detection Scenario 2) Added Value Analysis: two examples 3) Operational Prospects 4) Product Operation: a peak under the hood
(time permitting)
![Page 23: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/23.jpg)
Brainlike, Inc.
Data Layout
23
![Page 24: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/24.jpg)
Brainlike, Inc.
Shortcut
24
![Page 25: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/25.jpg)
Brainlike, Inc.
Output Structure, 1
25
![Page 26: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/26.jpg)
Brainlike, Inc.
Output Structure, 2
26
![Page 27: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/27.jpg)
Brainlike, Inc.
Bat File Structure
27
![Page 28: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/28.jpg)
Brainlike, Inc.
Whale Templates: two simple examples
28
![Page 29: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/29.jpg)
Brainlike, Inc.
Template Matching: rotation example
29
![Page 30: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/30.jpg)
Brainlike, Inc.
Template Matching: rescaling example
30
![Page 31: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/31.jpg)
Brainlike, Inc. 31
Caribou Template Matching
![Page 32: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/32.jpg)
Brainlike, Inc. 32
Caribou Template Matching
(cont.)
![Page 33: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/33.jpg)
Brainlike, Inc. 33
Presentation Summary
1) Wildlife Detection Scenario 2) Added Value Analysis: two examples 3) Operational Prospects 4) Product Operation: a peak under the hood
(time permitting)
![Page 34: Image Processing from UAS Sensor Data: Prospects and](https://reader031.vdocuments.net/reader031/viewer/2022020917/61be62464362531a8747c8dc/html5/thumbnails/34.jpg)
Brainlike, Inc. 34
Thank you very much for your interest!
Robert J. (Bob) Jannarone [email protected]
(619) 887-1153 (cell)