exploring the synergies between ‘commercial’ and open source software gregg petrie, cosmic...
TRANSCRIPT
![Page 1: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/1.jpg)
Exploring the Synergies between ‘Commercial’ and Open Source
Software
Gregg Petrie, Cosmic Project
Lee Miller, Pacific Northwest National Laboratory
![Page 2: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/2.jpg)
Outline
• Introduction
• Study Approach
• Specific Examples
• Conclusions
• Action Items
• Questions
![Page 3: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/3.jpg)
Introduction : Disclaimer• Represent Users-Hyperspectral Remote Sensing
NOT claiming to be an expert hacker
![Page 4: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/4.jpg)
Introduction : Motivation
Current Impression
Current Hope: The Whole > Parts
![Page 5: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/5.jpg)
Introduction : Goals
• Identify, develop, test, refine, and demonstrate synergies using real world examples
• Demonstrate how open source community can support users of commercial software
• Promote the support of open source by commercial vendors
![Page 6: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/6.jpg)
Introduction : More Information
COSMICPROJECT.ORG
![Page 7: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/7.jpg)
Outline
• Introduction
• Study Approach
• Give Some Concrete Examples
• Conclusions
• Action Items
• Questions
![Page 8: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/8.jpg)
Approach
• Survey of Open Source Possibilities
• Create and Experiment With a Loosely Coupled Environment
• Create and Experiment With a Tightly Create and Experiment With a Tightly Coupled EnvironmentCoupled Environment
![Page 9: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/9.jpg)
Approach: Survey
• 238 Open Source Geospatial Packages
• 24 Scientific Open Source Python Packages
![Page 10: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/10.jpg)
Approach-Survey Observations : Python
• Provide access to a wide range of additional tools
• High level structures promote rapid prototyping
• Self Documenting• Builds on the Python/ESRI Experience• Widely used to glue capabilities together• Well supported (e.g. .NET)• Python supports both UNIX and WINDOWS • Use of Python growing in the scientific world
![Page 11: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/11.jpg)
Approach-Survey Observations : Python Issues
•SPEED .NET
Moore's Law
More C code
![Page 12: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/12.jpg)
Approach-Loosely Coupled Environment: Dealing with the ‘Tower of Babel’ file format problem
GDAL
Vendor DLL
Write your own
![Page 13: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/13.jpg)
Loosely Coupled Environment: Actual Solution for the ‘Tower of Babel’ file format problem
TIFF files•Flexible
•Supported by many commercial packages
•Stable
•Dealing with large file sizes
•Well Known
![Page 14: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/14.jpg)
Tiff Flexibility :Two Edged Sword
![Page 15: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/15.jpg)
Outline
• Introduction
• Study Approach
• Specific Examples
• Conclusions
• Action Items
• Questions
![Page 16: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/16.jpg)
Examples: Leica Imagine
Imagine provides ‘standard’
remotes sensing tools that include:
Registration
File creation
Display
Registration
Classification
File import/export
Python tools Interface to Windows/UNIX AIP
AI tools
Easy access to FORTRAN and C software packages
Quick GUI development tools
Access to .NET
SciPy toolkit
WEB tools
SDC Morphology toolbox
‘Twisted’ for event-driven networking
CGAL for computational geometry
IDL like capabilities to write advanced Hyperspectral
analysis tools
COSMIC
Photoshop for presentation graphics
Python
![Page 17: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/17.jpg)
Example: Imagine
![Page 18: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/18.jpg)
Example: Imagine
Advantage
Essentials
Professional
Cost
Cap
abili
ties
![Page 19: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/19.jpg)
Example 1: Web Mapping
![Page 20: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/20.jpg)
Examples: Web Mapping
![Page 21: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/21.jpg)
Step 1: Trail Extraction
![Page 22: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/22.jpg)
Step 2: Annotation of Nodes
•Used Open Source to translate to ASCII files
•Used Python to add USGS elevation data to nodes and calculate distance
•Used the Open Source PIL software to create gif file
![Page 23: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/23.jpg)
Example 2: Color Compression
![Page 24: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/24.jpg)
Example 2: Imagine Approach
![Page 25: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/25.jpg)
Example 2: Combined Approach
For each class find the average color and update the LUT
![Page 26: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/26.jpg)
Example 2: Results Top Half=RGB image
Lower Left= Unsupervised color
Lower Right =Imagine color
Menu Maze Problem
![Page 27: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/27.jpg)
Example 2: Real Usefulness
Image source:http://www.csr.utexas.edu/projects/rs/hrs/hyper.html
Pick the 3 best BANDS for each land cover
![Page 28: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/28.jpg)
Outline
• Introduction
• Study Approach
• Specific Examples
• Conclusions
• Action Items
• Questions
![Page 29: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/29.jpg)
Conclusions
Advantage
Essentials
Professional
Cost
Cap
abili
ties
Whole > Sum of the Parts
0 Cost
Open Source
![Page 30: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/30.jpg)
Conclusions: NumPy and Python can be used to “glue” software
And now for something completely different...
+
![Page 31: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/31.jpg)
Conclusions: Tiff files, with a ‘little’ improvement’ can greatly mitigate
the ‘Tower of Babel’ file format problem
![Page 32: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/32.jpg)
Advantage
Cost
Professional
Conclusions: Vendor Specific
Essentials
Cap
abili
ties
Commercial Advantages
Know QA factors
Good documentation
Not all users programmers
Can be faster
Can be cheaper
Can by bureaucratically compatible
Open Source
![Page 33: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/33.jpg)
Conclusions: Vendor Specific
• Empower Users• Help current developers reduce both prototyping
costs and time to market• Increase the rate at which new ideas· developed
by users could be prototyped, tested and moved into ‘native’ proprietary commercial tool kit
• Provides an alternative to the Menu Maze• Build on the Python/ARC ESRI Experience• New pathway for new users
![Page 34: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/34.jpg)
Outline
• Introduction
• Study Approach
• Specific Examples
• Conclusions
• Action Items
• Questions
![Page 35: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/35.jpg)
Action Items For Vendors
• Continue Support BigTiff• Work together to establish Tiff conventions for
hyperspectral data sets• Build on the ESRI/Python Model• Support a Tightly Coupled Environment
![Page 36: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/36.jpg)
Action Items For Open Source
• Support BigTiff• Work together to establish Tiff conventions for
hyperspectral data sets• Move toward tightly coupling commercial and open
source data• Improve Documentation for GeoTiff data• Couple systems (e.g. GRASS) to Commercial packages
![Page 37: Exploring the Synergies between ‘Commercial’ and Open Source Software Gregg Petrie, Cosmic Project Lee Miller, Pacific Northwest National Laboratory](https://reader030.vdocuments.net/reader030/viewer/2022032709/56649ea35503460f94ba6f66/html5/thumbnails/37.jpg)
Questions