kenneth melero august, 2001

KENNETH MELEROKENNETH MELEROAUGUST, 2001AUGUST, 2001

What is the ImageLinks Active Archivetm?

ImageLinks Active Archivetm (IAA) is an image management and delivery system.

What is meant by “Image Management”

Management of the data before it is used to create a geo-spatial product. Management of the data after a geo-spatial product is created is “file management” and is NOT done by the IAA.

IAA

DATASOURCES

image managementimage management

A B C

Geo-spatial products

file managementfile management

What is meant by “Delivery System”

Delivery of the data in a form that is usable, a geo-spatial product.

IAA

DELIVERY

DATASETSDATASETS

SWSW HWHW

ImageLinks Active ImageLinks Active ArchiveArchivetm tm

SystemSystem

The IAA provides a turnkey client/server system including hardware, software and data sets on a beowulf cluster.

Why use ImageLinks Active Archivetm?

• IAA allows you to centrally build and deliver geo-spatial products to customers via an Intranet/Internet.

• IAA extends your current systems (Oracle, ArcIMS, etc.) by enabling it to handle large volumes of data.

• IAA makes it possible to combine any number of data sources.

• IAA can be easily scaled to meet your user’s needs.

What is supported?• Arbitrary Area of Interest (AOI) requests to generate geo-

spatial products.• On-the-fly orthorectification of images from raw data source.• Dynamic terrain-correction to base DTED elevation libraries.• Always first generation (single resampling) geo-spatial

products.• Apply ~200 different datums.• Apply a variety of different map projections, state plane

projections, and customer specific projections.• Cross-sensor blending and feathering supported.• Merge multi-sensor data in seamless dynamic mosaics.• etc.

IAA Architecture

The IAA runs in a distributed environment and consists of both client and server components

including hardware and software.

IAA Software Architecture

DBMSDBMS IMAGE PROCESSING ENGINESIMAGE PROCESSING ENGINES

ACTIVE ARCHIVEACTIVE ARCHIVETMTM ENGINE ENGINE

ACTIVE ARCHIVEACTIVE ARCHIVETMTM SERVER SERVER

CUSTOM CUSTOM APPLICATION SOLUTIONSAPPLICATION SOLUTIONS

DISTRIBUTIVEDISTRIBUTIVEAPPLICATION SOLUTIONSAPPLICATION SOLUTIONS

APPLICATION EXTENSIONSAPPLICATION EXTENSIONS(ArcView)(ArcView)

THIRD PARTY THIRD PARTY APPLICATION SOLUTIONSAPPLICATION SOLUTIONS

(ArcIMS)(ArcIMS)

What is it made of?

The software architecture is composed of:

• Image Processing Technology

• Middleware software

• User application solution

What is this Image Processing Technology?

ImageLinks Image Processing Technology is:

• EMET, Enhanced Multi-Image Exploitation Tool

• OSSIM, Open Source Software Image Map

• ImgLnk, ImageLinks Proprietary


BOTTOM TIERBOTTOM TIER

Image processing technology

• The core technology handles large data sets of varying sensor types both raster and vector.

• Each sensor, satellite or aerial, is mathematically modeled to provide the highest degree of accuracy.

• Geo-spatial products can then be:

• reprojected

• resampled

• datum shifted

• fused

• blended

• mosaicked

•tonally balanced

• extracted

• enhanced

• clipped

• overlayed

• etc.

Input/Output vector data formats

• Supported are:– Arc Shapefiles (SHP)– MapInfo (MIF/MID)– AutoCAD (DWG/DXF)– Design Files (DGN)

Input raster data formats• Arc/Info ASCII Grid • Arc/Info Binary Grid • CEOS (Spot for instance) • First Generation USGS DOQ • New Labelled USGS DOQ • Military Elevation Data • Eosat Fast Format • ESRI .hdr Labelled • Envisat Image Product • FITS • Graphics Interchange Format (.gif) • Arc/Info Binary Grid• TIFF / GeoTIFF • Erdas Imagine .hfa • Atlantis HKV Image • Japanese DEM (.mem) • JPEG JFIF • Atlantis MFF • Probe • HyMap

• PCI .aux Labelled • Portable Network Graphics • Netpbm (.ppm,.pgm) • USGS SDTS DEM • SAR CEOS • Arc Digitized Raster (ADRG)• Chip Chunk Format (CCF)• Control Image Base (CIB)• Compressed Arc Digitized Raster (CADRG)• National Imagery Tag Format (NITF)• Landsat TM/ETM+• SPOT 2, 3, 4• IRS-1C/IRS-1D• IKONOS• Radarsat• ADAR 5000• Altaphoto Citipix (ITIFF)

Output raster data formats

• Supported are:– General Raster (bil, bip, bsq interleaves)– SunRaster– MrSid– Chip Chunk Format (CCF)– JPEG with jgw– GeoTiff– Tiff with tfw– 10+ different compressed/uncompressed versions of TIFF

What is the middleware stuff?

The Active Archivetm Engine is formally considered middleware software. It is a “request broker” that translates real-world requests to software requests.


MIDDLE TIERMIDDLE TIER

Active Archivetm Engine

• When a user application solution sends a request to the IAA server, the Active Archivetm Engine processes and responds to that request.

• It also handles load balancing and service management.• Requests to the AA Engine can de done via a standard

http POST request or an XML-formatted request.

User Application Solutions

It is the gateway to the IAA system for a user. The user through a customized application solution can easily request a geo-spatial product without having to be a technical expert.

TOP TIERTOP TIER





(ArcIMS)(ArcIMS)

User Application Solutions

User application solutions can be web-based or a client-side program. It is tailored to the user.



IAA Software Architecture



ACTIVE ARCHIVEACTIVE ARCHIVETMTM SERVER SERVER





(ArcIMS)(ArcIMS)

IAA Hardware Architecture

• ImageLinks Active Archivetm is built on a beowulf cluster hardware architecture.

Beowulf clustering?

• Beowulf clustering refers to the concept of speeding-up the execution of a program by dividing the program into multiple fragments that can execute simultaneously, each on its own processor.

• Thus, a program across N processors might execute N times faster than it would using a single processor.


• ImageLinks beowulf clusters allow for high-volume, high-performance processing of geo-spatial products.

• Depending on the complexity of the data and the requested geo-spatial product, output rates can be as fast as 18-25 mb/min. on a standard IAA system.

• Faster rates can be achieved on scaleable mid-size systems with the addition of beowulf cluster nodes.

• Current benchmarks on systems with up to 48 nodes are resulting in near linear scalability.


• ImageLinks image processing technology is optimized for distributed parallel processing through the use of MPI (Message Passing Interface Standard) and PVM (Pure Virtual Machine).

TILESTILES

NODE 1NODE 1

NODE 2NODE 2

NODE 3NODE 3

NODE 4NODE 4

NODE 5NODE 5

IMAGELINKSIMAGELINKSACTIVE ARCHIVEACTIVE ARCHIVETMTM

DBMSDBMS

GEO-SPATIALGEO-SPATIALPRODUCTPRODUCT

IAA Architecture

• As a result of IAA these hardware and software architectures, IAA systems are highly scaleable.

• Many concurrent users can access your databases and many requests can be processed at one time.

• Plus, over time with growth in demand and processing times the IAA can be expanded.

• Finally because of this scaleable architecture, the IAA is a good choice for small organizations processing a dozen geo-spatial products a day or a large organizations processing thousands of geo-spatial products an hour.

IAA Services: Distributive Querying

• Designated databases residing on each IAA present on a Intranet/Internet will be searched when the user places a request via the application solution.

• Those data sets can then be merged form each IAA to produce a composite geo-spatial product.

A B IMAGELINKS

INTERNET

CLIENT WORKSTATION

IAA Services: Load Balancing

• A customer through an application solution selects a geo-spatial product to produce.

• When the request is sent back to the IAA to process, the system determines if the amount of processing time is reasonable on the current system or if it could be framed out to another designated IAA that would do the processing faster.

• Finally, the process is processed parallel on all nodes in the cluster to rapidly create the composite geo-spatial product.

Third Party Interaction

• Currently, there are 3 mechanisms in which third-party applications, image servers, or other web sites can interact with the ImageLinks Active Archivetm.

Third Party Interaction: First

• In the first mechanism, a third-party application, image server or other web site uses the geo-spatial product to produce yet another third-party product.

IAA

Geoviz Spatial Maps

FTP SITEFTP SITE

downloadeddownloaded

Third Party Interaction: Second

• In the second mechanism, a third-party application pulls the geo-spatial product into an application to produce another third-part product.

IAA

Geoviz Spatial Maps

FTP SITEFTP SITE

pulledpulled

Third Party Interaction: Third

• In the third mechanism, a third-party image server or application can request a geo-spatial product from the IAA to be combined dynamically with its server capabilities in producing a new third party application solution.

ImageLinks ES (Melbourne, FL)

Earth-Info Image Server (Denver, CO)

Earth-Info.org

EDC Image Server (Sioux Falls, ND)

IAA Application Solutions

• A number of different application solutions can connect to and work with the IAA system. Some example application solutions that are currently being used by customers include:– Sample Solution– DRG Solution– OSSIM Solution– Landsat Path/Row Solution– BTG Solution– Earth-Info Distributive Site– PixSell ArcIMS Solution– ArcView extension

Sample Solution

• The sample solution is the default client installed with every installation of the IAA.

• This is meant to give the user an idea of the flexibility and configurability of IAA application solutions.

• It is used as an example or starting point, for the customization of a new application solution tailored to the user.

DRG Solution

• Digital Raster Graphics (DRG) at a variety of scales (1:20K, 1:24K, 1:25K, 1:30K, 1:100K, 1:250K) are used as base maps for image registration.

• This solution provides paperless maps on demand to production personnel for use in autonomous image registration in two formats & b/w or RGB color.

OSSIM Solution

• The OSSIM Solution provides methods to create fast and accurate Image Maps from satellite or aerial imagery and digitized maps.

• This application solution is targeted to the government for using National Technical Means (NTM) data such as ADRG, CADRG, CIB and NITF.

Landsat Path/Row Solution

• The Landsat Path/Row solution is a derived solution from the DRG solution.

• It extends the functionality of that solution to be used in conjunction with Landsat TM/ETM footprints.

• This facilitates selecting DRGs for to use as base maps.

ADS Solution

• The ADS Solution is an all-inclusive aerial-management system built for the Airborne Data Systems (ADS) camera.

• This solution allows for interactive QC/QA of error correction and output options for seamless tonally-balanced mosaics of ADS aerial imagery.

Earth-Info Distributive Site

• Earth-info.org is dedicated to giving access to information about commercially available imagery to the public.

• This applications solution, hosted in Denver, CO, is able to query the IAA in Melbourne, FL and in turn pull the browse imagery from EDC in Sioux Falls, SD.

PixSell ArcIMS Solution

• ArcIMS solutions for the IAA are done in conjunction with PixSell, a leader in the customization of Arc products.

• This solution extends the capabilities of ArcIMS systems to be able to serve dynamically value-added products from raw data sources.

ArcView extension

• Application solutions for the IAA don’t have to be web-based.

• They can also be a client-side program or an extension to an application.

• This ArcView extension is customizable to any IAA application solution.

Custom application solutions

• It is easy to add a custom solution to the IAA server. The only major requirements is that the custom client be able to query the DBMS and post requests are via http or XML formatted.

Summary

• ImageLinks Active Archivetm (IAA) is an image management and delivery system that takes disparate data sources and combines them into a usable form.

Summary


RASTERRASTER

Summary


RASTERRASTER

VECTORVECTOR

Summary


RASTERRASTER

VECTORVECTOR

TABULARTABULAR

Summary


GEO-SPATIAL GEO-SPATIAL PRODUCTPRODUCTRASTERRASTER

VECTORVECTOR

TABULARTABULAR


kenneth melero august, 2001

Documents

number of data

image managementmanagement

raw data source

merge multisensor data

iaa software architecturewhat

architecturethe iaa

deliverythe iaa

state plane projections