Information Visualization ToolkitsInformation Visualization ToolkitsIV2004 – Austin, TXIV2004 – Austin, TX

Steve SmithSteve Smith

Decision ApplicationsDecision Applications

Visualization DimensionsVisualization Dimensions

Visualization DisciplinesVisualization Disciplines

Three(+) dimensions of visualizationThree(+) dimensions of visualization Scientific/EngineeringScientific/Engineering GeoSpatialGeoSpatial Abstract InformationAbstract Information

Key disciplinesKey disciplines Computer skillsComputer skills GeoSpatial/cartographic skillsGeoSpatial/cartographic skills MathematicsMathematics Computer systems and programmingComputer systems and programming User interface development (GUI)User interface development (GUI) Perceptual and cognitive sciencePerceptual and cognitive science Computer graphics skillsComputer graphics skills

Visualization DisciplinesVisualization Disciplines(continued)(continued)

Key Development AreasKey Development Areas GUI developmentGUI development Cross-platform/language/tool integrationCross-platform/language/tool integration Data model abstractionData model abstraction Distributed computing/information modelsDistributed computing/information models

Key Research AreasKey Research Areas ReificationReification ImmersionImmersion PerceptualizationPerceptualization GPU computationGPU computation

Scientific/Engineering VisualizationScientific/Engineering Visualization

Temporal and Spatial registrationTemporal and Spatial registration What: Physical quantities (e.g., Fluid dynamics, What: Physical quantities (e.g., Fluid dynamics,

Radiation Transport, CAD, etc)Radiation Transport, CAD, etc) Who:Who:

Core team background (D-4)Core team background (D-4) Collaboration with CCN-8/CCS-1/EES Visualization TeamsCollaboration with CCN-8/CCS-1/EES Visualization Teams

How:How: Commercial (CEI, IBM DX, PVM, AVS,ProE …)Commercial (CEI, IBM DX, PVM, AVS,ProE …) Code development (OpenGL, X, Java, Java3D)Code development (OpenGL, X, Java, Java3D) Public domain toolkits (VTK, VisAD, etc.)Public domain toolkits (VTK, VisAD, etc.)

Scientific VisualizationScientific Visualization

GeoSpatial VisualizationGeoSpatial Visualization

Geographic RegistrationGeographic Registration What: Physical and Demographic QuantitiesWhat: Physical and Demographic Quantities

e.g. GIS, Mapping, Population at Risk, etce.g. GIS, Mapping, Population at Risk, etc Who:Who:

Core team competencyCore team competency Collaboration with EES GIS LaboratoryCollaboration with EES GIS Laboratory

How:How: Commercial (ESRI/Arc, etc)Commercial (ESRI/Arc, etc) Code development (OpenGL, X, Java, Java3D)Code development (OpenGL, X, Java, Java3D) Public domain toolkits (OpenMap)Public domain toolkits (OpenMap)

Geospatial VisualizationGeospatial Visualization

National Impacts

Information VisualizationInformation Visualization

Logical layout (topological, geometrical, Logical layout (topological, geometrical, metaphorical)metaphorical)

What: Abstract quantities and qualities, high dimensional, What: Abstract quantities and qualities, high dimensional, complex. (e.g. Statistical Graphics, Graphs and Networks, complex. (e.g. Statistical Graphics, Graphs and Networks, Semantic Maps, Visual Data Mining …) Relatively new field. Semantic Maps, Visual Data Mining …) Relatively new field. Roots in cartography/charting.Roots in cartography/charting.

Who:Who: Core team competencyCore team competency Collaboration with Collaboration with UNM, GMU, UC Davis, LBNL, IEEE UNM, GMU, UC Davis, LBNL, IEEE

Information Visualization community, PNNL (Starlight, et Information Visualization community, PNNL (Starlight, et cetera)cetera)

How:How: Commercial tools very limited but growing(e.g., S+, Starlight, Commercial tools very limited but growing(e.g., S+, Starlight,

Lucent,)Lucent,) Code development (Code development (Java3D, OpenGL, Flatland, et ceteraJava3D, OpenGL, Flatland, et cetera)) Public domain toolkits (e.g., Gobi, Root, R, others?)Public domain toolkits (e.g., Gobi, Root, R, others?)

Information VisualizationInformation Visualization

Other Related areasOther Related areas

What:What: Training (Mission rehearsal, Gaming,Cinema, Interactive Training (Mission rehearsal, Gaming,Cinema, Interactive

Storytelling)Storytelling) Analysis (Animation, Visual Data Mining, etc.)Analysis (Animation, Visual Data Mining, etc.) Design (Sensor Network Design, Facilities design, CAD, Design (Sensor Network Design, Facilities design, CAD,

Industrial Design, Architectural, etc.)Industrial Design, Architectural, etc.) Who:Who:

Core Team CompetencyCore Team Competency Collaboration with IM, N-4, UNM, Collaboration with IM, N-4, UNM, USC Cinema and TV (Scott USC Cinema and TV (Scott

Fisher) Naval Postgraduate School (Mike Zyda), ESA (Mark Knight)Fisher) Naval Postgraduate School (Mike Zyda), ESA (Mark Knight) How:How:

Customized combinations of COTS, Open Source, and custom Customized combinations of COTS, Open Source, and custom codingcoding

Projects (just a few)Projects (just a few)

Network Infrastructure Simulation and Analysis Center (NISAC)Network Infrastructure Simulation and Analysis Center (NISAC) Dispersion Modeling (Chemical, Biological, Pollution, etc.)Dispersion Modeling (Chemical, Biological, Pollution, etc.) Maritime ( Worldwide Container shipping)Maritime ( Worldwide Container shipping) Second Line of Defense (borders and crosings)Second Line of Defense (borders and crosings) ASCI Supercomputer ModelingASCI Supercomputer Modeling NNSA Network Intrusion DetectionNNSA Network Intrusion Detection Urban Infrastructure Suite (Epi, AdHop, TransSims etc.)Urban Infrastructure Suite (Epi, AdHop, TransSims etc.) Scenario Visualizer, IEISS VisualizerScenario Visualizer, IEISS Visualizer LDRD (proposals) LDRD (proposals) Cognition Enhancement for Decision Cognition Enhancement for Decision

Support:Support: Immersive Perceptualization & GPU programming for Immersive Perceptualization & GPU programming for high performance and non-standard computation.high performance and non-standard computation.

……

Visualization Strategy (UI)Visualization Strategy (UI)

User InterfaceUser Interface Command LineCommand Line Textual/Tabular FormsTextual/Tabular Forms Web (CGI, JavaScript, etc)Web (CGI, JavaScript, etc)

Graphical User InterfaceGraphical User Interface Java SwingJava Swing X/MotifX/Motif Tcl/TK, GTK, etc (portable UI toolkits)Tcl/TK, GTK, etc (portable UI toolkits) VB/A (ArcGIS, Access, etc)VB/A (ArcGIS, Access, etc) MatLab, etc.MatLab, etc.

Immersive UIImmersive UI Hand, Head, Body TrackingHand, Head, Body Tracking Keyboard/mouse proxyKeyboard/mouse proxy Pointing devicePointing device Object SelectionObject Selection Gesture recognitionGesture recognition Utterance recognitionUtterance recognition

Visualization Strategy (UI continued)Visualization Strategy (UI continued)

Model-View-Controller (Design Pattern)Model-View-Controller (Design Pattern) Distributed (client server-ish model)Distributed (client server-ish model)

.NET/COM (Windows) .NET/COM (Windows) Sockets/RPCSockets/RPC Java Spaces/SOAP/WSDLJava Spaces/SOAP/WSDL Shared Files/DBShared Files/DB

Visualization Strategy (GIS)Visualization Strategy (GIS)

ESRIESRI ArcMap, ArcView, Arc3D, etcArcMap, ArcView, Arc3D, etc VB/A scripting of UI, functions, pluginsVB/A scripting of UI, functions, plugins Execute non-native codeExecute non-native code

OpenMap/OpenGISOpenMap/OpenGIS Web Data ProductsWeb Data Products ??????

Visualization Strategy Visualization Strategy (1(1stst Person/Training) Person/Training)

UnReal Game Engine UnReal Game Engine Level editingLevel editing 3D Modeling3D Modeling Skins/Textures/MaterialsSkins/Textures/Materials Module (dynamically loaded code) developmentModule (dynamically loaded code) development KinematicsKinematics

FlatlandFlatland 3D development in OpenGL 3D development in OpenGL Flux/Reifier/EloomFlux/Reifier/Eloom Object/Level/Texture Import Object/Level/Texture Import AnimationAnimation LocomotionLocomotion Interaction (explicit/implicit, beam, proximity,etc)Interaction (explicit/implicit, beam, proximity,etc)

Visualization Strategy Visualization Strategy (Scientific/Engineering)(Scientific/Engineering)

Partner with CCS/CCN/EESPartner with CCS/CCN/EES Parallel VTKParallel VTK Volume RenderingVolume Rendering VisAD (Java)VisAD (Java) Integration with FlatlandIntegration with Flatland MatLabMatLab CEI EnsightCEI Ensight ProEngineerProEngineer

Visualization Strategy (Information)Visualization Strategy (Information)

Public domainPublic domain Gobi, ATT, Walrus, etcGobi, ATT, Walrus, etc

CommercialCommercial S+, Mathematica, etcS+, Mathematica, etc

In House developmentIn House development Value-added strategy with “conventional” toolsValue-added strategy with “conventional” tools Flatland/Immersive developmentFlatland/Immersive development

Visualization Strategy Visualization Strategy (Monolithic Example)(Monolithic Example)

Simulation Loop

ScenarioReader

ConfigurationReader

ScenarioReader

Scenario/Data

Reader

Diagnostic

Outputs

modulemod

ulemodulemod

ule

modulemod

ulemodulemod

ule

Command line parser

Data File

Data Base

ImageTab

le

Menu/Button/Slider/Text Box

GUI

Single Process, Monolithic Conventional

PlotOutputsPlotOutputsImageOutputsTabularOutputs

Plot

Information Toolkit Summary Information Toolkit Summary (LANL (LANL focus)focus)

ScalabilityScalability HeterogeneityHeterogeneity

Application DomainsApplication Domains Data SourcesData Sources Representational IdiomsRepresentational Idioms Customer TypesCustomer Types

PerceptualizationPerceptualization Full SensoriumFull Sensorium ImmersionImmersion Metaphor ComplexesMetaphor Complexes

InteroperabilityInteroperability NVACNVAC IEEE IV communityIEEE IV community

Streaming DataStreaming Data Immersive UIImmersive UI Graph (multi-hyper, Graph (multi-hyper,

etc)etc) Metaphor mappingMetaphor mapping Explicit/Implicit Explicit/Implicit

Spatial/TopologicalSpatial/Topological High dimensional High dimensional

ProjectionProjection ““Logical” ProjectionLogical” Projection InfoVolumesInfoVolumes

Visualization Visualization (Advanced Development/Research)(Advanced Development/Research)

ReificationReification Figurative Representation (metaphor,etc)Figurative Representation (metaphor,etc) ImmersionImmersion Gesture/Utterance RecognitionGesture/Utterance Recognition Sound, etcSound, etc TrackingTracking Ubiquitous Projection/IntegrationUbiquitous Projection/Integration GPU programmingGPU programming Non Standard ComputationNon Standard Computation