The Challenge of 3 Dimensional Data - Storage, Preservation,

Description, and Access

Dr. Jeremy Rowe

Head, Media Development, Information Technology

Partnership for Research in Stereo Modeling

Arizona State University

Joint Conference on Digital Libraries, Portland, Oregon, July 15, 2002

Partnership for Research In Stereo Modeling (PRISM)

Established in Spring 1996 at Arizona State University to promote interdisciplinary research in 3D Data Acquisition, Visualization & Modeling, and Form Realization.

PRISM includes researchers with a shared interest in visualizing 3D and higher dimensional data. Disciplines include: Anthropology Archaeology Biology Computer Science Educational Technology Fine Arts Industrial Engineering Mechanical Engineering

Data Acquisition

Cyberware Laser Scanner

Also:-Portable Laser Scanners-Confocal Microscope-CAT Scanner-Other Method of 3D Point Cloud Capture

Laser Scanning to Create Point Cloud

Single Scan Multiple Scans Combine to Create Point Cloud Representing the Original Object

Point Cloud Triangular Mesh Surface

Surface Generation from Point CloudAssemble Point Cloud from Multiple Scans (Geomagic)

3D Imaging - Moving Beyond Viewable Images

Extending research capabilities beyond Image-Only 3D display such as QuickTime VR, Rhino, & Maya.

Funding - National Science Foundation Digital Library/Knowledge and Distributed Intelligence

Goals to work with Domain Researchers to Develop Processes to:

•Create A Quantifiable, Measurable Model•Identify and Extract Data•Create Catalog Information•Populated Database

Surface Modeling

Fitting a Modeled, Measurable Surface

Spatial Measures of Similarity

Graphically illustrate symmetry And changes in curvature

Goal - to provide objective measures of objects and component features

Profile Curves

Also: Local Curvature Inflection Points Area Volume Proximity Orientation Etc.

Range of ProjectsDNA in Fertilized Mouse Egg

Through the Cell Biology Pilot project, we applied computer algorithms that enabled us to obtain more information from confocal microscope images.

Range of ProjectsNative American Ceramic Vessels

Digital collections to analyze shape, morphology, manufacturing techniques, improve measurement accuracy, permit objective comparison of objects, document before repatriation.

Bone Surfaces and Forensics

Digital collections to analyze shape, structure, morphology, improve measurement accuracy, permit objective comparison of objects, and to identify unique individuals.

Range of Projects

Range of Projects

Region Identification

Morphology/SymmetryObject Identification

Feature Extraction

Project Process Summary

Project Process SummaryDevelopment of vocabularyDevelopment of XML schema and DTDsCapture/digitizationModeling and data extraction

Volume modeling research Modeling software developmentData extraction

Data storageText and tabular dataBinary geometric/spatial data

Point cloud dataPolygonal meshSurface/volume models

Links to other databases Query and interaction

Vocabulary

3D Class Inheritance 3D Class Inheritance

Class:Object

::Vessel

::JarPlus...Axisbase plane

Diametercircumference

Attributes…Shaperepresentation model# features

::Surface model

Plus...volumesurface area

Plus...Shoulder heightaperture diameter

Each subclass definition inherits generic attributes from its parent class and qualifies them or adds new ones

Addition of 3D Data to Relational Databases

Conventional RelationalDatabase Tables

Tables added to accommodate3D Metadata

RDBMS(Oracle, SQL Server, etc)

AttributeTables

3D Indexes

Existing Data Access Protocols

(ODBC, JDBC,XML)

3D QueryProcessor

Custom 3DData objects

(Surfaces, Volumes)

Database organizationUser Interface applications(Java, Visual Basic, C++)

Text search Spatial Search

Query and InteractionCreating a Digital Library

On Submit Query

Binary and Text search criteria sent

from interface

1st CGI

Generate the contour type and parameterize the text

query

2nd CGI

Curve matching

Database

1st Record set

Pot ids of same contour

1st JSP

Query sent to

Databases

2nd JSP

Query database

2nd Record set

XMLdocument

XSL/HTML display

Initial query interface

Query result with thumbnails Detail display of individual pot

X-Path/ display the selected pot

Examples of Current 3D Data Applications

Environmental dataGISAir QualityWater Quality

Built EnvironmentBuilding Design (CAD/Architecture modeling)Building DocumentationGround Penetrating Radar

Manufactured ObjectsDesign/Production/Quality ControlCatalog/Sale

Medical CAT scansUltrasound

Data ComponentsRaw Data

Textual2D Image/surface3D Spatial N-Dimensional

TimeSensor data

Derived DataModeled DataTechnical Data

File FormatsApplications

Researcher Annotations (to permit reconstruction)“Bookmark” Information Documenting Searches/Interaction

Metadata

• Traditional textual info (Dublin Core, COPARES, etc.)

• Non-static information (audio, video, etc.)

• 2D data (from new and existing sources)

• 3D data (point cloud and modeled)

• Multi-dimensional data (i.e. vector, sensor, time, etc.)

Class based XML Schema

*

Class based XML Schema

*

Class based XML Schema

*

Class based XML Schema

Other Issues•Increasingly complex multi-dimensional data•Development of standards

•File/storage formats•Metadata/Cataloging/Description

•Researcher notations/version documentation•“Bookmarking”/replicability of search results•XML/SOAP search to replace/augment SQL search•Migration•Electronic records management of “Born Digital” data

3DK Project TeamPriti Aggarwal Myungsoo BaeMichael Bailey D. Page BaluchDavid Capco Daniel CollinsGerald Farin Patricia GreenMark Henderson Jiu Xiang HuAdam Huang Graham JonesRaghu Krovvidi Dezhi LiuMary Marzske Peter McCartneyPornchai Mongkolnam Greg NielsonS. Panchanathan Sandeep PullaB. Ramakrishna Anshuman Razdan Jeremy Rowe Utsav Schurmans Arleyn Simon Matt TocheriDavid Van Alfen May Zsu

Contact Information

Partnership for Research in Stereo Modeling (PRISM) at Arizona State Universityhttp://3dk.asu.edu

Dr. Jeremy Rowejeremy.rowe@asu.edu