virtual analog environments: exploring lidar data in vr · virtual analog environments: exploring...

1
Virtual Analog Environments: Exploring Lidar Data in VR W. Brent Garry 1 , Troy J. Ames 1 , Matt A. Brandt 1 , Stewy Slocum 2 , Tom G. Grubb 1 , Jen L. Heldmann 3 1 NASA Goddard Space Flight Center, 2 Johns Hopkins University, 3 NASAAmes Research Center INTRODUCTION The goal: The NASA GSFC VR/AR team created the LandscapesVR project for geoscientists to view and analyze LiDAR data of a lava tube in an immersive 3D environment. The problem: Nothing will ever replace field work, but viewing 3D infor- mation on a 2D screen does not always reveal the complexity, scale, and spatial relationships of geologic terrains. Recall of observations from a field site can also become fuzzy over time. The solution: Virtual Reality (VR) allows geoscientists to view data from a boots-on-the-ground perspective, but also manipulate the environment to achieve views unobtainable in the field. The benefit: Geoscientists can revisit remote locations from a first- person perspective, explore sites they may have missed due to time con- straints or bad weather, and collaborate remotely from the office. VR has rapidly become a more accessible, low-cost technology that can now be developed and used by a broader user base. Field Site: Indian Tunnel Lava Tube at Craters of the Moon National Monument in Idaho Data: Pointclouds are from Riegl VZ-400 lidar scans Software: & Hardware: DATA & TOOLS The full pointcloud for the Indian Tunnel lava tube is ~900 million points. Limitations: We could only import a ~22 million points into a single VR scene. This is equivalent to a single lidar scan. Import Text File: Lidar scans were exported as a text file with xyz rgb μ and imported into Unity using a customized script. Viewing Data: Users can view the points as natural (RGB), elevation, and reflectance. We developed a series of preliminary tools to analyze the data. Draw Tool: Freeform line tool to circle or trace features. Ruler Tool: Measure straight line or curved distance. Labels distance. Waypoint Tool: Mark a point of interest. Notes Tool: Write down information for a location Eraser Tool: Deletes lines and waypoints. Cost-effective: Low-cost, unique way to revisit field sites User Controls: Still testing new ways to move through scenes, mark lines and points, and export data and observations. Limitations of VR software: Unity was user friendly, but not able to handle the large amount of point data. OpenSceneGraph Earth can han- dle the large data sets, but we need to develop the geologic tools. RECREATING THE LAVA TUBE IN VR CREATING GEOLOGIC TOOLS FOR VR LESSONS LEARNED FUTURE WORK Import Lidar and DEMs: We plan to import LiDAR data of different vol- canic terrains and forests, plus DEMs created from UAV flights. New VR Geologic Tools: We plan to expand the capabilities of the VR toolkit with notes, mapping tools, and traverse lines. Planetary landscapes in VR: We are importing mission data from LRO and HiRISE to recreate Lunar and Martian terrains. Lidar of trees UAV Photogrammetry Develop new tools Apollo landing sites View of a single LiDAR scan (~22 million points) as natural (RGB) View of LiDAR data as Reflectance Mark waypoints Measure distances Tools were created to use in the VR environment Add Notes LiDAR inside the lava tube HTC Vive setup VR allows the user to move above, below, and inside the pointcloud Specific locations can be selected for more detailed views View of LiDAR data as elevation

Upload: others

Post on 07-Jun-2020

7 views

Category:

Documents


0 download

TRANSCRIPT

Virtual Analog Environments: Exploring Lidar Data in VRW. Brent Garry1, Troy J. Ames1, Matt A. Brandt1, Stewy Slocum2, Tom G. Grubb1, Jen L. Heldmann3

1NASA Goddard Space Flight Center, 2Johns Hopkins University, 3NASAAmes Research Center

INTRODUCTIONThe goal: The NASA GSFC VR/AR team created the LandscapesVRproject for geoscientists to view and analyze LiDAR data of a lava tube inan immersive 3D environment.

The problem: Nothing will ever replace field work, but viewing 3D infor-mation on a 2D screen does not always reveal the complexity, scale, andspatial relationships of geologic terrains. Recall of observations from afield site can also become fuzzy over time.

The solution: Virtual Reality (VR) allows geoscientists to view data froma boots-on-the-ground perspective, but also manipulate the environmentto achieve views unobtainable in the field.

The benefit: Geoscientists can revisit remote locations from a first-person perspective, explore sites they may have missed due to time con-straints or bad weather, and collaborate remotely from the office.

VR has rapidly become a more accessible, low-cost technology that cannow be developed and used by a broader user base.Field Site: Indian Tunnel Lava Tube at Craters of the Moon NationalMonument in IdahoData: Pointclouds are from Riegl VZ-400 lidar scans

Software: &

Hardware:

DATA & TOOLS

The full pointcloud for the Indian Tunnel lava tube is ~900 million points.Limitations: We could only import a ~22 million points into a single VRscene. This is equivalent to a single lidar scan.

Import Text File: Lidar scans were exported as a text file with xyz rgb µand imported into Unity using a customized script.

Viewing Data: Users can view the points as natural (RGB), elevation, andreflectance.

We developed a series of preliminary tools to analyze the data.Draw Tool: Freeform line tool to circle or trace features.

Ruler Tool: Measure straight line or curved distance. Labels distance.

Waypoint Tool: Mark a point of interest.

Notes Tool: Write down information for a location

Eraser Tool: Deletes lines and waypoints.

Cost-effective: Low-cost, unique way to revisit field sites

User Controls: Still testing new ways to move through scenes, marklines and points, and export data and observations.

Limitations of VR software: Unity was user friendly, but not able tohandle the large amount of point data. OpenSceneGraph Earth can han-dle the large data sets, but we need to develop the geologic tools.

RECREATING THE LAVA TUBE IN VR

CREATING GEOLOGIC TOOLS FOR VR

LESSONS LEARNED

FUTURE WORKImport Lidar and DEMs: We plan to import LiDAR data of different vol-canic terrains and forests, plus DEMs created from UAV flights.New VR Geologic Tools: We plan to expand the capabilities of the VRtoolkit with notes, mapping tools, and traverse lines.Planetary landscapes in VR: We are importing mission data from LROand HiRISE to recreate Lunar and Martian terrains.

Lidar of trees UAV Photogrammetry Develop new tools Apollo landing sites

View of a single LiDAR scan (~22 million points) as natural (RGB) View of LiDAR data as Reflectance

Mark waypointsMeasure distancesTools were created to use in the VR environment

Add Notes

LiDAR inside the lava tube

HTC Vive setup

VR allows the user to move above, below, and inside the pointcloud

Specific locations can be selected for more detailed views

View of LiDAR data as elevation