visualization - eso · 3d visualization june 2008 visualization christopher fluke & david...

22
3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength 3D Perspective

Upload: others

Post on 22-Sep-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Visualization

Christopher Fluke& David Barnes

THINGS datacubes courtesy Erwin De Blok

Gas and Stars in GalaxiesA Multi-Wavelength

3D Perspective

Page 2: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

• Increasingly multi-dimensional (N ≥ 3)– e.g. Spectral data cubes, N-body simulations

• Increasingly multi-wavelength– e.g. THINGS, NUGA, VO

• Include gridded and non-gridded data

• 3D visualization: opportunity to maximize scientific return from data

Astronomy Datasets

Page 3: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Science

DataVisualization

System

Data visualization: planning, data collection,reduction, comprehension, presentation

Page 4: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Science

Data

Visualization System

Publication Presentation Education

Software

Interaction

Display

Graphics hardware

Page 5: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

THINGS datacube; S2PLOT visualization

Moment maps Slices Isosurfaces Volume rendering

How to interpret complex structures?

Page 6: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

CommercialE.g. IDL, AVS/Express, IRIS Explorer

– Lots of functionality vs. costly licenses?

Open SourceE.g. Paraview, VisIt, Drishti

– Lots of functionality, free vs. not designed for astronomy tasks?

3D Slicer

Osirix

Astronomical Medicine Project (e.g. Borkin et al. 2007, AAS)

Page 7: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Custom CodeVTK, OpenGL, PGPLOT, S2PLOT

– Do anything you want!– Need to write your own software

Astronomy packagesE3D, QFITSView, VisIVO, Karma, Gaia, TIPSY, SPLASH, ...

– Do one job and do it well– Flexibility? Platforms supported? Display types supported?

E3DQFITSView

VisIVO Splash

Page 8: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Floating-Point Operations per Second for the CPU and GPUNVIDIA CUDA Programming Guide V1.0 (2007)

Graphics Processing Units (GPUs)

Motivated by games industry = $$$• Character detail = isosurface• Fog + fire + smoke = volume rendering

Page 9: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

• Parallel stream processor• Fills pixels in parallel• Great for rendering large datasets• Programmable (e.g. CUDA “C-Programming”)

Gra

ph

ics

Me

mo

ry

i =1

i =128

i =1

i =128 Ma

in M

em

ory

GPU

Ma

in M

em

ory

Gra

ph

ics

Me

mo

ry

Page 10: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Real-time 3D texture volume rendering

NVIDIA GeForce 9600 GT

GPU Memory: 1 GB512 px x 512 px texture = 1 MB/texture512 textures = 512 MB

Memory bandwidth: 60 GB/secReal-time stereo: 25 fps * 2 eyes = 50 fpsMbw = 1 MB/texture * 512 textures * 50 fps = 26 GB/s

Pixel fill rate: 20 Gpix/secRpix = 50 fps * 5122 pixels * 512 textures = 6.4 Gpix/s

Page 11: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Nyland et al. 2008, GPU Gems 3, NVIDIA– 16,384 particles on NVIDIA GeForce 8800 GTX GPU– Sustained performance of 200 gigaflops

Real-time N-body + visualization

See also:• Hamada & Itaka, 2007, arXiv:astro-ph/0703100• Portegies Zwart et al. 2007, NA, 12, 641

Page 12: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

I can’t see (3D) without my glasses

Left Eye Right Eye

Anaglyph

See Fluke et al. (2006)

Page 13: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

I can’t see (3D) without my glasses

Left Eye Right Eye Passive polarizing glassesCrossed Filters

Polarising Filters

Page 14: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

I can’t see (3D) without my glasses

Left Eye Right Eye Infinitec(interference/colour notch filter)

Page 15: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

I can’t see (3D) without my glasses

Left Eye Right Eye

Interleaved

Page 16: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Zalman Trimon 2D/3D Display

A low-cost, easy to use, stereo 3D display

Page 17: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

L R

Autostereoscopic Displays

Lenticular lens screen

LRLRLRLRLRLR

Parallax barrier

LRLRLRLRLRLRLRLRLR

L R

Page 18: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Volumetric displaysActuality Systems Inc.Perspecta

•198 images of768x768 pixels

•~100 million voxels• 80,000 Euro!

•Other systems:•Felix 3D•Genex

Page 19: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Nintendo Wii Remote• 3-Axis accelerometer • IR Video camera

• Roll, pitch, yaw. • Additional IR sensors

• X,Y,Z relative positions

3DconnexionSpace Navigator

“optimize your productivity by 30%”

Gesture recognition?

Page 20: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Digital PublishingEarly 90s• ApJ publishes movies on video tapes• ADS Abstract Service begins• ADS provides scanned articles

Late 90s• Portable Document Format (PDF)

May 2007• Adobe Acrobat 3D Version 8 … 3D-PDF

3D PDF + JavaScript = Interactive publications• Barnes & Fluke (2008)

Page 21: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

You have been watching...

This presentation was originally given usings2slides built on S2PLOT

http://astronomy.swin.edu.au/s2plot

Integrated 3-d visualization with slides

Same presentation would work in stereo!

Page 22: Visualization - ESO · 3D Visualization June 2008 Visualization Christopher Fluke & David Barnes THINGS datacubes courtesy Erwin De Blok Gas and Stars in Galaxies A Multi-Wavelength

3D Visualization June 2008

Science

Publication Presentation

Data

Visualization System

Education

Now it’syour turn...

Software

Interaction

Display

Graphics hardware