30
Photogrammetry & Virtual Reality Transporting Real Sites into VR Daniel Sproll @left_big_toe David Finsterwalder @DFinsterwalder

Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

  • Upload
    others

  • View
    7

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Photogrammetry & Virtual RealityTransporting Real Sites into VR

Daniel Sproll@left_big_toe

David Finsterwalder@DFinsterwalder

Page 3: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Photogrammetry

Page 4: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Photo ● gram ● metry

φωτός (photós) = light

γράμμα (grámma) = drawing

μετϱικὴ (metriké) = measurement

Page 5: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting
Page 6: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

History

Almost as old as photography (François Arago 1839)

Mathematical foundation in 1849(Aimé Laussedat)

First full algorithm in 1899(Sebastian Finsterwalder)

Page 7: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

What’s new?

Computer vision for feature detection

Compute Bundle Adjustments fast

Compute Depthmaps fast

Page 8: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

CUDA

SIFTGPU(Feature detection)

Multicore Bundle Adjustment(Bundle Adjustments)

RealityCapture(Depth Reconstruction)

Page 9: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

7.000.000.000.000FLOPS (SP Peak) with a Quadro M6000

(that is over 9000!)

Page 10: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Getting more popular in Realtime 3D

Page 11: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting
Page 12: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting
Page 13: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Virtual Reality

Page 14: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

The Hard Facts

i5 / 4GB / GTX 970

stereo 1080 x 1100

90fps - always

Page 15: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Scenography

Page 16: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Scenography

“...ingenious engineering to create movable sets, or create illusions of environments.”

Antonio Caimi, 1862

Page 17: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Scenographs

Photorealistic

Explorable

Vivid

Page 18: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Photorealistic

High Geometric Resolution

High Texture Resolution

Real Lighting

Page 19: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting
Page 20: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting
Page 21: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Photorealistic

Page 22: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Explorable

Free Spatial Exploration

Embodied Experience

Active User

Page 24: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting
Page 25: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Vivid

Spatial Audio

Dynamic Elements

Realtime Lighting

Page 28: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Vivid

Spatial Audio

Dynamic Elements

Realtime Lighting

Page 29: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Scenographs

Photorealistic

Explorable

Vivid

Page 30: Photogrammetry & Virtual Reality Transporting Real Sites into VRon-demand.gputechconf.com/gtc/2016/presentation/s6677... · 2016-04-10 · Photogrammetry & Virtual Reality Transporting

Scenographs

Photorealistic

Explorable

Vivid