dash - from ott to vr · streamed vs download: compromise – speed, volume vs image quality new...

24
DASH - From OTT to VR VR and 360: The Broadcaster’s Perspective Richard Mills Technical Director, Sky VR Studios

Upload: others

Post on 25-Jun-2020

2 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

DASH - From OTT to VR

VR and 360:

The Broadcaster’s Perspective

Richard Mills

Technical Director, Sky VR Studios

Page 2: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

April 2016: Sky VR announced

October 2016: App launched

Phase 1: 360 Video immersive content

Phase 2: Interactive, and Room-Scale experiences

Sky VR Timeline

Page 3: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Sky VR aims

•Produce content In-house

•Commission Content

•Aggregate 3rd Party Content

Sky VR Timeline

Page 4: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

1 - Planning and Shooting for VR

2 - Design and implementation of a VR App

3 – 360/VR within a Broadcast infrastructure

Sky VR

Page 5: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Sky VR Content Creation aims:

•Native 360 Shooting

•Hybrid 360 plus CGI

•Pure CGI

•Volumetric Asset creation and integration

1 - Production - Planning and Shooting

Page 6: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Sky Sports – Closer

David Beckham – Sky Ambassador

Showcase Sky Sports’ new season

Hi-tech virtual environment

Fresh, exciting look

Compelling action

Production - Planning and Shooting

Page 7: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

David Beckham in Virtual hub – with “Micro-worlds” Live action 360 content combined with Studio Shoot

Sky Sports – Closer: The concept

Production - Planning and Shooting

Page 8: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server
Page 9: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Production - Planning and Shooting

Sky Sports – Closer: The Shoot

Page 10: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

360 Content insertion techniques

Pre-shot content – Match action

Williams: F1

Football: Final

Boxing: Anthony Joshua

Post-shot content–Direct the shoot

Cricket: Lords Test

Golf: British Open

Production - Planning and Shooting

Page 11: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Alternative Shooting Techniques for VR

Giselle VR

3D 360

Nodal spherical arc

Freehand Camera moves

MoCo Background

Page 12: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

2 – Design and implementation of a VR App

VR App – Platform Aims

Mobile Phone, Cardboard and Tablet

GearVR Store

HTC Vive

Facebook

YouTube

Page 13: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

VR App Content Aims

5 Sky UK Genres:

Sport

Arts

News

Entertainment

Sky Cinema

Page 14: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

VR App – Design Specification

Ease of Use – Brilliantly simple

UI designed to be intuitive

High quality content

Reliability of playback

Mobile, Tablet, Cardboard

Download or Streamed Content

Page 15: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Rushes Back up

Join FAT subclips

Rough Stitch

Offline Online/Fine Stitch

Delivery encoding

VR Post Production – an overview

Page 16: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

3 - 360/VR pipelines in a Broadcast environment

Commissioning or Aquisition of 3rd party Content

Content Guidelines

Compliance

Master programme file delivery

QC Delivery encoding QA

Comfort/Age Rating

Delivery Specification

Page 17: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

360/Video Technical Specification

Content Creation Guidelines – Motion, Orientation, Comfort

Content Technical Spec for Master file – Sky final encode

4096 x 2048 , 10-bit, 4:2:2 colour, Progressive 25 to 120fps

MXF, IMF, DnxHR HQ, ProRes 422 HQ

Audio: Preferably Spatial WXYZ, or 5.1, or Stereo

Page 18: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Streamed vs download: compromise – Speed, Volume vs image quality

New approach: Field-of-view Adaptive delivery

• Content is resident on Cloud server

• “Viewport” is delivered in Dynamic Adaptive bitrate Streaming

• Low latency essential (user disorientation): 50 – 100ms max

• 4-15Mb/s with this service is equivalent to 10-60Mb/s of whole scene

content

Next Steps: Tiled FOV Delivery via DASH

Page 19: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Next Steps: Tiled FOV Delivery via DASH

Page 20: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Next Steps: Tiled FOV Delivery via DASH

Page 21: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Next Steps: Tiled FOV Delivery via DASH

Cube Projection

Page 22: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Next Steps: Tiled FOV Delivery via DASH

Tile subdivision

Page 23: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

Next Steps: Tiled FOV Delivery via DASH

Page 24: DASH - From OTT to VR · Streamed vs download: compromise – Speed, Volume vs image quality New approach: Field-of-view Adaptive delivery • Content is resident on Cloud server

DASH - From OTT to VR

VR and 360:

The Broadcaster’s Perspective

Richard Mills

Technical Director, Sky VR Studios