streaming technologies: under the hood egon verharen innovatie management surfnet bv...
TRANSCRIPT
2
TERENA Networking Conference 2000
Contents
• Digital Video family– Similarities en Differences
• What is streaming and why streaming media?• Technology
– what do you need• formats, standards, server, clients, network
– demo• (forseable) Future• Lessons learned
Content Management
3
TERENA Networking Conference 2000
Pieces of the puzzle• Why digital video in education
Collaborativetools
Conferencingtools
Multimediaarchives
live eventstreaming
webbased virtualclassroom
4
TERENA Networking Conference 2000
Digital Video: Similarities and Differences
Video Conferencing
Video chatLike a telephone callTwo - WayCall up or Answertypical bitrates from56 kb/s - 1,5 mb/sVideo format (H.261, H.263,MPEG)transport protocol (RTP)fast network connectionQoS (min. delay, min. jitter,synchronisation
Video Broadcasting
Streaming/WebcastingLike watching TelevisionOne - WayTune In or enter URLtypical bitrates from28 kb/s - 8 mb/sVideo format (H.261, H.263,MPEG)transport protocol (RTP)fast network connectionQoS (jitter, synchronisation)
-Network video
5
TERENA Networking Conference 2000
What & Why Streaming Media
• “Streaming” is buzz-word. – an adjective
• Many definitions/definotions– Push vs. Pull– Client-oriented vs. server-oriented– on-demand vs. live
• Streaming media: the ‘real-time’ playing of a video-, audio- and/or datastream on a machine from the moment the first bytes come in.
content
ITTelCo
6
TERENA Networking Conference 2000
Streaming: live vs on-demand
archive realtime
unicast
multicast
VoD Event-driven
Event-driven
scheduled
7
TERENA Networking Conference 2000
Why streaming? (download times)
Bandwidth transport time (650 MB)2400 bit/s 631 hrs (26 days and 7 hrs)
9600 bit/s 158 hrs (6 days and 14 hrs)
2,5 Mbit/s 34 min
10 Mbit/s 8 min and 40 sec
34 Mbit/s 2 min and 33 sec
155 Mbit/s 32 sec1 Gbit/s 5 sec
1 Gbit/s = 1.000 Mbit/s = 1.000.000 kbit/s = 1.000.000.000 bit/s
8
TERENA Networking Conference 2000
Streaming media advantages
• data does not need to be downloaded;
• high bitrate make high (video)quality possible;
• you can jump ahead (or back) in stream (‘vcr principle’);
• you can broadcast/netcast live;
• suitable for tele-educatie,
–but also information delivery.
9
TERENA Networking Conference 2000
Digitale Video QoS myth
• NO, you can start now !
• QoS for end-users = bigger picture, better audio.• QoS for network = delay, packet loss, jitter• Requirements differ per application:
– interactivity vs streaming, minimal delay/jitter ?• Quality is function of many parameters
– client, LAN, campus, access links to PoP, within PoP, natl & int.l. networks
“DV cannot be implemented without QoS technology (which is new, complex, expensive and over the horizon)”
10
TERENA Networking Conference 2000
Quotes & Provocations by Dennis Glenn, NWU
• “Tape is dead”
• “Delivery is king”
• “Quality is not important”–quality of video–QoS
• “Exposure is everything” –Content is worth nothing if you don’t show it
11
TERENA Networking Conference 2000
Analog Digital
CostsValue
Digital Content management: driving forces
LARGE archives
Everywhere and always access
Create once, distribute/use many
Save and secure for (re)use
12
TERENA Networking Conference 2000
Developments in the content chain
Programmaker
Internet provider
Websiteowner
Internethost
Channel
Cable-operator Distributer
Telecomoperator
Author
Broadcastorganisation Publisher
Users/Viewer
13
TERENA Networking Conference 2000
Merging of the chains
Contentmanager
Distribution media
A/V/D-material
End-users
Format conversionclassificationlogical ordering
14
TERENA Networking Conference 2000
Video-over-IP value chain
$$$$
Content use
$$
Content deployment(content distribution/content delivery)
Media production
10110111011011
Content management
Encoding
15
TERENA Networking Conference 2000
Workflow TV “broadcast” via internet
• “Dynamic” services example: DelayTV
NED1
Online Encoding
Batching
NOS ADatabaseA
5 min to 3 hrs
Staging
Spotting
Enhancing
InstallatieVideoserver
Online
disk2tape
Validatie
Mass Archive
Export
InstallatieDB/Webserver
30 hrs encoded video plus metadata each day!
By Ton van Mil, director NOB-interactive
Content management cycle
16
TERENA Networking Conference 2000
disk2tape
Workflow TV “broadcast” via internet
• “Dynamic” services example: News
NED1
Online Encoding Installatie
Videoserver
InstallatieDB/Webserver
Online
disk2CD
Batching
Validatie
NOS ProgrammaDatabase
3 hrs
Staging
Spotting
Enhancing
Export
NOS Newsroom
NOB graphics
Mass Archive
Archief
By Ton van Mil, director NOB-interactive
Content management cycle
17
TERENA Networking Conference 2000
VIP platform components
End user
Basicdeployment
AdvanceddeploymentContent
management
BasicContent production
AdvancedContent production
MetadataMPEG7
User metadata provision
Accounting server
Reversed content provision
18
TERENA Networking Conference 2000
Streaming media service
• content creation–producers, editors, encoders
• content mgt–db mgt, META-DATA, indexing&searching
• content delivery–dynamic streaming (more than one bandwidth),
license control, synchr. Multimedia,–scalability (caching & replication)
• content viewing–softw based players, MPEG2 hw based players,
browser plugin and external helper apps.
19
TERENA Networking Conference 2000
Technology
• standards, formats–still new codecs (e.g. MPEG4, IBMs LBR)
• streaming servers and clients• network
20
TERENA Networking Conference 2000
Formats
• Aspects:– Bitrates (constant, variable)– Framesize– QoS
• Bandwidth (at end-user) • dynamic use: Real SureStream, simulcast
• Standards– ISO/IEC (int.l. org for standardization/int.l. electrotechnical commission)
• Moving Pictures Experts Group (ISO/IEC JTC1/SC29/WG11)• MPEG1,2,4,7
– ITU (int.l. telecommunication union)
• Series H (video), Series G (audio) (ITU-T SG16)
21
TERENA Networking Conference 2000
Formats (cont.: MPEG)
• MPEG1 1,5 mb/s; VHS; part3=audio=MP3
• MPEG2 6-8 mb/s; digitale TV
• MPEG4 lower bitrate (better compr.); multimedia appl.layers (transparent info), content protection, QoS
• MPEG7 metadata model ‘on top of’ MPEG1/2/4; searching,filtering, processes
22
TERENA Networking Conference 2000
Formats (cont.: Video en Audio)
• Video– ITU-T Series H - Audiovisual and multimedia systems
– H.261 H.263
– DV (Digital Video)
• Audio– MP3 = MPEG-1 audio layer 3
– Series G - Transmission systems and media, digital systems and networks
– G711, 722, 723.1, 726, 728, 729
23
TERENA Networking Conference 2000
Protocols
• Streaming Media Protocols are protocols that are being used to support the real-time delivery of multimedia data
• TCP vs. UDP• HTTP
–progressive download• RTP
– real time protocol– UDP– payload
24
TERENA Networking Conference 2000
Protocols (cont.: RTSP)
• RTSP– Real Time Streaming Protocol
• designed to be an open standard aims to provide an extensible framework to enable controlled delivery of real-time data, such as audio and video.
• Denk: videocontrole (play, pauze, stop, back, forward)
– http://www.ietf.org/rfc/rfc2326.txt
25
TERENA Networking Conference 2000
Distribution
• Scenario’s– Broadcast vs. Groupcast vs. Personcast (Video-on-
demand)
• Technology– Unicast– Multicast
• cookbook
26
TERENA Networking Conference 2000
What do you need
• Streaming server– on-demand/live; program manager; asset mgt– data pump– encoders (can be separate)
• Streaming client– Fast PC– decoder (up to MPEG1: software, MPEG2 prefer. hardware)– monitor
• Network connection– MPEG-1 (VHS-qual/CD): 2 Mbit/s guaranteed end-to-end
!– UDP/IP– multicast
• Connectivity end-user determintes format (bitrate)
27
TERENA Networking Conference 2000
Streaming servers & Clients• Architectures
– Real
– Windows Media
– Quicktime
• “High-end”– Kasenna Mediabase, Oracle Videoserver
– (not yet) Broadcast servers !
• Others– FVC I-studio, IBM Videocharger, Cisco IP/TV, …
• Clients– almost all dedicated !
– Not (yet) interoperable
28
TERENA Networking Conference 2000
Architectures
• RealMedia– codecs: RealVideo, RealAudio
– streaming formaat: RealVideo, RealAudio, met plugins (bijv. BitCasting) MPEG1, MP3
– SureStream: multiple bitrate encodings, bandwidth negotiation
– RealText, RealPix– SMIL (Synchronized Multimedia
Integration Language)– Standards: RTSP, RTP (RDP)
29
TERENA Networking Conference 2000
Architectures (cont.)
• Apple Quicktime– supports many codecs
• streaming RTP payloads; Sorensen: VBR, CBR
– streaming format: Quicktime (hinted movies)
– plug-in architecture
– tracks & effects & interactivity
– standards: RTSP, RTP
30
TERENA Networking Conference 2000
Architectures (cont.)
• Microsoft Windows Media Technologies
– NetShow, DirectShow/ActiveMovie, Video for Windows
– codecs: Windows Media Audio (WMA), MPEG-4 v3, ACELP (voice)
– streaming format: ASF (advanced streaming format)
– Multi-Datarate Encoding, Intelligent Transmission, Media rights
– standards: ??; WMM– office integration !! (e.g. streaming
powerpoint)– Most ‘compatible’ client (player)
31
TERENA Networking Conference 2000
Codecs
• Codecs– MPEG1, MPEG2, MPEG4– MP3 = MPEG-1 audio layer 3 – Qualcomm PureVoice– Qdesign Music (stereo audio for dialup data rates en fast processor)– a2b (AAC, high fidelity, faster data rates, encryption)– liquid audio (arch., AAC, hifi, encryption, licensing, watermarking)– java based: emblaze, GTS– Sorensen (video, both dialup and cable modem data rates)– Vivo (VIV), Vxtreme (VXF), VDOnet
– http://www.terran.com/CodecCentral/
32
TERENA Networking Conference 2000
Servers• Aspects
– storage– media pump– network (bandwidth)– on-demand vs. live– asset management !
• Examples (not complete !!)– Architectures
• Apple Quicktime, Real G2, Microsoft Windows Media– “high end” IP streamers (live/on-demand)
• Cisco IP/TV, IBM Videocharger, Kasenne Mediabase, Oracle Videoserver
– broadcast servers• Sony,Philips, SUN, ..., AXCENT INSERT
– frameworks• SUN & IBM Java Media Framework
33
TERENA Networking Conference 2000
Servers (cont.: Examples)
– “high end”• FVC.COM I-Studio
• Cisco IP/TV– standards support
• IBM Videocharger– Digital Library; architectuer; interactivity
– standards support
• Kasenna (formerly SGI) Mediabase
• Ncube/Oracle MediaCUBE/Videoserver
• ...
• Frameworks– SUN & IBM Java media framework
– unified architecture for the playback, synchronization, capture, transmission and transcode of media -- including streaming audio and video -- across most major operating systems
34
TERENA Networking Conference 2000
Clients
• Aspects– Buffer– Synchronisation– Multicast
• Examples– FVC.COM I-viewer
– Cisco IP/TV viewer
– IBM Videocharger client
– Apple Quicktime client
– Microsoft Windows Media Player
– Mbone tools
• SDR, Vic, Rat, …
35
TERENA Networking Conference 2000
Figuur 1. Internet- en Video-verkeer op Snelnet
0
500
1000
1500
2000
2500
3000
3500
mrt-98 apr-98 mei-98 jun-98 jul-98 aug-98 sep-98 okt-98 nov-98 dec-98 jan-99 feb-99 mrt-99 apr-99
maand
Gb
yte/
maa
nd
SURFnet ---> Snelnet
NOB ---> Snelnet
SURFnet ---> Universiteit (gem)
What does streaming mean for your network ?
36
TERENA Networking Conference 2000
All problems solved ?
• NO !• Open issues
–standaards• protocol implementations
– RTP, RTSP
– formats• MPEG program/system/transport streams• Metadata
– filesystems–network
• multicast• Quality of Service (QoS)
–content delivery
37
TERENA Networking Conference 2000
Rights issues
• Rights organisations see “On demand” as the highest service level possible and therefore demand high compensation
• Rights organisations (in NL) are nog (yet) qualified for–TV rights–Film–News, Sport
• Models for slice payments are missing
• [YMMV]
38
TERENA Networking Conference 2000
Lessons learned
• Audio and data often more important than Video–scenario dependent
• Image quality and refresh-rate still no problem with Internet users
–compare tv viewers–Connectivity end-user determines format (bitrate)
• Multicast–Commercialisation needed
• Content !–Refresh services
39
TERENA Networking Conference 2000
Streaming services at your screen
• Do not underestimate technology involved– recording, encoding, network, storage, distribution
• Navigation for the end-user is important• Automate the workflow• Know in advance what to do with the material
afterwards–does it stay online, storage, re-distribute
• Don’t forget the rights !• Warning: it is expensive (still)
• Always subcontract large applications/services
40
TERENA Networking Conference 2000
Future• Quality
– MPEG2 (both streaming & conferencing); DV format -> HDTV– QoS/Classes of Service
• Contents– 3D (e.g.. VRML, QuicktimeVR)– Metadata (MPEG7)
• Codecs– fractal; VBR
• Standards– RTP/RTSP, incl. Authenticatie; MPEG4 & MPEG7
• Efficiency– multicast: data too; content delivery (caching & replication)
• New applications– gnutella
• More streaming servers/clients– better access networks– media & asset management
41
TERENA Networking Conference 2000
Come forward: TF-STREAM
• Who has experience ?– which tools, what have you done– plans for content creation, mgt, deployment
• Ideas: how can this (new) technology be put to work in projects
– at your institute– between institutes, organisations, NRNs, ...
• TF-STREAM– http://www.terena.nl/task-forces/tf-stream/– [email protected] ([email protected] subscribe)
42
TERENA Networking Conference 2000
Demo streaming • SURFnet-TV– 1. FVC I-studio– 2. IBM Videocharger– 3. Cisco IP/TV– Real– Quicktime– WindowsMedia
• SNOB/Snelnet– SGI Mediabase– Compcore player
• FUNET-TV• US:
– ICAIR– ResearchChannel– Vanderbilt Univ.
43
TERENA Networking Conference 2000
URLs (background info)
• http://stream.surfnet.nl/• http://contact.surfnet.nl/• http://www.surfnet.nl/diensten/seminars/surfnet-sec/streaming/• http://skin.surfnet.nl/video-audio/index.html• http://www.surfnet.nl/innovatie/surfworks/showcase/• http://www.surfnet.nl/innovatie/surfworks/streaming/surfnettven.html
• http://www.surfnet-tv.nl/• http://dv.internet2.edu/• http://dv.internet2.edu/videospace/index.html
• http://www.researchchannel.com/ • http://www.vide.net/