ngi summer project
DESCRIPTION
NGI Summer Project. Streaming Media Extensions to Open Mash and Indiva. Allan Gu. Multicast Backbone (Mbone). Multicast Distribution of IP packets to many hosts Many-to-many communication Mbone Tools NSDR VAT/RAT VIC. NSDR. SAP listener SAP announcer. VAT/RAT. Audio tool - PowerPoint PPT PresentationTRANSCRIPT
NGI Summer ProjectNGI Summer Project
Streaming Media Extensionsto Open Mash and Indiva
Allan Gu
NGI Summer Research (8/02) 2
Multicast BackboneMulticast Backbone(Mbone)(Mbone)
MulticastDistribution of IP packets to many hosts
Many-to-many communication
Mbone ToolsNSDR
VAT/RAT
VIC
NGI Summer Research (8/02) 3
NSDRNSDR SAP listener SAP announcer
NGI Summer Research (8/02) 4
VAT/RATVAT/RAT
Audio tool Participants talk
to each other
NGI Summer Research (8/02) 5
VICVIC Viewer Encoder
NGI Summer Research (8/02) 6
OpenMashOpenMash
Comprehensive toolkitCollection of Mbone toolsOpen source
NGI Summer Research (8/02) 7
ProblemsProblems
VIC displays useless streamSave screen real estateSave resources
Cache of multicast sessionsWeb interface
NGI Summer Research (8/02) 8
NGI Summer Research (8/02) 9
Blue StreamBlue StreamCamera OffEncoder encodes default blue
NGI Summer Research (8/02) 10
Algorithm to RemoveAlgorithm to RemoveBlue StreamBlue Stream
Check YUV frame
5 blocks of 4 pixels
Compare Y, U, V with known color
Blue is (Y,U,V) = (35, 212, 114)
NGI Summer Research (8/02) 11
Black StreamBlack Stream
Lights Off Can’t
compare Different
black Error not
black
NGI Summer Research (8/02) 12
Algorithm to RemoveAlgorithm to RemoveBlack StreamBlack Stream
Examine 20 blocks of 4 pixels eachNeed more samples to detect
Count number of values within ranges4 BINS (3 Black, 1 Other)
Also compute average value of pixelsBlack if satisfy certain condition
50% of pixels is true black (Y<16, 120<U&V <136)
AvgY<28, 120<avgU&avgV<136
NGI Summer Research (8/02) 13
Remove StreamRemove Stream
Drop packets from senderRemove thumbnail Callback to test stream later
Accept packet and check if still black or blue
If not black or blue, put back thumbnail
If still black or blue, register another callback
NGI Summer Research (8/02) 14
NGI Summer Research (8/02) 15
Indiva: Middleware for Streaming Indiva: Middleware for Streaming Media Equipment and ResourcesMedia Equipment and ResourcesNFS metaphor
Application mounts a server and issues commands
High level commandse.g., encode, move, copy, link, mkses, etc.
Bridge conventional audio/video environment and streaming media
Hide physical connections and control interfacesAllocate paths through conventional routing switchesAllocate encoding/decoding resources in a broadcast center
NGI Summer Research (8/02) 16
ISAPISAP
Cache of active Mbone sessionsClone of NSDR
Web interface
Run continuously
Well-known address for SAP 224.2.127.254/9875
A web-cast guide
NGI Summer Research (8/02) 17
ISAPISAP
Parse message according to IETF protocol
Execute indiva manager to create conference
Associate callbackAfter 30 minute, delete conference
Future – click link to participate in session
NGI Summer Research (8/02) 18
NGI Summer Research (8/02) 19
NGI Summer Research (8/02) 20
Future ResearchFuture Research
RTP a/v synchronizationA “time-based corrector” for RTP packet streams
Implement new Indiva services and applications
Ncast Telepresenter service
Webcast control apps
…
NGI Summer Research (8/02) 21
AcknowledgementAcknowledgement
NGILarry RoweWei Tsang OoiPeter PletcherJose Maria Gonzalez…and the entire OpenMash
community
NGI Summer Research (8/02) 22
For More InformationFor More Information
http://www.openmash.orghttp://www.bmrc.berkeley.edu/
frame/projects/indiva/