Download - 230 File Based World Paulsen BO1 Final
-
8/6/2019 230 File Based World Paulsen BO1 Final
1/43
The
NEXT GENERATIONof
DIGITAL MEDIA WORKFLOW
Evolution to aEvolution to aFileFile--onlyonly
InfrastructureInfrastructure
-
8/6/2019 230 File Based World Paulsen BO1 Final
2/43
Session Topics
What happens when they are only files?
aka when baseband is no more
Quality Control in a File-based domain
Automated Test & Measurement
How the Network is ImpactedProvisioning and efficiency for content migration
Content delivery networks - internal & long distance
exchange Planning, Processes and Procedures
Expectations, shortfalls, handling upgrades
-
8/6/2019 230 File Based World Paulsen BO1 Final
3/43
The Demise Of Baseband
Inevitable reduction of baseband implementations
Retained for live productionNLE is moving away from exclusive real time ingest
Baseband costs increase to maintain the status quo
Non-real time media exchange expands
Faster or slower depending upon immediacy of content
Scalable with the network bandwidth/speed
Ideal for compressed video and file based platforms
Baseband unnecessary for delivery going forward
Pre-packaged formats (already in cable & satellite)
Platform Interchange (direct to air and for transport)
-
8/6/2019 230 File Based World Paulsen BO1 Final
4/43
The Value of Working with Files
Platforms offer unconstrained flexibility
Content is readily repurposed The transport of content is unbound
network based vs. point-to-point physical
Replaces aging analog and digital lineal tapefiles are more durable and extensible
promotes independence from fixed media formats
Costs for file only implementations will decrease
-
8/6/2019 230 File Based World Paulsen BO1 Final
5/43
Uses & Expectations
File-based platforms will
support the NextGen Digital Media domainaddress ATSCs evolving standards (i.e., A/101
interactive, A/72 AVC, NRT protocols, ATSC 2.0)
new mobile applications (A/153 ATSC-M/H)future delivery diversification (VoD, Web)
Preservation of legacy content and fixed media
archive content onceclean up analog formats correctly, once and for all
preserves digital content completely
-
8/6/2019 230 File Based World Paulsen BO1 Final
6/43
File-based Frameworks
Promote integration through a layered architecture
Acquisition, storage, manipulation, and deliveryprocesses
Achieves flexibility by loosely couplingthe infrastructure
to the applications Force structurefor
media asset management
focused work centers, content sharing, collaborationcapabilities that aid in developing or repurposing content
-
8/6/2019 230 File Based World Paulsen BO1 Final
7/43
File-based Frameworks
Provide consistency in workflow
broadcast operations will still use several workflowflavors
applications are extended to work area needs
from acquisition through content preparationthen to playout and on to archive
-
8/6/2019 230 File Based World Paulsen BO1 Final
8/43
Legacy Hybrid WorkflowARCHIVE
Limited FormatsRigid work structure labor intensiveGeneration lossesExcessive Q/ASecondary Information/Metadata manual
-
8/6/2019 230 File Based World Paulsen BO1 Final
9/43
The New Digital Media Workflow (DMW)
GIGABIT NETWORK
FILE BASEDPROCESSING
PLAY TO AIR
POSTPRODUCTION
NEW MEDIADISTRIBUTION
QAMEDIA
MANAGEMENTARCHIVE
ACQUISITION & INGEST
VIDEO
VIDEO
-
8/6/2019 230 File Based World Paulsen BO1 Final
10/43
Enabling a Comprehensive
File-based Environment
Decisions and Policies must be established:
Compression types and formats Coding types and bit rates for levels of quality
Acquisition media (SSM, optical disc, HDD)
Intra-facility interchange formats
Archive methods (near-, short- and long-term)
Disaster recovery mechanism and platform Edit decision making (proxy vs. low-bandwidth)
Monitoring and quality assurance
-
8/6/2019 230 File Based World Paulsen BO1 Final
11/43
When There Are Only Files
Many Work Tasks can be Automated
ingest, quality control, security, backup
Personnel diversification is improved
Baseband house formats can be relaxed Platform interchanges gain flexibility
however, not necessarily simpler or more achievable
Quality control becomes essential!
-
8/6/2019 230 File Based World Paulsen BO1 Final
12/43
Part II
Quality Control in a File Domain
-
8/6/2019 230 File Based World Paulsen BO1 Final
13/43
Touch Points for QC/Test & Monitoring
POINTS OF QC ANALYSIS
MediaTypes
AnalogVideo
Sources
DigitalVideo
Sources
VideoFormats
ANALOG(NTSC, PAL)
SD, HD(720p, 1080i,
1080p)
CIF, QCIF
(Internet, Mobile)
Other(resolutions,frame rates,aspect ratio,
formats)
VIDEO CODECSMPEG2, H.264, AVC-
INTRA, JPEG, JPEG2K,MPEG2 Pt-2, VC-1, VC-3
VIDEO CODECSMPEG2, H.264, AVC-
INTRA, JPEG, JPEG2K,MPEG2 Pt-2, VC-1, VC-3
FILE FORMATS
MPEG-2(TS, PS, PES)
ASF, QTGXF, MXF3GPP, DV
FILE FORMATS
MPEG-2(TS, PS, PES)
ASF, QTGXF, MXF3GPP, DV
BROA
DCAS
T
DELIV
ERY
ALTERNATIVEMEDI
A
AUDIO CODECS
AACE-AC-3, AC-3
DOLBY-E
WMP3WMALayer ILayer II
AUDIO CODECS
AACE-AC-3, AC-3
DOLBY-E
WMP3WMALayer ILayer II1 2 4
-
8/6/2019 230 File Based World Paulsen BO1 Final
14/43
Automating File-based QC
-
8/6/2019 230 File Based World Paulsen BO1 Final
15/43
What Operators Wont See or Hear
Content can be irreparably damaged very early ondangers of image impairment are camouflaged
with no way to recover from many errors
and while it may lookgood, it is still no good Errors created in the encoding process
may be passed through or masked by a good decoder
may still crash a home STB decoderhard to spot missing I-frames, corrupted syntax, levels of macro-
blocking, improper motion vectors, etc
Audio that sounds good, but has:
out-of-phase, channel swapped or lost due
channels missing, wrong dial_norm or DRC
compressed audio but metadata parameters are corrupted
-
8/6/2019 230 File Based World Paulsen BO1 Final
16/43
Audio/Visual Impairments
Encoding quality errors
blockiness, improper motion-vector, misorderingmissing or other improper audio metadata
Timing and segmenting
mistiming, truncation, extension of heads/tailscommercial insertion triggering errors, splicing errors
Format errors or missing information
PAL instead of NTSC, progressive instead of interlace
line standard or framing incorrect
-
8/6/2019 230 File Based World Paulsen BO1 Final
17/43
Non-Audio/Visual Impairments
Multiplexing Errors
Missing data (closed captions, ratings)
Metadata errors
DRM, MXF, BXF (automation/traffic)
Industry interchange specificationsImproper CableLabs compliance
Incorrect MPEG syntax (in ES or PS)
PIDs, PATs, PMTs, PCRs
-
8/6/2019 230 File Based World Paulsen BO1 Final
18/43
Traditional Content Work Flow for QC
INGEST PROCESSESMultiple
ContentProviders
or SourcesManual
QCChecks
QC Script
Transcoding
WrappingTrimming
(Tops & Tails)SegmentingVersioning
Transfer
toServer
-----------Playout
Ready
CONTENT
REJECTED
-
8/6/2019 230 File Based World Paulsen BO1 Final
19/43
Improved Content Quality Assurance
ContentProviders
or Sources
AutomatedQC
PluggedInto Existing
Workflow
Content Meets Rules
TranscodingWrappingCataloging
SegmentingAdd Graphics
Transferto
Server
-----------PlayoutReady
FILES
CONTENT
REJECTED
AutomatedQC Checks
LinearPrograms
LINEAR VIDEO
Automated
QC
IRD
-
8/6/2019 230 File Based World Paulsen BO1 Final
20/43
Corrective Actions
Option-1
decode to baseband, correct with baseband
processing equipment, re-encode(most aesthetic correction or visual/aural discrepancies
must be fixed by humans)
Option-2fix the syntax, (meta)data insertion, or timing
adjust audio metadata or normalization
Option-3reject, then re-feed/re-order the content
abandon and substitute with evergreen material
-
8/6/2019 230 File Based World Paulsen BO1 Final
21/43
New Tools for File Analysis Automated File Analysis
Tektronix Cerify
Interra Systems Baton
Videotek QuiC
MXF tools
Snell & Wilcox, MOG Solutions, Metaglue
Transport stream, MUX and Picture Quality checking
JDSU, Rohde & Schwartz, Tektronix, Triveni
Audio analysis, encoding and metadata correction
Dolby DP600
Delay and Lip Sync correction
disruptive vs. non-disruptive instruments
-
8/6/2019 230 File Based World Paulsen BO1 Final
22/43
Tools Allow You to See & Solve
Video thumbnails and audiowaveform shown in frames
surrounding the alert
Details for each file
within the Job
Alerts for eacherror within the file
Test summary foreach file in Job
Courtesy Tektronix(AZCAR is a Cerify Developers Community member)
Errors in frame
-
8/6/2019 230 File Based World Paulsen BO1 Final
23/43
File-based Augmentation Adding ancillary data (cc, ratings, or v-chip)
Adding logos or branding
Tagging of AdID, ISAN/V-ISAN or ISCI data Inserting playout descriptors
Active Format Description (AFD SMPTE 2016)
Certain traffic/automation tagging (BXF SMPTE 2021)
MXF versioning
Multi-language, video description, PG vs MA versions
Advanced Media Workflow Association (AMWA)Focus on high-level workflow for commercial, syndicated and long form programming
from creation through distribution and then broadcast.
-
8/6/2019 230 File Based World Paulsen BO1 Final
24/43
Part III
Impacts on the Contribution Network
-
8/6/2019 230 File Based World Paulsen BO1 Final
25/43
Managing Files Over Networks
Requires appropriate network provisioning
Scaling for growth
Internal or local storage managementMoving of very large file sizes (upwards of 50 GB)
Security
Handling of varying traffic volatility High Speed Interchange
Internally between work centers
Site-to-site and site-to-multisiteGeographic exchanges with products such as
Omneon ProCast CDN, Isilon, Aspera, Signiant
-
8/6/2019 230 File Based World Paulsen BO1 Final
26/43
File Preparation & Processing
Preparation to prescribed formats
delivered to the facility read to go
Transcode farms
option to use COTS products vs. grow your own
license & per seat costs, interoperability, customization
Engines may be dedicated or integrated
server storage with application processing
integrated transcode clients
deeply tied with automation (extended with QC)
Transcoding vs. unwrapping/rewrappingprocessing times vary
blind transcoding may be ambiguous
-
8/6/2019 230 File Based World Paulsen BO1 Final
27/43
Network Security and Resiliency
Secure file delivery
cryptography
SSL (Secure Sockets Layer)TLS (Transport Layer Security)
selectable payload encryption (AES 256/128/64)
certified delivery using Public Key Infrastructure Network resiliency using
file check-pointing (saving a program state)
firewall traversal
-
8/6/2019 230 File Based World Paulsen BO1 Final
28/43
Operability
Employs industry-standard applications
watch folder based management and interchange
encoding, proxies, and metadata carriage
watermarking, transcoding, content playout or distribution
Simple Object Access Protocol (SOAP),
Service Oriented Architecture (SOA),
Web Services
-
8/6/2019 230 File Based World Paulsen BO1 Final
29/43
Network Centric
Digital Media Distribution Policy based, Web-enabled network management
the network traffic control cop
uses business-based prioritization Tracking, scheduling, reporting and auditing
employs a dashboard view of system status
Controls data confidentiality and integrityCertifies delivery to resources and recipients
Denies unauthorized access
Template based execution of scheduled jobsusing data movement agents
with conformance to business policies
provides redundancy utilizing data differencing
-
8/6/2019 230 File Based World Paulsen BO1 Final
30/43
Intelligent
Content Distribution Networks (CDN)
Intelligent Traffic Management(ITM) offers:
efficient network traffic & bandwidth utilization diversification of transcoding and rate shaping operations
rights management and security
platform extensions, adding diversity to operations automated re-transfer as a background task
ability to use content before FTP transfer is complete
controlled exchange of contentbetween workgroups and other sites
-
8/6/2019 230 File Based World Paulsen BO1 Final
31/43
Media Dispatch Protocol
SMPTE EG 2032-4-2007
For the delivery of files over IP networks
Three parts to MDPprotocol specification (SMPTE 2032-1)mapping specification (SMPTE 2032-2 for MDP/XML/HTTP)
profile specification (SMPTE 2032-3 is the basic target pull profile)
Developed for MAN and WANsuitable for LAN
MDP is not
a transfer protocola file wrapper or container format (i.e., MXF, QuickTime, etc)
a metadata protocol
-
8/6/2019 230 File Based World Paulsen BO1 Final
32/43
Media Dispatch Protocol
SMPTE EG 2032-4-2007
Courtesy of SMPTE
-
8/6/2019 230 File Based World Paulsen BO1 Final
33/43
Content Management Architecture
-
8/6/2019 230 File Based World Paulsen BO1 Final
34/43
Site-to-Site Distribution
File interchange for
collaborative production
content delivery (WIP, approvals or release)
disaster recovery site content population
Content is automatically distributed to destinations usingwatch folders
Nodes (agents) at each site ensure content is moved in themost efficient manner
Transfer scheduling employed to
manage the bandwidth of each individual transferprioritize jobs via rules-based transfers
increases network proficiency
-
8/6/2019 230 File Based World Paulsen BO1 Final
35/43
Site-to-Multisite Distribution
Moves content efficiently between several geographicallydistributed global sites
provisioned on existing IP-networks as an overlay
uses a content-aware file delivery layer
Uses highly scalable enterprise-class platforms
Nodes easily added/removed at new locations
Unidirectional distribution
selects most appropriate route available
multi-cast enabled for satellite delivery
Managed from any location on the network
ensures universal management, monitoring and access
-
8/6/2019 230 File Based World Paulsen BO1 Final
36/43
Part IV
Planning Considerations
for a File-based Infrastructure
-
8/6/2019 230 File Based World Paulsen BO1 Final
37/43
-
8/6/2019 230 File Based World Paulsen BO1 Final
38/43
Media Asset Management
The Key to Success is in a centralized MAM plan
essential element in automated file management Requires adopting new workflow principles
should adhere to open work flow standards
development of your ownservice oriented architecture (SOA)
Selecting the right MAM product
most products are still proprietaryusers often insist upon customizing workflows
costly, less friendly, often undesired by vendor
-
8/6/2019 230 File Based World Paulsen BO1 Final
39/43
Process and Procedure Setting
Establish written policies, practices and procedures
Set acceptability thresholds
Utilize a reporting check list automate whenever possible
logging of errors, statistics, all corrective actions taken
Develop a backup plan with sufficient evergreen content
Prepare the system failover and failback
Adopt versioning management (use MXF)
Know how to find the files
Catalog with MAM, use check-in and check-out, etc
Rigidity with flexibility
Just in Time content delivery may not be practical
-
8/6/2019 230 File Based World Paulsen BO1 Final
40/43
Impacts from System Upgrades
Upgrades will become a regular part of life
Make certain you perform regression testing Forward thinking needed for server growth
play to Air platform, disk expansion, VoD, archive
Understand that both file and system issues areaffected by
inter-departmental interchanges or workflow
platform obsolescence in work zones
the I need a better mousetrap proliferation
-
8/6/2019 230 File Based World Paulsen BO1 Final
41/43
Shortfalls in Implementation Spotty or incomplete implementation
Deployed only a portion of the necessary tools
Insufficient training and exposure prior to launch
System was customized for todays thinkingsort out and remove unobtainable results
set aside misrepresentations and vaporware
Limited acceptance by the staffthe old ways never die, felt threatened, apprehensive
didnt want to become the guinea pig
Only a few understand or evangelized the long term,extensible value to the overall organizationinitial ROI didnt meet the accounting expectation
-
8/6/2019 230 File Based World Paulsen BO1 Final
42/43
The Successful Implementation
Mitigates manual processes
Reduces time getting products to air
Minimizes errors improves flexibility
Creates the perfect paths for
archivingrepurposing/versioning of content
disaster recovery/asset protection
prevention of obsolescence
Complex at the start worth it in the end
-
8/6/2019 230 File Based World Paulsen BO1 Final
43/43
Thank You
Karl Paulsen
Chief Technology Officer
AZCAR Technologies, Inc.
724-873-0800 ext 203
mailto:[email protected]:[email protected]