steeple workshop - mediamosa - oxford, july 2011
DESCRIPTION
MediaMosa, an overview. Event: Steeple workshop Date: July, 1st, 2011 Location: Kellogg College, Oxford Presenter: Frans Ward - SURFnetTRANSCRIPT
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
`
Frans WardSenior Technical Product ManagerSURFnet Advanced Services
MediaMosa: Open Source Media ManagementSoftware to Build an Open Video Platform
“Open Video in Education”
Saturday, July 2, 2011
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
OVERVIEW
• About SURFnetAnd our services. Briefly...
• MediaMosa IntroductionWhat is it?
• MediaMosa FeaturesWhat can it do for you?
• MediaMosa ArchitectureHow is it build?
• Technology Scouting ProjectsHow can MediaMosa be of use here?
Saturday, July 2, 2011
About SURFnet
• The SURFnet network is the national computer network for higher education and research in the Netherlands (NREN)
• SURFnet is a subsidiary of the SURF organization
• Not for profit, 80 employees
• 180 connected institutions, serving 1 million users
NREN, National Research and Education Network
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
The SURF organization
Policymaking
Task Organizations
Institutions
Customer Relation
Strategic Direction
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
SURFfoundation
SURFnet
SURFdiensten
Saturday, July 2, 2011
SURFnet ServicesSURFnet provides advanced services to the
Dutch research and education community
High performance networking. SURFnet plays a leading role in the development of national, European and world-wide networking.
Authentication and authorization services to provide secure access to the network and other resources.
Advanced multimedia collaboration tools, including high quality audio/video streaming and communication.
NREN, National Research and Education Network
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
CDN
VP-CorePowered by
SURFmediaSURFnet’s online mediaportalhttp://www.surfmedia.nl/
✓ Video On Demand (VOD)✓ Live Streaming
Front-endsBack-ends
Facts and Figures (June 2011)
• 97.610 assets
• 15 TB data
• 47.979 accounts
• 11.450 logins per month
• 43 institutions using federative logins
• 4 content suppliers
• 248.049 views per month
SURFnet Video Services
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
VP-Core• Shared platform SURFnet and Kennisnet• Application, streaming-, transcoding servers + storage• Powered by MediaMosa
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
DEMO SURFMEDIA
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
http://ww.surfmedia.nl/
Saturday, July 2, 2011
SURFnet. We make innovation work1
MediaMosa Open Source
Software to build a Media Management andDistribution Platform
Main Entry: 1me·dia-mo-saPronunciation: \ˈmē-dē-ə-mō-ˈzā\Function: open source software to build a media management and distribution platformRelease Date: 8 april 2009
In use by SURFnet and Kennisnet on their
VP-Core platform since July 2008
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
Fron
t-en
dA
pplic
atio
nsBa
ck-e
ndM
edia
Mos
a
‣ Separation of front-end and back-end functionality
‣ Open source and open source components !
‣ Based on a Service Oriented Architecture
‣ Multiple end-user applications on a centralized video backend infrastructure
‣ Performance and High availability
‣ Scalable for future expansions
‣ Flexibility: combining components
MediaMosa Architecture Blueprint
➡ Common base for MediaMosa is Drupal 7
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
RESTRepresentational State Transfer
• All interactions (messages) with the MediaMosa platform are done with REST-calls.
• REST strictly refers to a collection of network architecture principles which outline how resources are defined and addressed.
• REST is a Client-server, Stateless, Cacheable and Layered protocol.
✓ This reduces the complexity ✓ improves the effectiveness of
performance tuning✓ increases the scalability of pure
server components
[GET] .../asset?limit=10<?xml version="1.0"?> <response> <header> <item_count>8</item_count> <item_count_total>8</item_count_total> <item_offset>0</item_offset> <request_process_time>0.0728</request_process_time> <request_query_count>55</request_query_count> <request_result>success</request_result> <request_result_description></request_result_description> <request_result_id>601</request_result_id> <request_uri>[GET] asset?limit=10&user_id=admin&is_app_admin=TRUE</request_uri> <vpx_version>2.3.11</vpx_version> </header> <items> <item id="1"> <asset_id>ZG3SmyybQ61abezpbVHrJkFF</asset_id>..... etc
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
WebservicesOver 185, divided in services for....
• Play Video (PlayProxy HTML wrapper)• Authentication (DBUS for EUA)• Authorization
(Domain, REALM, Group or mixed)• Upload (PUT, POST, FTP)• Transcoding• Media Management: media files, assets
and collections• Search: Contextual Query Language • Jobs• Metadata and OAI/PMH• Notification• Logging and Statistics
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
http://mediamosa.org/api
Saturday, July 2, 2011
SURFnet. We make innovation work1
Flexible Metadata Element Sets
CRUD REST-calls on all objects possible. i.e.:• POST /asset/create?user=John• GET /asset/$asset_id • POST /mediafile/$mediafile?filename=NewName• POST /collection/$coll_id/delete?user=John
Metadata Element Sets Provided:• Standard Dublin Core (DC)• Qualified Dublin Core (QDC)• Learning Object Metadata (IEEE LOM) • ‘Content Zoek Profiel’ (CZP / NL LOM)
Objects are organized in assets, media files and collections
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
Transcoding Services
Based on FFMPEG a complete, cross-platform solution to record, convert and stream audio and video. It includes libavcodec - the leading audio/video codec library.
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
Access ManagementScreening
Default: Media is accessible for everyone. Option to set access restrictions for playing media on the following properties:
• Domain, or group of domains: i.e only accessible from .surfnet.nl
• Realm, or group of realms:i.e. using SURFfederation authentication infrastructure
• User, or group of users: only give rights to user=john or group "class-24"
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
Search Services
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Simple Search: • GET /asset?owner=John• GET /asset?collection=7
Advanced Search using CQL level 2 :• “(dc.title = foo OR qdc.title_alternative = bar)” • “NOT (dc.title = foo AND dc.title = bar)” • “^cat ^dog tree^”
http://www.loc.gov/standards/sru/specs/cql.html
Support for Apache SOLR as alternative search engine!
Saturday, July 2, 2011
SURFnet. We make innovation work1
Upload Services• POST upload using End User Application
(limited to 2 GB) • POST upload directly to MediaMosa Platform
using ticket system (limited to 2 GB)
• HTTP PUT upload using End User Application (i.e. Java Upload Applet)
• FTP batch upload (“no” limits) including
metadata in XML file • Quota per End User Application
• Support for Master / Slave content sharing(Provider Application / CLA)
MediaMosa
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
Metadata Harvesting using OAI-PMH
Metadata Harvesting using OAI-PMH
• is a low-barrier mechanism for repository interoperability. • Data Providers are repositories that expose structured metadata via
OAI-PMH. • Service Providers then make OAI-PMH service requests to harvest
that metadata. • OAI-PMH is a set of six verbs or services that are invoked within
HTTP.
http://oai.surfmedia.nl/request?verb=Identifyhttp://oai.surfmedia.nl/request?verb=ListSetshttp://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_qdchttp://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_dchttp://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_lomhttp://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=czphttp://oai.surfmedia.nl/request?verb=ListRecords&metadataPrefix=oai_qdc&set=coll_id:794
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MediaMosa Community Website & Online DEMO environment
http://mediamosa.org
http://demo.mediamosa.org
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
• Rich Media Systems Compared
• MediaMosa Building Block for Blackboard
• MediaMosa and support for other content
• Full text search engines
• Content in the Cloud
• MediaMosa and Open API
• Transcripting Technology
• Open Live Streaming
• MediaMosa RichMedia Application
• Content Supplier Application
• MediaMosa and Opencast Matterhorn
• HTML5 Video
TECHNOLOGY SCOUTING PROJECTS... PAST & PRESENT
MediaMosa Technology Scouts
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
MEDIAMOSA AND OPEN WEBSERVICES
Goal: 1) to provide an open interface for sharing data stored in a MediaMosa environment
2) to consume data from other open platforms and to integrate this in MediaMosa
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
MEDIAMOSA AND OPEN WEBSERVICESPROOF OF CONCEPTS
http://api.mediamosa.surfnet.nl/
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
MEDIAMOSA RICH MEDIA END USER APPLICATION
Goal: to provide a rich media presentation application using MediaMosa for presenting weblecture recordings
• Rich Media = Weblecture Recording
• 2 playback modes: Video - Video or Video - Slides
• Using export of a MediaSite recording
• Automatically producing slides from video
• Demo available on MediaMosa demo-site: http://demo.mediamosa.org/richmedia
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
MEDIAMOSA RICH MEDIA END USER APPLICATION
DEMO
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the Internet increases rapidly
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the Internet increases rapidly
• Archiving is not enough: disclosure and reusing is required!
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the Internet increases rapidly
• Archiving is not enough: disclosure and reusing is required!
• The use of speech technology is needed (Reduce human effort).
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the Internet increases rapidly.
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the Internet increases rapidly.
• Archiving is not enough: disclosure and reusing is required!
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the Internet increases rapidly.
• Archiving is not enough: disclosure and reusing is required!
• Adding Metadata is the key component here.
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• The number of AV-archives on the Internet increases rapidly.
• Archiving is not enough: disclosure and reusing is required!
• Adding Metadata is the key component here.
• The use of speech technology is needed (Reduce human effort).
Disclosure of audiovisual archives
UK National Film and Television Archive, Berkhamstedhttp://www.flickr.com/people/footage/
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
Huge amount of workand no time-coded relations with video
Adding metadata, the traditional approach:Manual annotation
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
Adding metadata, the new approach:Exploiting Speech technology for metadata generation
Speech Recognition(Speech-to-Text)Time-coded Transcript
Indexing and Search:Search on fragment level
Audio Extraction
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
• Transcripting: conversion of speech into a written or electronic text document.
• Automatic Speech Recognition (ASR) seems to be the ideal technology for this.
• In combination with Optical Character Recognition (OCR) of slides.
• Goal: to provide additional metadata for searching in video / lecture recordings.
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGY
DEMO’s SPEECH RECOGNITION
http://hmi.ewi.utwente.nl/showcases/Broadcast-news-demohttp://hmi.ewi.utwente.nl/showcases/Radio%20Oranje%20demo
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MEDIAMOSA TRANSCRIPTING TECHNOLOGYThe Technology Scout Project. The process is complex...
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
MEDIAMOSA TRANSCRIPTING TECHNOLOGY SCOUTING PROJECT
MediaMosaTranscription by Spraak
Multi-SourcePlayer
Partners:
• Enhanced Search• Optional Subtitles• Mashup info
Lecture Recording
End User Application
• Recognize the Speech• Produce time-coded
Transcript
• Recording of Teacher• Recording of Slides• Reference material
• Transcode into audio• Store all into an asset
MediaMosa and Transcripting TechnologyDIVERSE2011, Dublin, June 28 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
OPEN SOURCE MULTI-SOURCE HTML5 PLAYER
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
RECORDING BOX LECTURE RECORDINGCommunity Development Projects
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
RECORDING BOX LECTURE RECORDINGCommunity Development Projects
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Picture in Picture, Chapter marking, Text Recognition, Recording Player for Flash and iPad
Saturday, July 2, 2011
SURFnet. We make innovation work1
RECORDING BOX LECTURE RECORDINGCommunity Development Projects
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
RECORDING BOX LECTURE RECORDINGCommunity Development Projects
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
• Automatic publishing• Create and use metadata• Rich Media content• All metadata searchable
Saturday, July 2, 2011
MEDIAMOSA INNOVATION PROJECTS IN 2011Weblecturing pilot with the University of Groningen (RUG)
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
Community Development ProjectsMEDIAMOSA DRUPAL MODULES
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Drupal 6
Drupal 7
Saturday, July 2, 2011
SURFnet. We make innovation work1
MediaMosa Status & Roadmap
Continued Development: 2011: Two major releases based on new Drupal 7 framework.MediaMosa 3.0: focusses on Open InterfacesMediaMosa 3.5: focusses on Transcripting Technology (speech-2-text)
Other MediaMosa Projects 2011:• Weblecture Pilot MediaMosa - Matterhorn• Proof of Concepts Transcripting Technology• Proof of Concepts flexible workflows
(Enhanced support for other content than audio/video)
Available on mediamosa.org
Release 2.3.11
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MediaMosa 3.0Focus on open interfaces, open standards and OpenSocial
MediaMosa OpenAPI interface:Own interface in MediaMosa for support for open REST calls and other related functions:• Search• oAuth• oEmbed• open upload
Open standards: • JSON, ATOM feed
OpenSocial: • a common API for social applications across multiple websites
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1 MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
1. SURFfederatie SAML
2. SURFteams (grouper)
3. OpenSocial
4. Collaboration tools
+
+
+
=
Saturday, July 2, 2011
SURFnet. We make innovation work1 MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
External Services
Campus Services
Supporting Services • SURFfederatie • SURFteams • OpenSocial
Functional Components
Saturday, July 2, 2011
SURFnet. We make innovation work1 MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
OpenSource: www.OpenConext.org
Sourcecode: Apache License, v2.0
Content: CC “Attr. 3.0 Unported”
Portal
Engine Block
OpenSocial Container
Platform Management interface
Saturday, July 2, 2011
SURFnet. We make innovation work1 MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011
SURFnet. We make innovation work1
MediaMosa Directions
Q&A
MediaMosa
MediaMosa
MediaMosa
Thanks
for yo
ur
attenti
on!
WWWhttp://mediamosa.org
Online Demohttp://demo.mediamosa.org
Forumhttp://mediamosa.org/forum
Issue Trackerhttp://mediamosa.org/trac
Source Codehttps://github.com/mediamosa
Slidesharehttp://www.slideshare.net/MediaMosa
Twitterhttp://twitter.com/mediamosa
MediaMosa @ Steeple WorkshopOxford, July 1 2011 - SURFnet. We make innovation work
Saturday, July 2, 2011