kiddle cybera summit08 edm
DESCRIPTION
Cameron Kiddle's presentation on rendering on the cloud from Cybera Summit 08.TRANSCRIPT
Rendering on the Cloud:
A Cybera Industry Pilot
Project with EDM Studio
Cameron Kiddle
Grid Research Centre
University of Calgary
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 2
Outline
� EDM Studio
� Project Goals
� Cyberinfrastructure Technology Employed
� Demonstration
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 3
EDM Studio (http://www.edmstudio.com)
� A leading-edge design firm based in Calgary
� Specialize in
� Interactive displays for museums
� Digital visualization
� Have created exhibits for places such as
� National Museum of Australia
� Royal Tyrrell Museum
� Frank Slide Interpretive Centre (in progress)
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 4
Computer Animation
� Requires significant computational power to
produce final movie
� Rendering of an individual frame can take
hours
� High level of concurrency – frames can be
rendered separately
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 5
Case Study: Shrek (DreamWorks)
� Shrek (2001) – 5 million CPU render hours
� Shrek 2 (2004) – 10 million CPU render hours
� Shrek 3 (2007) – 20 million CPU render hours(Source: R. Rowe. DreamWorks Animation "Shrek the Third": Linux Feeds an Ogre.
Linux Journal. June 5, 2007. (http://www.linuxjournal.com/article/9653))
83 days22.8 years2283 yearsShrek 3
42 days11.4 years1142 yearsShrek 2
21 days5.7 years571 yearsShrek
10000 CPUs100 CPUs1 CPU
Time to Render
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 6
EDM Studio Pilot Project Goals
� To create an on-demand cloud-based
rendering service
� Project is divided into two phases
� Phase 1 – a static environment (complete)
� Phase 2 – a dynamic environment with enriched
user portal
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 7
Phase I – Report� Created a virtual 32 CPU rendering farm (static) on the HP Labs
Data Centre at the University of Calgary
� Condor batch scheduling system used to manage rendering jobs
� Setup SideFX Houdini rendering software and licenses
� Setup 1 TB of storage for use by EDM Studio
� EDM Studios has used the render farm to create a preliminary animation of the Frank Slide
� What normally would have taken two months to complete was completed in two weeks
Low-resolution sample rendered on the HP Labs Data Centre by EDM Studio. (Supplied)
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 8
Phase II – Objectives
� Enable dynamic adaptivity of rendering farm
based on user demand
� Employ data management tools to more
efficiently move and manage data
� Construct a portal to allow EDM Studio to
access data management tools and to submit
and monitor rendering jobs
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 9
Cyberinfrastructure Technology
Employed
� Data management tools
� Virtual machine technology
� Dynamic cloud-based infrastructure
� Social networking technology
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 10
Data Management Tools
� Significant amounts of data need to be moved
and managed
� Exploring the use of iRODS (https://www.irods.org)
� Abstracts users, data and resources
� Flexible, adaptive, and customizable
� Handles data transfers and replications
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 11
Virtual Machine Technology
� Employing Xen virtual machine technology
� Create custom Virtual Appliances (VA) for
each application/service needed
� VAs can be easily cloned to create new
instances and scale the environment
� Can support heterogeneous services on the
same physical infrastructure
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 12
Dynamic Cloud-based Infrastructure
� ASPEN: Automated Service Provisioning Environment
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 13
Social Networking Technology
� Allow users to easily generate and share content
� Allow users to interact and collaborate
� Exploring the use of social networking technology
for use by academia and industry
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 14
Rendering Service Portal
� Using Ning - a white label social networking tool (http://www.ning.com)
� The portal is aimed at:� Providing access to data
management tools
� Allowing user to submit, monitor and manage rendering jobs
� Providing access to interactive applications
� Enabling interaction and collaboration
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 15
Demonstration
Cybera Summit
September 30, 2008
Disruptive Technologies Session - 16
Contact Information
Cameron Kiddle
http://grid.ucalgary.ca/