National Grid –National Grid –Beyond R&D to Industry Beyond R&D to Industry

AdoptionAdoption

e-Science Workshop18 Jul 2006

National Grid MissionNational Grid Mission

to facilitate the seamless use of an integrated cyber infrastructure in a secure, effective & efficient manner to advance scientific, engineering &

biomedical R&D,

with the longer term goal of transforming the Singapore economy

using grid

Resource Usage by DomainsResource Usage by Domains(Apr 2005 – Mar 2006)(Apr 2005 – Mar 2006)

Defence R&D, 61.7

Digital Media, 0.6

Life Sciences, 34.8

Physical Sciences, 0.3

CERN, 2.6

Defence R&D

Digital Media

Life Sciences

Physical Sciences

CERN

PC GridsPC Grids• Beyond vacation camp …

– Raffles Institution• Mentors: Zhang Xinhuai (NUS) & Dr. Bryan Lee (BII)• Project: Autodocking

– Hwa Chong Institution• Mentor: Dr. Li Haizhou (I2R)• Project: Speech modelling

• Finalizing syllabi (for IDA ICT Club scheme)– Apple, SCS, SES

• Software Platform– United Devices, BOINC & XGrid

AeroGenome – Crunching on a PC AeroGenome – Crunching on a PC GridGrid

• Aim: To study bacterial micro-organisms in the air in Singapore.

• Motivation: Air plays significant role in public & environmental health

• Initial dataset of 20,000 DNA sequences were matched against database of 3 million known sequences. Single run on isolated compute resources took an entire month.

• Same process took less than 2 days on TCG@NUS

• Future: Scale up study using larger datasets.

A

B C

SHOPExhaust Air

Fresh Air (20%)

Air filter A/C

Recycling Air (80%)

AHU fan

Open door

SHOPExhaust Air

Fresh Air (20%)

Air filter A/C

Recycling Air (80%)

AHU fan

Open door

A

B C

SHOPExhaust Air

Fresh Air (20%)

Air filter A/C

Recycling Air (80%)

AHU fan

Open door

SHOPExhaust Air

Fresh Air (20%)

Air filter A/C

Recycling Air (80%)

AHU fan

Open door

[Courtesy of Dr. Patrick Tan, GIS]

Optimal Resource Management – Zones & Containers by Liang Seng Quee (Sun Microsystems)

Virtual Infrastructure – The Next Generation Data Centerby Lee Poh Wah (VMWare)

Key Issues in Grid Computingby Prof. David Walker (Welsh e-Science Centre & Cardiff University, UK)

Using Virtualisation Techniques in a Grid Environmentby Dr. Ruediger Berlich (Institute for Scientific Computing, Germany)

Microsoft Virtual Server 2005 R2 - An Introduction & Real World Application by Arnold Clemente (Microsoft)

07 Feb - Grid Computing: New FrontiersDr. Ruediger Berlich (Institute for Scientific Computing, Germany)

07 Mar – Romance of the PC GridA/Prof. Tan Tin Wee (National University of Singapore)

08 Apr – Grids for Business for Real?Ong Guan Sin (Singapore Computer Systems)

15 May – A Million Years of ComputingDr. David Andersen (UC Berkeley, USA)

08 Jun – From Grid to Pervasive ComputingProf. Xian-He Sun (Illinois Institute of Technology, USA)

Grid is Good: Unleashing Grid Computing to Power Business, Education & Life

07 Jul – Grid: A Tool for Science & BusinessDr. Simon See (Sun Microsystems Inc., Asia)

18 Aug – Commercial Grids: Remote Rendering for 3D AnimationAlfred Lie (Frontline Technologies)

Sep – Grids in EducationBenjamin Khoo (Apple Computers)

06 Oct – AeroGenomeDr. Patrick Tan (National Cancer Center)

Nov – Sensor GridsDr. Lim Hock Beng (ST Engineering)

Brings leaders, critical thinkers &

speakers of international

renown to Singapore several

times a year to provoke thoughts,

stimulate discussions, &

provide insights on a variety of topics in Grid Computing

Prof. Carl Kesselman (USC)

Kevin Walsh (Oracle Corporation)

• Venue: SMU city campus• Date: 16 – 19 May 2006

GECON 2006

Rocks-A-Palooza II

Sun HPC ConsortiumMeeting

Global Operational Grid (GOG)

HP Tiramisu Program

SINGAPORE

CERNPSCSDSC

ANLNCSAPurdue

CaltechCERN LCG

ASCC

GOGCluster

• Implement baseline grid HPC resources• Build partnerships• Industry-relevant IP creation

In collaboration with

International Collaboration & International Collaboration & MembershipMembership

• Members

• PurposeTo provide a forum for national level discussions on setting up grid infrastructures, deploying applications, and facilitating coordination of projects of common interest in South East Asia.

• Meetings – 8 Feb 2006, and 19 May 2006 in Singapore– 3rd meeting is tentatively in Sep 2006, Thailand.

South East Asia Grid Forum

Sponsored by:

Digital MediaDigital MediaRenderingRendering

Digital MediaDigital Media• Free access to common pool of mental ray licenses• No charge to commercial users, IHL users & independent

animators• Digital Media companies that have used the facilities

• TheContentCompany• Omens-Studio• VHQ Productions

• Digital Media companies scheduled to use the facilities• mega media • Cubix International• Cyber-Max

• Grid Service Brokers• Frontline Technologies Pte Ltd

• IHLs• Singapore Polytechnic• Ngee Ann Polytechnic

Pipeline of Animation Pipeline of Animation ProjectsProjects

• Completed– Smoking Fish – Hold onto Your Butt– The Yellowman Shortfilm– UK Bull Dog Singing

• In the queue …– Piko the Silkworm (22 x 2min episodes)– Man Made Marvels Documentary– Zheng He Documentary– Fun Bots– Nutritional Immunology Sciences

Documentary

Usage – Usage – TheContentCompanyTheContentCompany

• A 2-man company

• Title: The Yellowman Shortfilm

• Required resources for rendering a submission to “Cannes Lions 2006” 53rd International Advertising Festival (18-24 June 2006)

Usage – Usage – TheContentCompanyTheContentCompany

• Mental Ray licenses & servers were used to render the entire animation.

• Facts:– 6500 frames were rendered– Urgent request for required resources over

weekend of 7 - 11 April 2006– Generation of background, animation, &

ambient occlusion layers

Time Taken

CPUs Mental Ray Licenses

Grid 10.46 hrs 46 46

Own ~103.64 hrs 1 1

Usage – Usage – TheContentCompanyTheContentCompany

• 2nd Project: UK Bull Dog Singing

• Animation for the World Cup 2006, to be shown on UK television. The commissioning company offers viewers to download ring tone & animation.

• Facts:– 3200 frames were rendered– Generation of background, animation, & ambient

occlusion layersTime Taken

CPUs Mental Ray Licenses

Grid 20 hrs 20 20

Own ~330 hrs 1 1

Speed up of 16.5x

Usage – Usage –

“Smoking Fish – Hold onto Your Butt”

• Public Service Announcement commissioned by the Surfrider Foundation of America to educate the public about how pollution is harming the country’s coastline. • Working in tandem with Hollywood writer Adam McKay (“Anchorman - Legend of Ron Burgundy”, “Bewitched”) & director Ian O’Roarty,

• Omens Studios produced the CG animation for the project. The PSA will be televised nationally in USA in 2006 on various networks.

Usage – Usage –

• Mental Ray licenses & servers were used to render the “sea floor”.

• Facts:– 755 frames were

rendered

Time Taken

CPUs Mental Ray Licenses

Grid 24 mins 40 40

Own ~760 mins 1 1

Usage – Usage – ProductionsProductions

• Proposed rendering job (Life-Buoy) was rendered in-house as it was not large to use the Grid).

• NGO tested rendering the job over the Grid to confirm resolution of porting & cross-platform issues.

• Facts: 50 frames were renderedTime Taken

CPUs Mental Ray Licenses

Grid 10 min 30 30

Own 30 min 10 10

Speed up of 3x

QuotesQuotes

• “It is now easier and faster to visualize our work, instead of waiting for days before the work is finished.”

Tang Chi SimMD, Omens Studios

• “Grid Computing allows local digital media firms to focus on the creative side of things, rather than worrying over the lack of computing resources.”

Yeo Chun ChengCIO, Media Development Authority

Grid Service Broker – Grid Service Broker –

• Frontline Technologies is a company which has started to explore the business of remote rendering for Digital Media companies.

• Frontline will use of the mental ray licenses from NG’s license server & use NG’s servers as spillover

• Frontline will also provide machines to be used on the grid.

DemonstrationDemonstration

Animation Rendering on the Animation Rendering on the GridGrid

Submission Host / Digital Media Portal Network Switch

. . .

Internet / Internet

2

Internet / Internet

2

NGPPNetwor

k

NGPPNetwor

k

Clusters

1

2

3

User connects to the submission host via internet

Submission host is where user’s input & output files resides and where user submits rendering jobs and collects his ourput.

Rendering is done on the resources

Clusters

EndEnd