National Institute of Advanced Industrial Science and Technology

ApGrid: Asia Pacific Partnership for Grid Computing

- Introduction of testbed development efforts in Asia Pacific Region -

Yoshio TanakaYoshio Tanaka

Asia

Asia Grid Initiative

NorthAmericaEurope

•International Collaboration•Standardization

Possible Applications on the Grid•Bio Informatics （ Rice Genome, etc. ）•Earth Science （ Weather forecast, Fluid prediction, Earthquake prediction, etc. ）

ApGrid TestbedInternational Grid Testbed over the Asia Pacific countries

ApGrid focuses onSharing resources, knowledge, technologiesDeveloping Grid technologiesHelping the use of our technologies in create new applicationsCollaboration on each others work

History of ApGrid

ApGrid Exhibition at HPCAsia （ Gold Coast, Australia)

2001 2002

ApGrid Exhibition / SC Global Event at SC 2001 （ Denver, USA)

1st ApGrid Core Meeting (Phuket, Thailand)

1st ApGrid Workshop (Tokyo, Japan)

2nd ApGrid Workshop / 2nd ApGrid Core Meeting (Taipei, Taiwan)

2000

Kick-off meeting (Yokohama, Japan)

Presentation at GF5 (Boston, USA)

ApGrid Exhibition at SC 2002 （ Baltimore, USA)

15 countries, 41 organizations (as of Aug, 2003)

2003

We are here

ApGrid Demo at CCGrid 2003 (Tokyo, Japan)

ApGrid Testbed – features -

Truly multi national/political/institutional VOTruly multi national/political/institutional VOnot an application-driven testbeddifferences in languages, culture, policy, interests,

Donation (Contribution) basedDonation (Contribution) basedNot a single source funded for the developmentEach institution contributes his own sharegrass-roots approach

We canWe canhave experiences on running international VOverify the feasibility of this approach for the testbed development

ApGrid Testbed – implementation -

Use Globus Toolkit Ver.2 as a common softwareUse Globus Toolkit Ver.2 as a common softwareGSI based security infrastructureBuild MDS tree

ApGrid CAs’ApGrid CAs’ApGrid allows multiple root CAsTrying to build trust-relationship between CAs

ApGrid MDSApGrid MDSApGrid MDS is running on mds.apgrid.orgplanning to run more top-level MDS and cross-register resources

280280

8080

6464

32323232

3232

ApGrid Testbed: Status http://www.apgrid.org/

Lessons Learned

We have to pay much efforts for initiationWe have to pay much efforts for initiationProblems on installation of GT2/PBS/jobmanger

Installation/configuration of GT2/PBS/jobmanager is still not so easy for application people.Most sites needed help for the installation.

Software requirements depends on the application and middleware used by the application.

In order to run GridRPC (Ninf-G) applications, I askedOpen firewall/TCP WrapperAdditionally build Info SDK bundle with gcc32dbgInstall Ninf-Gchange configuration of xinetd/inetdEnable NAT

Lessons Learned (cont’d)

MDS is not scalable and still unstableMDS is not scalable and still unstableTerrible performance

GIIS lookup takes several ten seconds ~ minutes

Some parameters in grid-info-slapd.conf such as sizelimit, timeout, cahcettl, etc., should be set to appropriate values depends on your environment (number of registered objects, network performance between GRISes and GIISes, etc.).

Well known problem Well known problem Firewall, private IP addresses…

Lessons Learned (cont’d)

Difficulties caused by the grass-roots approach.Difficulties caused by the grass-roots approach.It is not easy to keep the GT2 version coherent between sites.Different requirements for the Globus Toolkit between users.

Middleware developers needs the newest one.Application developers satisfy with using the stable (older) one.It is not easy to catch up frequent version up of the Globus Toolkit.CoG is a current problem

Lessons Learned (cont’d)

Difficulties caused by the grass-roots Difficulties caused by the grass-roots approach (cont’d)approach (cont’d)

Most resources are not dedicated to the ApGrid Testbed. (though this is a common problem for Grids)

There may be busy resourcesNeed grid level scheduler, fancy Grid reservation system?

Lessons Learned (cont’d)

Some resources are not stableSome resources are not stableexample: If I call many RPCs, some of them fails (but sometimes all will done)not yet resolvedGT2? Ninf-G? OS? Hardware?

Other instabilityOther instabilitySystem maintenance (incl. version up of software) without notification

realized when the application would fail.it worked well yesterday, but I’m not sure whether it works today

But this is the Grid But this is the Grid

Relation to other international activities

Contribution to APAN and PRAGMAContribution to APAN and PRAGMAAPAN: Asia Pacific Advanced Network

Network people + application people + Grid peoplePlan to reform ApGrid under APAN

PRAGMA: Pacific-Rim Application and Grid Middleware Assembly

PRAGMA is focusing on applicationsProvide ApGrid Testbed for their applications

Activities at the GGFActivities at the GGFProduction Grid Management RG

Draft a Case Study Document (ApGrid Testbed)Groups in the Security Area

CAOPs (Grid PMA)Discuss about the policy management

Grid Federation RG (1st BOF at GGF9)Discuss federation of GridI’ll be a co-chair

Summary

Difficulties are caused by not technical Difficulties are caused by not technical problems but sociological/political problems but sociological/political problemsproblemsEach site has its own policyEach site has its own policy

account managementfirewallstrusted CAs…

Differences in interests / expertiseDifferences in interests / expertiseApplication, middleware, networking, etc.

Differences in culture, language, etc.Differences in culture, language, etc.Human interaction is very important

Summary (cont’d)

What has been done?What has been done?Resource sharing between more than 10 sites (around 500cpus)Use GT2 as a common softwareRun Ninf-G applications

What hasn’t?What hasn’t?I could use, but it is difficult for others

I was given an account at each site by personal communicationFormalize “how to use the Grid Testbed”Provide documentationDefine ApGrid Policy for international collaborationKeep the testbed stableTools for management

Browse informationCA/Cert. management

For more info

Home Page http://www.apgrid.org/

Mailing Lists Core Member ML core@apgrid.org Tech. Contacts ML tech-contacts@apgrid.org (approved members)

ML for discussion discuss@apgrid.org (open for anyone)