ipv6 and grid middleware: the euchinagrid experience

20
http:// www.euchinagrid.e FP6−2004−Infrastructures−6- SSA-026634 IPv6 and Grid Middleware: the EUChinaGRID experience Gabriella Paolini – GARR Valentino Carcione – GARR Mario Reale – GARR Taipei, 28/03/2007 ISGC 2007

Upload: olive

Post on 02-Feb-2016

53 views

Category:

Documents


0 download

DESCRIPTION

IPv6 and Grid Middleware: the EUChinaGRID experience. Gabriella Paolini – GARR Valentino Carcione – GARR Mario Reale – GARR Taipei, 28/03/2007 ISGC 2007. Summary. EUChinaGRID project IPv6 activity in EUChinaGRID gLite IPv6 Compliance Code-checker Guideline for developers Test-bed - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: IPv6 and Grid Middleware: the EUChinaGRID experience

http://www.euchinagrid.eu

FP6−2004−Infrastructures−6-SSA-026634

IPv6 and Grid Middleware:the EUChinaGRID experience

Gabriella Paolini – GARRValentino Carcione – GARR

Mario Reale – GARR

Taipei, 28/03/2007

ISGC 2007

Page 2: IPv6 and Grid Middleware: the EUChinaGRID experience

2 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

Summary

EUChinaGRID project IPv6 activity in EUChinaGRID gLite IPv6 Compliance

• Code-checker • Guideline for developers • Test-bed

External components and IPv6 GOS and DAS Next steps

Page 3: IPv6 and Grid Middleware: the EUChinaGRID experience

3 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

Project Information

EUChinaGRID is a Specific Support Action (SSA) funded under the EU VI Framework Program.

The project started on the 1 January 2006. 24 months duration. 10 partners (6 from Europe and 4 from China). A total of 495 person months (325 funded). More information is available on the project web site:

www.euchinagrid.eu.

Page 4: IPv6 and Grid Middleware: the EUChinaGRID experience

4 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

IPv6: A specific activity in EUChinaGRID

IPv6 compliance of the middleware

on operational networks

in China (CNGrid GOS) and in Europe (EGEE gLite) address possible issues;provide feedback to MW developers.

Page 5: IPv6 and Grid Middleware: the EUChinaGRID experience

5 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

gLite IPv6 compliance performed tasks

gLite code survey performed by GARR and INFN with an ad-hoc developed tool: the IPv6 code checker

Specific tests on an IPv6 test-bed highlighted a number of IP version dependencies in the gLite code

gLite is not yet IPv6-ready

A migration guideline document delivered to the EGEE middleware developers.

On going fruitful collaboration

with EGEE and ETICS

Page 6: IPv6 and Grid Middleware: the EUChinaGRID experience

6 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

IPv6 code checker

It is a simple bash script It looks for:

• non RFC-3493 compliant calls in specific patterns• suspicious IPv4 code patterns and function calls inside

the source code (C/C++, Java, Python, Perl). Available for downloading:

http://www.euchinagrid.org/IPv6/cod_checker.html

It has been run on 52 gLite WMS CVS modules : 16 failed

Page 7: IPv6 and Grid Middleware: the EUChinaGRID experience

7 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

Example of IPv6 code checker output

org.glite.security.vomsINADDR_ [FAILED]addr_in [FAILED]F_INET$ [PASSED]gethostbyname [FAILED]inet_addr [PASSED]inet_ntoa [PASSED]Inet4Address [PASSED]inet_aton [PASSED]gethostbyname_ex [PASSED]INADDR_BROADCAST [PASSED]0.0.0.0 [FAILED]127.0.0.1 [PASSED]255.255.255.255 [PASSED]

Page 8: IPv6 and Grid Middleware: the EUChinaGRID experience

8 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

IPv6 guidelines for GRID developers

The document consists of two parts. the IPv6 Programming guide

• It describes basics of IPv6 programming and explains how to port IPv4 applications on IPV6.

• It focuses on the most used programming languages: C/C++, Perl, Python, Java

the gLite code survey• It reports results of the code survey on the middleware source

code and draws up the list of the incompatible modules.

Included in EUChinaGrid deliverable D2.2• http://www.euchinagrid.org/docs/EUChinaGRID-Del2.2v3-1.pdf

Page 9: IPv6 and Grid Middleware: the EUChinaGRID experience

9 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

Protocol-agnostic programming

Page 10: IPv6 and Grid Middleware: the EUChinaGRID experience

10 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

IPv6 testbed @GARR

Hardware: • VMWARE ESX server based virtual nodes

Software: • Operating System: Scientific Linux CERN 3.0.8• gLite middleware : gLite 3.0.6 + recommended patches

Page 11: IPv6 and Grid Middleware: the EUChinaGRID experience

11 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

UI2

RGMA-BDII

WMS-LB

CE

WN1

193.206.159.217

ui2.dir.garr.it

2001:760::159:217/64

193.206.159.215

rgma-bdii.dir.garr.it

2001:760::159:215/64

193.206.159.211

voms.dir.garr.it

2001:760::159:211/64

193.206.159.214

wms.dir.garr.it

2001:760::159:214/64 193.206.159.213

ce.dir.garr.it

2001:760::159:213/64

SE

193.206.159.216

wn1.dir.garr.it

2001:760::159:216/64

WN2

193.206.159.218

wn2.dir.garr.it

2001:760::159:218/64

VOMS

193.206.159.221

se.dir.garr.it

2001:760::159:221/64

IPv6 test-bed@ GARR

Page 12: IPv6 and Grid Middleware: the EUChinaGRID experience

12 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

Test operational procedure

Install and configure gLite Start up all services Let the system work on dual stack

• Register nodes with double hostnames on a dual stack DNS server (verify DNS resolving)

Switch off IPv4 and restart with IPv6 only Re-configure and restart services when required (and

possible!) Perform basic functional tests from the UI node

Page 13: IPv6 and Grid Middleware: the EUChinaGRID experience

13 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

Testbed set up and results

The following gLite services have been installed and configured:• UI User Interface • WMS Workload Management System• LB Logging and Bookkeeping server• CE Computing Element (Torque)• WNs Worker Nodes• VOMS server (mysql) VO Management System server• RGMA Information System• BD-II Information System• SE (classic) (gridFTP , local disk fs based)

Functionalities immediately failing:• voms-proxy-init failing [VOMS]• glite-job-submit failing [WMS NS] • …

Page 14: IPv6 and Grid Middleware: the EUChinaGRID experience

14 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

Ipv6 compatibility of GRID middleware A specific task was started in order to investigate if

libraries, software and other third-party elements used in gLite and GOS are IPv6 compliant.

Results reported in a list of modules and third-party components.

http://www.euchinagrid.org/IPv6/ipv_grid_middle.html

Page 15: IPv6 and Grid Middleware: the EUChinaGRID experience

15 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

GOS IPv6 migration

CNGrid GOS (Grid Operating System) middleware is written in Java, which natively supports IPv6.

A full dual-stack version of GOS has been deployed by Beihang University (BUAA).

The new release of GOS was thoroughly tested on a test-bed set up on servers at BUAA, Tsinghua University and Institute of Computing Technology (ICT) in Chinese Academy of Sciences (CAS).

GOS was deployed on 11 main nodes of CNGrid.

Page 16: IPv6 and Grid Middleware: the EUChinaGRID experience

16 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

GOS on IPv6

Page 17: IPv6 and Grid Middleware: the EUChinaGRID experience

17 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

DAS IPv6 version

DAS (Data Access Service) is a middleware used in Scientific Data Grid (a sub-project of CNGrid) aiming at uniform data access service on heterogeneous relational databases covering many disciplines.

It’s IPv6 compliant. Fully tested in an IPv6 environment.

• DASv6: http://das.sdg.ac.cn:8080/dataview

Page 18: IPv6 and Grid Middleware: the EUChinaGRID experience

18 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

DASv6

Page 19: IPv6 and Grid Middleware: the EUChinaGRID experience

19 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

Next Steps

Continue the collaboration with EGEE and ETICS on gLite and IPv6 compliance• Put IPv6 code-checker as a plug-in in the ETICS building-system

Continue with IPv6 compatibility in Grid middleware studies• following ETICS list of all the external dependencies (~ 80)

A large scale IPv6 test-bed• Across different countries (Italy, France, Greece and China) • Across different projects (EUChinaGRID::WP2, EGEE::SA2,

ETICS) • Using IPv4-IPv6 transition mechanisms (NAT-PT)

Page 20: IPv6 and Grid Middleware: the EUChinaGRID experience

20 G. Paolini et al. - GARR ISGC 2007 Taipei 28 March 2007

http://www.euchinagrid.eu/IPv6/