The DataTAG Project 25 March, Brussels FP6 Information Day

http://www.datatag.orghttp://www.datatag.org

Peter Clarke, University College London

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(2)

DataTAG MissionDataTAG Mission

EU EU US Grid network research US Grid network research High Performance Transport protocols

Inter-domain QoS

Advance bandwidth reservation

EU EU US Grid Interoperability US Grid Interoperability

Sister project to DataGRIDSister project to DataGRID

TTransransAAtlantictlantic G Gridrid

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(3)

Collaborations Collaborations

Collaboration with NetworksCollaboration with Networks DANTE and National Research Networks (NRN) GARR (IT), MB-NG (UK), Surfnet (NL), VTHD (FR) Internet2/Abilene, Starlight, TeraGrid, ESnet,

Canarie

Collaboration with projects in EuropeCollaboration with projects in Europe DataGrid/CrossGrid Gridstart National Grid projects (e.g. IT) LHC Computing Grid (LCG)

Collaboration with projects in the USCollaboration with projects in the US Globus iVDGL GriPhyN PPDG

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(4)

EU collaboratorsEU collaborators Brunel UniversityBrunel University

CERNCERN

CLRCCLRC

DANTEDANTE

INRIA INRIA

NIKHEFNIKHEF

PPARCPPARC

UvAUvA

University of University of ManchesterManchester

UCLUCL

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(5)

US collaboratorsUS collaborators

ANLANL

CaltechCaltech

FermilabFermilab

University of University of ChicagoChicago

FSUFSU

IndianaIndiana

WisconsinWisconsin

GlobusGlobus

Northwestern Northwestern UniversityUniversity

UICUIC

University of MichiganUniversity of Michigan

SLACSLAC

StarlightStarlight

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(6)

Cooperating Networks

Funding agencies

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(7)

NLNLSURFnet

CERN

UKUKSuperJANET4

AbileneAbilene

ESNETESNET

MRENMREN

ITITGARR-B

GEANT

NewYork

STAR-TAP

STAR-LIGHT

Network Research Testbed

FRFRINRIA ATRIUM/

VTHD

ATRIUM/VTHD

3*2.5G3*2.5G

2.5G --> 2.5G --> 10G10G

10G10G

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(8)

Phase I (iGRID2002)Phase I (iGRID2002)

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

9

On February 27-28, a Terabyte of data was transferred by S. Ravot of Caltech between the Level3 PoP in Sunnyvale near SLAC and CERN through the TeraGrid router at StarLight from memory to memory as a single TCP/IP stream with 9KB Jumbo frames at a rate of 2.38 Gbps for 3700 seconds. This beat the former record by a factor of approximately 2.5, and used the US-CERN link at 96% efficiency. This is equivalent to:

Transferring a full CD in 2.3 seconds (i.e. 1565 CDs/hour)Transferring 200 full length DVD movies in one hour (i.e. 1 DVD in 18 seconds)

Intel 10GigE Data Transfer TrialIntel 10GigE Data Transfer Trial

European CommissionEuropean Commission

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(10)

ObjectivesObjectives Enable Middleware interoperabilityEnable Middleware interoperability between between

European and US Grid domains European and US Grid domains DemonstrateDemonstrate Large Hadron Collider (LHC) Large Hadron Collider (LHC)

AApplications running on heterogeneous Gridpplications running on heterogeneous Grid

EU EU US Grid Interoperability US Grid Interoperability

IssuesIssues

Resource DiscoveryResource Discovery

Authentication & AuthorisationAuthentication & Authorisation

Job schedulingJob scheduling

Data Management Data Management

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(11)

Results Results

Common Resource Information Common Resource Information PublicationPublication

DataGrid Resource Broker and DataGrid Resource Broker and common Information system common Information system integrationintegration

Implementation in standard Globus release

To be included in next DataGrid Release Already included in US VDT release and

CERN LCG-0 release Input to GGF and CIM

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(12)

Results Results

Common Virtual Organization Common Virtual Organization Authorization system (VOMS)Authorization system (VOMS)

jointly developed by DataTAG/DataGRID

Mapping between PKI-based Grid Mapping between PKI-based Grid security and Kerberos-based security and Kerberos-based mechanism at the local site.mechanism at the local site.

New Grid monitoring system New Grid monitoring system

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(13)

Dissemination Dissemination

Web siteWeb site

PresentationsPresentations GGF, DataGrid, Internet2, AcrossGrid, Nordunet,

INFN-Grid, Gridstart, HNF Europe, IST2002, SC2002, etc

DemosDemos iGRID2002, IST2002, SC2002

High Performance TCP workshopHigh Performance TCP workshop

0

5000

10000

15000

20000

25000

30000

35000

40000

Feb-02 Apr-02 May-02 Jul-02 Sep-02 Oct-02 Dec-02 Jan-03 Mar-03

MonthH

its

40000/month40000/month

DataTAG - EU FP6 Information Day - Brussels 25 March 2003

(14)

ConclusionsConclusions

Successfull first yearSuccessfull first year

Comprehensive Transatlantic testbed builtComprehensive Transatlantic testbed built

Many advances in very high rate data transport Many advances in very high rate data transport

Demonstration of applications running across Demonstration of applications running across

heterogeneous Grid domainsheterogeneous Grid domains