networks and grids for global science networks and grids for global science harvey b. newman harvey...

74
Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology California Institute of Technology 3 3 rd rd International Data Grid Workshop International Data Grid Workshop Daegu, Korea August 26, 2004 Daegu, Korea August 26, 2004

Post on 19-Dec-2015

222 views

Category:

Documents


2 download

TRANSCRIPT

Page 1: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Networks and Grids for Global ScienceNetworks and Grids for Global Science

Harvey B. NewmanHarvey B. Newman California Institute of TechnologyCalifornia Institute of Technology33rdrd International Data Grid Workshop International Data Grid Workshop

Daegu, Korea August 26, 2004Daegu, Korea August 26, 2004

Page 2: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Challenges for Global HENP ExperimentsChallenges for Global HENP Experiments

Major Challenges (Shared with Other Fields)Major Challenges (Shared with Other Fields) Worldwide Communication and Collaboration Worldwide Communication and Collaboration Managing Globally Distributed Computing & Data Resources,Managing Globally Distributed Computing & Data Resources, for Cooperative Software Development and Analysis for Cooperative Software Development and Analysis

LHC Example- 20075000+ Physicists 250+ Institutes 60+ Countries

BaBar/D0 Example - 2004500+ Physicists 100+ Institutes 35+ Countries

Page 3: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

First Beams: Summer 2007Physics Runs: from Fall 2007

TOTEM

LHCb: B-physics

ALICE : HI

pp s =14 TeV L=1034 cm-2 s-1

27 km Tunnel in Switzerland & France

Large Hadron Collider (LHC) CERN, Geneva: 2007 Start

Large Hadron Collider (LHC) CERN, Geneva: 2007 Start

CMS

Atlas

Higgs, SUSY, QG Plasma, CP Violation, … the Unexpected

5000+ Physicists 250+ Institutes 60+ Countries

Page 4: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

LHC Data Grid Hierarchy:Developed at Caltech

LHC Data Grid Hierarchy:Developed at Caltech

Tier 1

Tier2 Center

Online System

CERN Center PBs of Disk;

Tape Robot

FNAL CenterIN2P3 Center INFN Center RAL Center

InstituteInstituteInstituteInstitute

Workstations

~100-1500 MBytes/sec

~10 Gbps

1 to 10 Gbps

Tens of Petabytes by 2007-8.An Exabyte ~5-7 Years later.Physics data cache

~PByte/sec

10 - 40 Gbps

Tier2 CenterTier2 CenterTier2 Center

~1-10 Gbps

Tier 0 +1

Tier 3

Tier 4

Tier2 Center Tier 2

Experiment

CERN/Outside Resource Ratio ~1:2Tier0/( Tier1)/( Tier2) ~1:1:1

Emerging Vision: A Richly Structured, Global Dynamic System

Page 5: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

ICFA and Global Networks ICFA and Global Networks for Collaborative Sciencefor Collaborative Science

ICFA and Global Networks ICFA and Global Networks for Collaborative Sciencefor Collaborative Science

National and International Networks, with sufficient National and International Networks, with sufficient (rapidly increasing) capacity and seamless end-to-end (rapidly increasing) capacity and seamless end-to-end capability, are essential forcapability, are essential forThe daily conduct of collaborative work in bothThe daily conduct of collaborative work in both

experiment and theory experiment and theoryExperiment development & construction Experiment development & construction

on a global scale on a global scaleGrid systems supporting analysis involving Grid systems supporting analysis involving

physicists in all world regions physicists in all world regions The conception, design and implementation of The conception, design and implementation of

next generation facilities as “global networks” next generation facilities as “global networks” ““Collaborations on this scale would never have been Collaborations on this scale would never have been

attempted, if they could not rely on excellent networks”attempted, if they could not rely on excellent networks”

Page 6: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Challenges of Next Generation Science in the Information AgeChallenges of Next Generation Science in the Information Age

Flagship Applications Flagship Applications High Energy & Nuclear Physics, AstroPhysics Sky Surveys:High Energy & Nuclear Physics, AstroPhysics Sky Surveys:

TByte to PByte “block” transfers at 1-10+ Gbps TByte to PByte “block” transfers at 1-10+ Gbps Fusion Energy:Fusion Energy: Time Critical Burst-Data Distribution; Time Critical Burst-Data Distribution;

Distributed Plasma Simulations, Visualization, Analysis Distributed Plasma Simulations, Visualization, Analysis eVLBI:eVLBI: Many real time data streams at 1-10 Gbps Many real time data streams at 1-10 Gbps BioInformatics, Clinical Imaging:BioInformatics, Clinical Imaging: GByte images on demand GByte images on demand

Provide results with rapid turnaround, over networks Provide results with rapid turnaround, over networks of varying capability in different world regionsof varying capability in different world regions

Advanced integrated applications, such as Data Grids, Advanced integrated applications, such as Data Grids, rely on seamless operation of our LANs and WANsrely on seamless operation of our LANs and WANs With reliable, quantifiable high performanceWith reliable, quantifiable high performance

Petabytes of complex data explored and analyzed by Petabytes of complex data explored and analyzed by 1000s of globally dispersed scientists, in hundreds of teams1000s of globally dispersed scientists, in hundreds of teams

Page 7: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Int’l Networks BW on Major Links for HENP: US-CERN Example

Int’l Networks BW on Major Links for HENP: US-CERN Example

Rate of Progress >> Moore’s Law (US-CERN Example)Rate of Progress >> Moore’s Law (US-CERN Example) 9.6 kbps Analog9.6 kbps Analog (1985) (1985) 64-256 kbps Digital (1989 - 1994) [X 7 – 27]64-256 kbps Digital (1989 - 1994) [X 7 – 27] 1.5 Mbps Shared (1990-3; IBM) [X 160]1.5 Mbps Shared (1990-3; IBM) [X 160] 2 -4 Mbps2 -4 Mbps (1996-1998) [X 200-400] (1996-1998) [X 200-400] 12-20 Mbps (1999-2000) [X 1.2k-2k]12-20 Mbps (1999-2000) [X 1.2k-2k] 155-310 Mbps155-310 Mbps (2001-2) [X 16k – 32k] (2001-2) [X 16k – 32k] 622 Mbps622 Mbps (2002-3) [X 65k] (2002-3) [X 65k] 2.5 Gbps 2.5 Gbps (2003-4) [X 250k] (2003-4) [X 250k] 10 Gbps 10 Gbps (2005) [X 1M] (2005) [X 1M] 44x10 Gbps or 40 Gbps (2007-8)x10 Gbps or 40 Gbps (2007-8) [X 4M][X 4M]

A factor of ~1M Bandwidth Improvement over A factor of ~1M Bandwidth Improvement over 1985-2005 (a factor of ~5k during 1995-2005)1985-2005 (a factor of ~5k during 1995-2005)

A prime enabler of major HENP programsA prime enabler of major HENP programs HENP has become a leading applications driver, HENP has become a leading applications driver,

and also a co-developer of global networks and also a co-developer of global networks

Page 8: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

History of Bandwidth Usage – One Large Network; One Large Research Site

History of Bandwidth Usage – One Large Network; One Large Research Site

ESnet Monthly Accepted Traffic 1/90-1/04

0

50

100

150

200

250

300

Jan,

90Oc

t, 90

Jul,9

1Ap

r, 92

Jan,

93Oc

t,93

Jul, 9

4Ap

r, 95

Jan,

96Oc

t, 96

Jul, 9

7Ap

r, 98

Jan,

99Oc

t, 99

Jul, 0

0Ap

r, 01

Jan,

02Oc

t, 02

Jul, 0

3

TByte

/Mon

th

SLAC Traffic ~400 Mbps; Growth in Steps (ESNet Limit): ~ 10X/4

Years.Projected: ~2 Terabits/s by

~2014

ESnet Accepted Traffic 1/90 – 1/04Exponential Growth Since ’92;

Annual Rate Increased from 1.7 to 2.0X Per Year In the Last 5 Years

Page 9: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Internet Growth in the World At Large

Internet Growth in the World At Large

Amsterdam Internet Exchange Point Example

20 Gbps

30 Gbps

Average

5 Minute

Max

Some Annual Growth Spurts;

Typically In Summer-Fall

The Rate of HENP Network Usage Growth (~100% Per Year) is Similar to the World at Large

11.0

8.0

4

Page 10: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Judged on product of transfer speed and Judged on product of transfer speed and distance end-to-end, using standard distance end-to-end, using standard (TCP/IP) protocols.(TCP/IP) protocols.

Across Production Net: AbileneAcross Production Net: Abilene IPv6 record: IPv6 record: 4.0 Gbps4.0 Gbps between between

Geneva and Phoenix (SC2003)Geneva and Phoenix (SC2003) IPv4 Multi-stream record with Windows & IPv4 Multi-stream record with Windows &

Linux: Linux: 6.6 Gbps6.6 Gbps between Caltech and between Caltech and CERN (16 kkm; CERN (16 kkm; “Grand Tour d’Abilene”) June 2004“Grand Tour d’Abilene”) June 2004 Exceeded 100 Petabit-m/secExceeded 100 Petabit-m/sec

Single Stream 7.5 Gbps X 16 kkmSingle Stream 7.5 Gbps X 16 kkm with with Linux Achieved in JulyLinux Achieved in July

Concentrate now on reliable Concentrate now on reliable Terabyte-scale file transfersTerabyte-scale file transfersNote System Issues: CPU, PCI-XNote System Issues: CPU, PCI-X

Bus, NIC, I/O Controllers, Drivers Bus, NIC, I/O Controllers, Drivers

Monitoring of the Abilene traffic in LA:Monitoring of the Abilene traffic in LA:

6.6 Gbps16500km

4.2 Gbps16343km5.6 Gbps

10949km

5.4 Gbps7067km

2.5 Gbps10037km0.9 Gbps

10978km0.4 Gbps12272km

0

20

40

60

80

100

120

Internet 2 Land Speed Record (LSR)Internet 2 Land Speed Record (LSR)

Pe

tab

itm

ete

r (1

0^1

5 b

it*m

ete

r)

LSR History – IPv4 single stream

http://www.guinnessworldrecords.com/

June 2004 Record Network

Page 11: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

HENP Bandwidth Roadmap for Major Links (in Gbps)

HENP Bandwidth Roadmap for Major Links (in Gbps)

Year Production Experimental Remarks

2001 0.155 0.622-2.5 SONET/SDH

2002 0.622 2.5 SONET/SDH DWDM; GigE Integ.

2003 2.5 10 DWDM; 1 + 10 GigE Integration

2005 10 2-4 X 10 Switch; Provisioning

2007 2-4 X 10 ~10 X 10; 40 Gbps

1st Gen. Grids

2009 ~10 X 10 or 1-2 X 40

~5 X 40 or ~20-50 X 10

40 Gbps Switching

2011 ~5 X 40 or

~20 X 10

~25 X 40 or ~100 X 10

2nd Gen Grids Terabit Networks

2013 ~Terabit ~MultiTbps ~Fill One Fiber

Continuing Trend: ~1000 Times Bandwidth Growth Per Decade;Keeping Pace with Network BW Usage (ESNet, SURFNet etc.)

Page 12: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Evolving Quantitative Science Requirements for Networks (DOE High Perf. Network Workshop)

Evolving Quantitative Science Requirements for Networks (DOE High Perf. Network Workshop)

Science AreasScience Areas Today Today End2EndEnd2End

ThroughputThroughput

5 years 5 years End2End End2End

ThroughputThroughput

5-10 Years 5-10 Years End2End End2End

ThroughputThroughput

RemarksRemarks

High Energy High Energy PhysicsPhysics

0.5 Gb/s0.5 Gb/s 100 Gb/s100 Gb/s 1000 Gb/s1000 Gb/s High bulk High bulk throughputthroughput

Climate (Data & Climate (Data & Computation)Computation)

0.5 Gb/s0.5 Gb/s 160-200 Gb/s160-200 Gb/s N x 1000 Gb/sN x 1000 Gb/s High bulk High bulk throughputthroughput

SNS NanoScienceSNS NanoScience Not yet startedNot yet started 1 Gb/s1 Gb/s 1000 Gb/s + QoS 1000 Gb/s + QoS for Control for Control

ChannelChannel

Remote control Remote control and time critical and time critical

throughputthroughput

Fusion EnergyFusion Energy 0.066 Gb/s0.066 Gb/s(500 MB/s (500 MB/s

burst)burst)

0.198 Gb/s0.198 Gb/s(500MB/(500MB/

20 sec. burst)20 sec. burst)

N x 1000 Gb/sN x 1000 Gb/s Time critical Time critical throughputthroughput

AstrophysicsAstrophysics 0.013 Gb/s0.013 Gb/s(1 TByte/week)(1 TByte/week)

N*N multicastN*N multicast 1000 Gb/s1000 Gb/s Computational Computational steering and steering and

collaborationscollaborations

Genomics Data & Genomics Data & ComputationComputation

0.091 Gb/s0.091 Gb/s(1 TBy/day)(1 TBy/day)

100s of users100s of users 1000 Gb/s + QoS 1000 Gb/s + QoS for Control for Control

ChannelChannel

High throughput High throughput and steeringand steering

Page 13: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

National Lambda Rail (NLR)National Lambda Rail (NLR)

15808 Terminal, Regen or OADM siteFiber route

NLRComing Up NowInitially 4 10G

WavelengthsNorthern Route

LA-JAX by 4Q04 Internet2 HOPI Initiative (w/HEP) To 40 10G Waves in Future

Transition beginning now to optical, multi-wavelength Community owned or leased

“dark fiber” networks for R&E

PITPIT

PORPOR

FREFRE

RALRAL

WALWAL

NASNASPHOPHO

OLGOLGATLATL

CHICHI

CLECLE

KANKAN

OGDOGD

SACSAC BOSBOSNYCNYC

WDCWDC

STRSTR

DALDAL

DENDEN

LAXLAX

SVLSVL

SEASEA

SDGSDG

JACJAC nl, ca, pl, cz,

uk, ko, jp18 US States

Page 14: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

JGN2: Japan Gigabit Network (4/04 – 3/08)20 Gbps Backbone, 6 Optical Cross-Connects

Kanazawa Sendai

Sapporo

Nagano

Kochi Nagoya

Fukuoka

Okinawa

Okayama

< 1 G> ・ Teleport Okayama (Okayama)  ・ Hiroshima University (Higashi

Hiroshima) < 100 M> ・ Tottori University of

Environmental Studies (Tottori)  ・ Techno Ark Shimane (Matsue)  ・ New Media Plaza Yamaguchi

(Yamaguchi)

< 10 G> ・ Kyoto University (Kyoto)  ・ Osaka University (Ibaraki) < 1 G>  ・ NICT Kansai Advanced Research Center (Kobe) < 100 M> ・ Lake Biwa Data Highway AP * (Ohtsu) ・ Nara Prefectural Institute of Industrial

Technology (Nara)  ・ Wakayama University (Wakayama)  ・ Hyogo Prefecture Nishiharima Technopolis

(Kamigori-cho, Hyogo Prefecture) < 10 G>   ・ Kyushu University (Fukuoka) < 100 M> ・ NetCom Saga (Saga)  ・ Nagasaki University

(Nagasaki)  ・ Kumamoto Prefectural Office

(Kumamoto)  ・ Toyonokuni Hyper Network

AP *(Oita) ・ Miyazaki University (Miyazaki)  ・ Kagoshima University

(Kagoshima)

< 100 M> ・ Kagawa Prefecture Industry Promotion Center (Takamatsu)  ・ Tokushima University (Tokushima)  ・ Ehime University (Matsuyama)  ・ Kochi University of Technology

(Tosayamada-cho, Kochi Prefecture)

< 100 M> ・ Nagoya University (Nagoya)  ・ University of Shizuoka (Shizuoka)  ・ Softopia Japan (Ogaki, Gifu Prefecture)  ・ Mie Prefectural College of Nursing (Tsu)

< 10 G> ・ Ishikawa Hi-tech Exchange Center

(Tatsunokuchi-machi, Ishikawa Prefecture) < 100 M> ・ Toyama Institute of Information Systems (Toyama)  ・ Fukui Prefecture Data Super Highway AP * (Fukui)  

< 100 M> ・ Niigata University

(Niigata)  ・ Matsumoto Information Creation Center

(Matsumoto, Nagano Prefecture)

< 10 G> ・ Tokyo University

(Bunkyo Ward, Tokyo)  ・ NICT Kashima Space Research Center

(Kashima, Ibaraki Prefecture) <1G> ・ Yokosuka Telecom Research Park

(Yokosuka, Kanagawa Prefecture) <100M> ・ Utsunomiya University (Utsunomiya)  ・ Gunma Industrial Technology Center

(Maebashi)  ・ Reitaku University

(Kashiwa, Chiba Prefecture)  ・ NICT Honjo Information and Communications Open Laboratory

(Honjo, Saitama Prefecture)  ・ Yamanashi Prefecture Open R&D Center

(Nakakoma-gun, Yamanashi Prefecture)

< 1 G> ・ Tohoku University (Sendai)  ・ NICT Iwate IT Open Laboratory

(Takizawa-mura, Iwate Prefecture) < 100 M> ・ Hachinohe Institute of Technology

(Hachinohe, Aomori Prefecture)  ・ Akita Regional IX * (Akita)  ・ Keio University Tsuruoka Campus

(Tsuruoka, Yamagata Prefecture)  ・ Aizu University (Aizu Wakamatsu)

< 100 M>  ・ Hokkaido Regional Network Association AP * (Sapporo)                

NICT Tsukuba Research Center

20Gbps10Gbps1GbpsOptical testbeds

Core network nodes

Access points

Osaka

Otemachi

USA

NICT Keihannna Human Info-Communications

Research Center

NICT Kita Kyushu IT Open Laboratory

NICT Koganei Headquarters

[Legends ]

*IX:Internet eXchange

AP:Access Point

Page 15: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

GLIF: Global Lambda Integrated Facility

DWDM SURFnet

lambda service path

IP service path

10 Gbit/s

SURFnet10 Gbit/s

SURFnet10 Gbit/s

IEEAF10 Gbit/s

DwingelooASTRON/JIVE

DwingelooASTRON/JIVE

PragueCzechLight

PragueCzechLight

2.5 Gbit/s

NSF10 Gbit/s

LondonUKLightLondonUKLight

StockholmNorthernLightStockholm

NorthernLight

2.5 Gbit/s

New YorkMANLANNew YorkMANLAN

TokyoWIDETokyoWIDE

10 Gbit/s

10Gbit/s

10 Gbit/s

2x10 Gbit/s

IEEAF10 Gbit/s

2x10 Gbit/s

10 Gbit/s

2.5 Gbit/s

2.5 Gbit/s

TokyoAPANTokyoAPAN

GenevaCERN

GenevaCERN

ChicagoChicago AmsterdamAmsterdam

“GLIF is a World Scale Lambda based Lab for Application and Middleware development, where Grid applications ride on dynamically configured networks based on optical wavelengths ... Coexisting with more traditional packet-switched network traffic

4th GLIF Workshop:Nottingham UK Sept. 2004

10 Gbps Wavelengths For R&E Network Development Are Prolifering,

Across Continents and Oceans

Page 16: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

ICFA Standing Committee on Interregional Connectivity (SCIC)

ICFA Standing Committee on Interregional Connectivity (SCIC)

Created by ICFA in July 1998 in VancouverCreated by ICFA in July 1998 in Vancouver CHARGE: CHARGE:

Make recommendations to ICFA concerning the connectivity Make recommendations to ICFA concerning the connectivity between between the Americasthe Americas, Asia and Europe, Asia and Europe

As part of the process of developing theseAs part of the process of developing theserecommendations, the committee should recommendations, the committee should

Monitor traffic Monitor traffic Keep track of technology developmentsKeep track of technology developments Periodically review forecasts of future bandwidth needs Periodically review forecasts of future bandwidth needs Provide early warning of potential problemsProvide early warning of potential problems

Representatives: Major labs, ECFA, ACFA; North AmericanRepresentatives: Major labs, ECFA, ACFA; North American and Latin American Physics Communities and Latin American Physics Communities

Monitoring, Advanced Technologies, and Monitoring, Advanced Technologies, and Digital DivideDigital DivideWorking Groups Formed in 2002Working Groups Formed in 2002

Page 17: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

SCIC in 2003-2004 http://cern.ch/icfa-scic SCIC in 2003-2004 http://cern.ch/icfa-scic

Three 2004 Reports; Presented to ICFA in FebruaryThree 2004 Reports; Presented to ICFA in February

Main Report: “Networking for HENP”Main Report: “Networking for HENP” [H. Newman et al.] [H. Newman et al.] Includes Brief Updates on Monitoring, the Digital Divide Includes Brief Updates on Monitoring, the Digital Divide

and Advanced Technologies [*]and Advanced Technologies [*] A World Network Overview (with 27 Appendices): A World Network Overview (with 27 Appendices):

Status and Plans for the Next Few Years of National & Status and Plans for the Next Few Years of National & Regional Networks, and Optical Network InitiativesRegional Networks, and Optical Network Initiatives

Monitoring Working Group ReportMonitoring Working Group Report [L. Cottrell] [L. Cottrell]

Digital Divide in RussiaDigital Divide in Russia [V. Ilyin] [V. Ilyin]

August 2004 Update Reports at the SCIC Web Site:August 2004 Update Reports at the SCIC Web Site:See http://icfa-scic.web.cern.ch/ICFA-SCIC/documents.htmSee http://icfa-scic.web.cern.ch/ICFA-SCIC/documents.htm

Asia Pacific, Latin America, GLORIAD (US-Ru-Asia Pacific, Latin America, GLORIAD (US-Ru-KoKo-China);-China);Brazil, Korea, ESNet, etc. Brazil, Korea, ESNet, etc.

Page 18: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

SCIC Main Conclusion for 2003Setting the Tone for 2004

SCIC Main Conclusion for 2003Setting the Tone for 2004

The disparity among regions in HENP could increase The disparity among regions in HENP could increase even more sharply, as we learn to use advanced even more sharply, as we learn to use advanced networks effectively, and we develop dynamic Grid networks effectively, and we develop dynamic Grid systems in the “most favored” regions systems in the “most favored” regions

We must take action, and workWe must take action, and work to Close the Digital Divideto Close the Digital Divide To make Physicists from All World Regions Full To make Physicists from All World Regions Full

Partners in Their Experiments; and in the Process Partners in Their Experiments; and in the Process of Discoveryof Discovery

This is essential for the health of our global This is essential for the health of our global experimental collaborations, our plans for future experimental collaborations, our plans for future projects, and our field.projects, and our field.

Page 19: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Cont’d SCIC Focus on the Digital Divide: Several Perspectives

Cont’d SCIC Focus on the Digital Divide: Several Perspectives

Work on Policies and/or Pricing: pk, in, br, SE Europe, …Work on Policies and/or Pricing: pk, in, br, SE Europe, … Find Ways to work with vendors, NRENs, and/or Gov’tsFind Ways to work with vendors, NRENs, and/or Gov’ts Point to Model Cases: e.g. Poland, Slovakia, Czech RepublicPoint to Model Cases: e.g. Poland, Slovakia, Czech Republic

Inter-Regional Projects Inter-Regional Projects GLORIAD,GLORIAD, Russia-China-US Optical Ring Russia-China-US Optical Ring Latin America: Latin America: CHEPREOCHEPREO (US-Brazil); EU (US-Brazil); EU CLARACLARA Project Project Virtual SILK HighwayVirtual SILK Highway Project (DESY): FSU satellite links Project (DESY): FSU satellite links

Workshops and Tutorials/Training SessionsWorkshops and Tutorials/Training Sessions For Example: Digital Divide and HEPGrid Workshop,For Example: Digital Divide and HEPGrid Workshop,

UERJ Rio, Feb. 2004; UERJ Rio, Feb. 2004; Next DD Workshop in Daegu May 2005Next DD Workshop in Daegu May 2005 Help with Modernizing the Infrastructure Help with Modernizing the Infrastructure

Raise Technology Awareness; Help Commission, DevelopRaise Technology Awareness; Help Commission, Develop Provide Tools for Effective Use: Monitoring, CollaborationProvide Tools for Effective Use: Monitoring, Collaboration

Participate in Standards Development; Open ToolsParticipate in Standards Development; Open Tools Advanced TCP stacks; Grid systemsAdvanced TCP stacks; Grid systems

Page 20: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

ICFA Report: Networks for HENPICFA Report: Networks for HENPGeneral Conclusions (2)General Conclusions (2)

ICFA Report: Networks for HENPICFA Report: Networks for HENPGeneral Conclusions (2)General Conclusions (2)

Reliable high Reliable high End-to-end PerformanceEnd-to-end Performance of networked applications such as of networked applications such as large file transfers and Data Grids is required. Achieving this requires:large file transfers and Data Grids is required. Achieving this requires: A coherent approach to End-to-end monitoring extending to all regions A coherent approach to End-to-end monitoring extending to all regions

that allows physicists throughout the world to extract clear information that allows physicists throughout the world to extract clear information Upgrading campus infrastructures.Upgrading campus infrastructures.

To support Gbps data transfers in most HEP centers. One reason for To support Gbps data transfers in most HEP centers. One reason for under-utilization of national and Int’l backbones, is the lack of under-utilization of national and Int’l backbones, is the lack of bandwidth to end-user groups in the campusbandwidth to end-user groups in the campus

Removing local, last mile, and nat’l and int’l bottlenecks Removing local, last mile, and nat’l and int’l bottlenecks end-to-end, whether technical or political in origin. end-to-end, whether technical or political in origin.While National and International backbones have reached 2.5 to While National and International backbones have reached 2.5 to 10 Gbps speeds in many countries, the bandwidths 10 Gbps speeds in many countries, the bandwidths across borders, across borders, the countryside or the city may be much less. the countryside or the city may be much less.

This problem is very widespread in our community, This problem is very widespread in our community, with examples stretching from the Asia Pacific to with examples stretching from the Asia Pacific to Latin America Latin America to the Northeastern U.S. Root causes for this vary, to the Northeastern U.S. Root causes for this vary, from lack from lack of local infrastructure to unfavorable pricing policies. of local infrastructure to unfavorable pricing policies.

Page 21: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

ICFA Report Update (8/2004): Main ICFA Report Update (8/2004): Main Trends Continue, Some AccelerateTrends Continue, Some AccelerateICFA Report Update (8/2004): Main ICFA Report Update (8/2004): Main Trends Continue, Some AccelerateTrends Continue, Some Accelerate

Current generation of 2.5-10 Gbps network backbones and major Int’l Current generation of 2.5-10 Gbps network backbones and major Int’l links arrived in 2-3 Years [US+Europe+Japan; Now links arrived in 2-3 Years [US+Europe+Japan; Now Korea and ChinaKorea and China]] Capability Grew 4 to 100s of Times; Much Faster than Moore’s LawCapability Grew 4 to 100s of Times; Much Faster than Moore’s Law

Proliferation of 10G links across the Atlantic NowProliferation of 10G links across the Atlantic Now Direct result of Falling Network Prices: $ 0.5 – 1M Per Year for 10GDirect result of Falling Network Prices: $ 0.5 – 1M Per Year for 10G

Ability to fully use long 10G paths with TCP continues to advance: Ability to fully use long 10G paths with TCP continues to advance: 7.5 Gbps X 16kkm (August 2004)7.5 Gbps X 16kkm (August 2004)

Technological progress driving equipment costs in end-systems lowerTechnological progress driving equipment costs in end-systems lower ““Commoditization” of Gbit Ethernet (GbE) ~complete: Commoditization” of Gbit Ethernet (GbE) ~complete:

($20-50 per port); 10 GbE commoditization underway($20-50 per port); 10 GbE commoditization underway Move to owned or leased optical nets (us, ca, nl, sk, po, ko, jp) Move to owned or leased optical nets (us, ca, nl, sk, po, ko, jp)

well underway in several areas of the world well underway in several areas of the world Emergence of “Hybrid” Network Model:Emergence of “Hybrid” Network Model: GNEW2004; UltraLight, GLIF GNEW2004; UltraLight, GLIF While there is progress in some less-advantaged regions, theWhile there is progress in some less-advantaged regions, the

gap between the technologically “rich” and “poor” is wideninggap between the technologically “rich” and “poor” is widening

Page 22: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

ICFA SCIC Monitoring WG (L. Cottrell)See www.slac.stanford.edu/grp/scs/net/talk03/icfa-aug04.ppt

Important for policy makers

TCP throughput measured from N. America to World Regions

1

10

100

1000

10000J

an

-95

Ja

n-9

6

De

c-9

6

De

c-9

7

De

c-9

8

De

c-9

9

De

c-0

0

De

c-0

1

De

c-0

2

De

c-0

3

De

c-0

4

Deri

ved

TC

P t

hro

ug

hp

ut

in K

Byte

s/s

ec

1

10

100

1000

10000

China (13)

S.E. Europe (21)

Europe(150) Canada (27)

Russia(17)

Edu (141)

Latin America (37)

India(7) Africa (30)

Mid East (16)

50% Improvement/year~ factor of 10 in < 6 years

C. Asia (8)

From the PingER project, Aug 2004

Caucasus (8)

C. Asia, Russia, SE Europe, L. America, M. East, China:

4-5 yrs behindIndia, Africa: 7 yrs behind

View from CERNConfirms This View

Now monitoring 650 sites in 115 countriesIn last 9 months:

Several sites in Russia (GLORIAD)Many hosts in Africa (27 of 54 Countries) Monitoring sites in Pakistan, Brazil

PingERWorld View Seen from

SLAC

Page 23: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Research Networking in Latin America: August 2004

The only Countries with research The only Countries with research network connectivity now in network connectivity now in Latin America:Latin America:Argentina, Brazil, Chile, Argentina, Brazil, Chile, Mexico, Venezuela Mexico, Venezuela

AmPathAmPath Provided connectivity for Provided connectivity for some South American countriessome South American countries

New New CHEPREOCHEPREO Sao Paolo-Miami Link Sao Paolo-Miami Link at 622 Mbps Starting This Monthat 622 Mbps Starting This Month

New: New: CLARA CLARA (Funded by EU)(Funded by EU) Regional Network Connecting 19 Countries:Regional Network Connecting 19 Countries:

AmPath

Argentina Argentina Dominican Republic Dominican Republic Panama Panama Brasil Brasil Ecuador Ecuador ParaguayParaguayBolivia Bolivia El Salvador El Salvador PeruPeruChile Chile Guatemala Guatemala UruguayUruguayColombia Colombia Honduras Honduras VenezuelaVenezuelaCosta Rica Mexico Costa Rica Mexico NicaraguaNicaraguaCubaCuba

155 Mbps Backbone with 10-45 Mbps Spurs;

4 Mbps Satellite to Cuba; 622 Mbps to Europe

Also NSF Proposals To

Connect at 2.5G to US

Page 24: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

HEPGRID (CMS) in Brazil (Santoro et al.)HEPGRID-CMS/BRAZIL is a project to build a Grid thatAt Regional Level will include CBPF,UFRJ,UFRGS,UFBA, UERJ & UNESPAt International Level will be integrated with CMS Grid based at CERN; focal points include iVGDL/Grid3 and bilateral projects with Caltech Group

France Italy USAGermany BRAZIL622 Mbps

UFRGS

UERJUFRJ

T1

IndividualMachines

On line systems

Brazilian HEPGRID

CBPF

UNESP/USPSPRACE-Working

Gigabit

CERN 2.5 - 10 Gbps

UFBA

UERJ RegionalTier2 Ctr

T4

T0 +T1

T2 T1

T3 T2

UERJ: T2T1,

100500 Nodes;

Plus T2s to

100 Nodes

Page 25: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

1660 km of Dark Fiber CWDM Links, up to 112 km.

1 to 4 Gbps (GbE)

August 2002: First NREN in Europe to establish Int’l GbE Dark Fiber Link, to Austria

April 2003 to Czech Republic.

Planning 10 Gbps Backbone; dark fiber link to Poland this year.

PROGRESS in SE Europe (Sk, Pl, Cz, Hu, …)

Page 26: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International
Page 27: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Dark Fiber in Eastern Europe Poland: PIONIER Network

Dark Fiber in Eastern Europe Poland: PIONIER Network

ŁÓDŹ

TORUŃ

P OZNAŃ

B YDGOS ZCZ

OLS ZTYN

B IAŁYS TOK

GDAŃS K

KOS ZALIN

S ZCZECIN

ZIELONAGÓRA

WROCŁAW

CZĘS TOCHOWA

KRAKÓW RZES ZÓW

LUB LIN

KIELCE

P UŁAWY

RADOM

KATOWICEGLIWICE

B IELS KO-B IAŁA

OP OLE

GUB IN WARS ZAWA

CIES ZYN

S IEDLCE

P IO NIE R n o d e sIn s ta lle d fib e r

F ib e rs p la n n e d in 2 0 0 4P IO NIE R n o d e s p la n n e d in 2 0 0 4

2650 km Fiber 2650 km Fiber Connects 16 MANs; Connects 16 MANs;

to 5200 km and to 5200 km and 21 MANs by 200521 MANs by 2005

Support Support Computational Grids;Computational Grids;

Domain-Specific Domain-Specific Grids Grids

Digital LibrariesDigital Libraries Interactive TVInteractive TV

Add’l Fibers for Add’l Fibers for e-Regional Initiatives e-Regional Initiatives

Page 28: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

The Advantage of Dark Fiber CESNET Case Study (Czech Republic)

The Advantage of Dark Fiber CESNET Case Study (Czech Republic)

Case Study ResultCase Study ResultWavelength ServiceWavelength Service

Vs. Fiber Lease:Vs. Fiber Lease:

Cost Savings of Cost Savings of 50-70% Over 4 Years50-70% Over 4 Years

for Long 2.5G for Long 2.5G or 10G Links or 10G Links

2513 km 2513 km Leased Fibers Leased Fibers (Since 1999) (Since 1999)

1 x 2,5G Leased 1 x 2,5G

(EURO/Month)about 150km (e.g. Ústí n.L. - Liberec) 7,000

about 300km (e.g. Praha - Brno) 8,000

***

4 x 2,5G Leased 4 x 2,5G

(EURO/Month)about 150km (e.g. Ústí n.L. - Liberec) 14,000

about 300km (e.g. Praha - Brno) 23,000

***

1 x 10G Leased 1 x 10G

(EURO/Month)about 150km (e.g. Ústí n.L. - Liberec) 14,000

about 300km (e.g. Praha - Brno) 16,000

***

4 x 10G Leased 4 x 10G

(EURO/Month)about 150km (e.g. Ústí n.L. - Liberec) 29,000

about 300km (e.g. Praha - Brno) 47,000

***

2 x booster 24dBm, 2 x DCF, DWDM 10G2 x (booster +In-line+preampr), 6 x DCF, DWDM 10G

Leased fibre with own equipment (EURO/Month)

5 000 *7 000 **

2 x booster 18dBm 2 x booster 27dBm + 2 x preamp + 6 x DCF

Leased fibre with own equipment (EURO/Month)

12 000 *14 000 **

8 000 **

2 x booster 21dBm, 2 x DCF2 x (booster 21dBm + in-line + preamplifier) + 6 x DCF

2 x booster 24dBm, DWDM 2,5G2 x (booster+In-line+preamp), 6 x DCF, DWDM 2,5G

Leased fibre with own equipment (EURO/Month)

5 000 *

Leased fibre with own equipment (EURO/Month)

8 000 *11 000 **

Page 29: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Asia Pacific Academic Network ConnectivityAsia Pacific Academic Network Connectivity

Access PointExchange PointCurrent Status2004 (plan)

US

Europe

ID

VN

LK

KR

TH

MY

SG

RU

PH

CN

HK

JP2G

12M

34M

45M

20.9G

155M

777M

1.2G

TW

200M

310M

AU

45M`722M

IN

16M

1.5M

1.5M

7.5M2M

2.5M

2M

90M

155M

622M

155M

9.1G

932M(to 21 G)

Better Better North/South Linkages within AsiaNorth/South Linkages within AsiaJP-SG link: 155Mbps in 2005 is proposed to NSF by JP-SG link: 155Mbps in 2005 is proposed to NSF by CIRENCIRENJP- TH link: 2Mbps JP- TH link: 2Mbps 45Mbps in 2004 is being 45Mbps in 2004 is being studied.studied.CIREN is studying an extension to IndiaCIREN is studying an extension to India

Connectivity Connectivity to US from JP, to US from JP, KO, AU is KO, AU is Advancing Advancing Rapidly.Rapidly.

Progress in Progress in the Region, the Region, and to Europe and to Europe is Much is Much Slower Slower

APAN Status July APAN Status July 20042004

Page 30: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

APAN Link Information (1 Of 2) 2004.7.7 [email protected]

Countries Network Bandwidth (Mbps) AUP/RemarkAU-US AARNet 310 to 2 x 10 Gbps soon R&E + CommodityAU-US (PAIX) AARNet 622 R&E + CommodityCN-HK CERNET 622 R&E + CommodityCN-HK CSTNET 155 R&ECN-JP CERNET 155 R&ECN-JP CERNET 45 Native IPv6CN-US CERNET 155 R&E + CommodityCN-US CSTNET 155 R&EHK-US HARNET 45 R&EHK-TW HARNET/TANET/ASNET 100 R&EIN-US/UK ERNET 16 R&EJP-ASIA UDL 9 R&EJP-ID AI3(ITB) 0.5/1.5 R&EJP-KR APII 2Gbps R&EJP-LA AI3 (NUOL) 0.128/0.128 R&EJP-MY AI3(USM) 1.5/0.5 R&EJP-PH AI3(ASTI) 1.5/0.5 R&EJP-PH MAFFIN 6 Research JP-SG AI3(TP) 1.5/0.5 R&EJP-TH AI3(AIT) (service interrupted) R&EJP-TH SINET(ThaiSarn) 2 R&EJP-US TransPac 5 Gbps to 2x10 Gbps soon R&E

Page 31: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Internet in China (J.P.Wu APAN July 2004)

Internet users in China: from 6.8 Million to 78 Million within 6 months

Backbone : 2.5-10G DWDM+RouterInternational links : 20GExchange Points : > 30G ( BJ , SH , GZ )Last Miles Ethernet , WLAN , ADSL , CTV , CDMA , ISDN

, GPRS , Dial-upIP Addresses: 32M ( 1A+233B+146C); Need IPv6

Wireline

Dial Up ISDNBroadband

23.4M 45.0M 4.9M 9.8M

 

Page 32: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

China: CERNET Update1995, 64K Nationwide backbone connecting 8 cities, 100 Universities1998, 2M Nation wide backbone connecting 20 cities, 300 Universities2000, Own dark fiber crossing 30+ major cities and 30,000 kilometers2001, CERNET DWDM/SDH network finished2001, 2.5G/155M Backbone connecting 36 cities, 800 universities2003, 1300+ universities and institutes, over 15 Million Users

Page 33: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

CERNET2 and Key Technologies

CERNET 2: Next Generation Education and Research Network in ChinaCERNET 2 Backbone connecting 15-20 GigaPOPs at 2.5G-10Gbps (I2-like Model)Connecting 200 Universities and 100+ Research Institutes at 1Gbps-10GbpsNative IPv6 and Lambda Networking Support/Deployment of:E2E performance monitoringMiddleware and Advanced ApplicationsMulticast

Page 34: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

APAN-KR : KREONET/KREONet2 IIAPAN-KR : KREONET/KREONet2 II

KREONET 11 Regions, 12 POP Centers Optical 2.5-10G Backbone;

SONET/SDH, POS, ATM National IX Connection

KREONET2 Support for Next Gen. Apps: IPv6, QoS, Multicast;

Bandwidth Alloc. Services StarLight/Abilene Connection

Int’l Links US: 2 X 622 Mbps via CA*Net;

GbE Link via TransPAC; 155 (to 10G) GLORIAD Link

Japan: 2 Gbps TEIN to GEANT: 34 Mbps Singapore (SingAREN): 8 Mbps

SuperSIREN (7 Res. Institutes) Optical 10-40G Backbone High Speed Wireless: 1.25 G Collaborative Environment

Support

Page 35: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

KR-US/CA Transpacific connectionKR-US/CA Transpacific connection

Participation in Global-scale Lambda NetworkingParticipation in Global-scale Lambda Networking Two STM-4 circuits (1.2G) : KR-CA-USTwo STM-4 circuits (1.2G) : KR-CA-US Global lambda networking : North America, Europe, Global lambda networking : North America, Europe,

Asia Pacific, etc.Asia Pacific, etc.

STM-4 * 2

Seattle

APII-testbed/KREONet2

KREONET/SuperSIReNCA*Net4

Global Lambda Networking

StarLight

Chicago

PacWave

Page 36: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

New Record: 916 Mbps from New Record: 916 Mbps from CHEP/KNU CHEP/KNU to Caltech to Caltech (UDP KOREN-TransPAC-Caltech, (UDP KOREN-TransPAC-Caltech, 22/06/’04)22/06/’04) Date: Tue, 22 Jun 2004 13:47:25 +0900Date: Tue, 22 Jun 2004 13:47:25 +0900

From: Kihwan Kwon From: Kihwan Kwon To: Dongchul Son <[email protected]>To: Dongchul Son <[email protected]>[root@sul Iperf]# ./iperf -c socrates.cacr.caltech.edu[root@sul Iperf]# ./iperf -c socrates.cacr.caltech.edu

-u -b 1000m -u -b 1000m ------------------------------------------------------------------------------------------------------------------------Client connecting to socrates.cacr.caltech.edu, UDP port 5001Client connecting to socrates.cacr.caltech.edu, UDP port 5001Sending 1470 byte datagrams; UDP buffer size: 64.0 KByte Sending 1470 byte datagrams; UDP buffer size: 64.0 KByte ------------------------------------------------------------------------------------------------------------------------[ 5] local 155.230.20.20 port 33036 connected with [ 5] local 155.230.20.20 port 33036 connected with

131.215.144.227131.215.144.227[ ID] Interval Transfer Bandwidth[ ID] Interval Transfer Bandwidth[ 5] 0.0-2595.2 sec 277 GBytes 916 Mbits/sec[ 5] 0.0-2595.2 sec 277 GBytes 916 Mbits/sec

USA TransPACUSA TransPAC

G/H-JapanG/H-JapanKNU/KoreaKNU/Korea

Max. 947.3Mbps

Page 37: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

OC3 circuits Moscow-Chicago-OC3 circuits Moscow-Chicago-Beijing since January 2004Beijing since January 2004

OC3 circuit Moscow-Beijing July OC3 circuit Moscow-Beijing July 2004 (completes the ring)2004 (completes the ring)

Korea (KISTI) joining US, Russia, Korea (KISTI) joining US, Russia, China as full partner in GLORIADChina as full partner in GLORIAD

Plans for Central Asian extension, Plans for Central Asian extension, with Kyrgyz Gov’twith Kyrgyz Gov’t

Rapid traffic growth with heaviest Rapid traffic growth with heaviest US use from DOE (FermiLab), US use from DOE (FermiLab), NASA, NOAA, NIH and 260+ Univ. NASA, NOAA, NIH and 260+ Univ. (UMD, IU, UCB, UNC, UMN… (UMD, IU, UCB, UNC, UMN… Many Others) Many Others)

GLORIAD 5-year Proposal Pending (with US NSF) for expansion: 2.5G Moscow-GLORIAD 5-year Proposal Pending (with US NSF) for expansion: 2.5G Moscow-Amsterdam-Chicago-Seattle-Hong Kong-Pusan-Beijing circuits early 2005; 10G Amsterdam-Chicago-Seattle-Hong Kong-Pusan-Beijing circuits early 2005; 10G ring around northern hemisphere 2007; multiple wavelength service 2009 – ring around northern hemisphere 2007; multiple wavelength service 2009 – providing hybrid circuit-switched (primarily Ethernet) and routed servicesproviding hybrid circuit-switched (primarily Ethernet) and routed services

> 5TBytes now transferred monthly via GLORIAD to US, Russia, China

Global Ring Network for Advanced Applications Development

Aug. 8 2004: P.K. Young, Korean IST

Advisor to President Announces

Korea Joining GLORIAD TEIN gradually to 10G, connected to GLORIAD Asia Pacific Info. Infra- Structure (1G) will be

backup net to GLORIAD

Page 38: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

AFRICA:AFRICA: NectarNet Initiative NectarNet Initiative

Growing Need to connect academic researchers, medicalGrowing Need to connect academic researchers, medicalresearchers & practitioners to many sites in Africaresearchers & practitioners to many sites in Africa

ExamplesExamples:: CDC & NIH: Global AIDS Project, Dept. of Parasitic Diseases,CDC & NIH: Global AIDS Project, Dept. of Parasitic Diseases,

Nat’l Library of Medicine (Ghana, Nigeria)Nat’l Library of Medicine (Ghana, Nigeria) Gates $ 50M HIV/AIDS Center in BotswanaGates $ 50M HIV/AIDS Center in Botswana; Project Coord at Harvard; Project Coord at Harvard Africa Monsoon AMMA Project, Dakar Site [cf. East US Hurricanes]Africa Monsoon AMMA Project, Dakar Site [cf. East US Hurricanes] US Geological Survey: Global Spatial Data InfrastructureUS Geological Survey: Global Spatial Data Infrastructure Distance Learning: Emory-Ibadan (Nigeria); Research ChannelDistance Learning: Emory-Ibadan (Nigeria); Research Channel

But Africa is HardBut Africa is Hard: : 11M Sq. Miles, 600 M People, 54 Countries11M Sq. Miles, 600 M People, 54 Countries Little Telecommunications InfrastructureLittle Telecommunications Infrastructure

Approach:Approach: Use SAT-3/WASC Cable (to Portugal), GEANT Across Europe, Use SAT-3/WASC Cable (to Portugal), GEANT Across Europe, AMS-NY Link Across Atlantic, Peer with Abilene in NYC AMS-NY Link Across Atlantic, Peer with Abilene in NYC Cable Landings in 8 West African Countries and South AfricaCable Landings in 8 West African Countries and South Africa Pragmatic approach to reach end points: VSAT,ADSL,microwave, etc.Pragmatic approach to reach end points: VSAT,ADSL,microwave, etc.

W. MatthewsGeorgia

Tech

Note: World Conference on Physics and Sustainable Development,

10/31 – 11/2/05 in Durban South Africa; Part of World Year of Physics 2005.

Sponsors: UNESCO, ICTP, IUPAP, APS, SAIP

Page 39: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Sample Bandwidth Costs for African Universities

$0.27

$3.00

$6.77

$9.84

$11.03

$20.00

$0.00 $5.00 $10.00 $15.00 $20.00 $25.00

USA

IBAUD Target

Ghana

Uganda

Average

Nigeria

$/kbps/month

Sample size of 26 universitiesAverage Cost for VSAT service: Quality, CIR, Rx, Tx not distinguished

Bandwidth prices in Africa vary dramatically; are in general many times what they could be if universities purchase in volume

Roy Steiner Internet2 Workshop

Avg. Unit Cost is 40X US Avg.; Cost is Several Hundred Times, Compared to Leading Countries

Page 40: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

HEP Active in the World Summit on the Information Society 2003-2005HEP Active in the World Summit on the Information Society 2003-2005

WSIS I (Geneva 12/03): CERN RSIS WSIS I (Geneva 12/03): CERN RSIS Event, SIS Forum, CERN/Caltech Event, SIS Forum, CERN/Caltech Online Stand Online Stand

Visitors at WSIS I Visitors at WSIS I Kofi Annan, UN Sec’y General Kofi Annan, UN Sec’y General John H. Marburger, Science John H. Marburger, Science

Adviser to US PresidentAdviser to US PresidentIon Iliescu, President of Ion Iliescu, President of

Romania, …Romania, … Planning Now Underway forPlanning Now Underway for WSIS II: Tunis 2005 WSIS II: Tunis 2005

GOAL: To Create an “Information Society”. GOAL: To Create an “Information Society”. Common Definition Adopted (Tokyo Declaration, January Common Definition Adopted (Tokyo Declaration, January

2003):2003):“… One in which highly developed ICT networks, equitable and “… One in which highly developed ICT networks, equitable and

ubiquitous access to information, appropriate content in ubiquitous access to information, appropriate content in accessible accessible formats and effective communication can help formats and effective communication can help people achieve their people achieve their potential”potential”Kofi Annan Challenged the Scientific Community to Help (3/03)Kofi Annan Challenged the Scientific Community to Help (3/03)

Page 41: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Role of Sciences in Information Society. Palexpo, Geneva 12/2003

Role of Sciences in Information Society. Palexpo, Geneva 12/2003

Demos at the CERN/Caltech Demos at the CERN/Caltech RSIS Online StandRSIS Online Stand

Advanced network and Advanced network and Grid-enabled analysis Grid-enabled analysis

Monitoring very large scale Monitoring very large scale Grid farms with MonALISAGrid farms with MonALISA

World Scale multisite multi-protocol World Scale multisite multi-protocol videoconference with VRVSvideoconference with VRVS

(Europe-US-Asia-South America) (Europe-US-Asia-South America) Distance diagnosis and surgery using Distance diagnosis and surgery using

Robots with “haptic” feedback Robots with “haptic” feedback (Geneva-Canada)(Geneva-Canada)

Music Grid: live performances with Music Grid: live performances with bands at St. John’s, Canada and the bands at St. John’s, Canada and the Music Conservatory of Geneva on Music Conservatory of Geneva on stagestage

VRVS 37k hostsVRVS 37k hosts106 Countries106 Countries

2-3X Growth/Year2-3X Growth/Year

Page 42: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

29 sites (U.S., Korea) to ~3000 CPUs to ~1200 Concurrent Jobs

Korea

www.ivdgl.org/grid2003

Grid3: An Operational Production Grid3: An Operational Production Grid, Since October 2003Grid, Since October 2003

Trillium: PPDGGriPhyNiVDGL

Prelude to Open Science Grid: www.opensciencegrid.org

Also LCG and EGEE

Project

Page 43: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

The original Computational and Data Grid concepts are The original Computational and Data Grid concepts are based on largely stateless, open systems based on largely stateless, open systems

Analogous to the WebAnalogous to the WebThe classical Grid architecture had a number of implicit The classical Grid architecture had a number of implicit

assumptionsassumptions The ability to locate and schedule suitable resources,The ability to locate and schedule suitable resources,

within a tolerably short time (i.e. resource richness) within a tolerably short time (i.e. resource richness) Short transactions with relatively simple failure modesShort transactions with relatively simple failure modes

HENP Grids are HENP Grids are Data Intensive & Resource-ConstrainedData Intensive & Resource-Constrained Resource usage governed by local and global policiesResource usage governed by local and global policies Long transactions; some long queuesLong transactions; some long queues

Grid-Enabled Analysis:Grid-Enabled Analysis: 1000s of users compete for resources 1000s of users compete for resources at dozens of sites: Complex scheduling; management at dozens of sites: Complex scheduling; management

HENP HENP Stateful, End-to-end Monitored and Tracked ParadigmStateful, End-to-end Monitored and Tracked Paradigm Adopted in OGSA [Now WS Resource Framework]Adopted in OGSA [Now WS Resource Framework]

HENP Data Grids, and Now HENP Data Grids, and Now Services-Oriented GridsServices-Oriented Grids

Page 44: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Managing Global Systems: Dynamic Managing Global Systems: Dynamic Scalable Services ArchitectureScalable Services Architecture

MonALISA: http://monalisa.cacr.caltech.edu

““Station Server” Station Server” Services-enginesServices-engines at sites host many at sites host many“Dynamic Services”“Dynamic Services” Scales to Scales to

thousands of thousands of service-Instancesservice-Instances

Servers autodiscover Servers autodiscover and interconnect and interconnect dynamically to form dynamically to form a robust fabric a robust fabric

Autonomous agentsAutonomous agents

+ CLARENS: Web Services Fabric and Portal Architecture

24 X 7 Operations24 X 7 OperationsMultiple Orgs.Multiple Orgs.

Grid2003Grid2003 US CMSUS CMS CMS-DC04CMS-DC04 ALICEALICE STARSTAR VRVSVRVS ABILENEABILENE GEANTGEANT + GLORIAD+ GLORIAD

Page 45: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

45Caltech GAE Team

Grid-Enabled Analysis EnvironmentGrid-Enabled Analysis Environment

Analysis Clients talk standard protocols to the CLARENS “Grid Services Web Server”, with a simple Web service API

The secure Clarens portal hides the complexity of the Grid Services from the client

Key features: Global Scheduler, Catalogs, Monitoring, and Grid-wide Execution service;Clarens servers forma Global Peer to peer Network

SchedulerCatalogs

Analysis Client

Grid ServicesWeb Server

ExecutionPriority

Manager

Grid WideExecutionService

DataManagement

Fully-ConcretePlanner

Fully-AbstractPlanner

Analysis Client

AnalysisClient

Virtual Data

Replica

ApplicationsMonitoring

Partially-AbstractPlanner

Metadata

HTTP, SOAP, XML/RPC

CLARENS: Web Services Architecture

Page 46: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Integrated hybrid experimental network, leveraging Transatlantic Integrated hybrid experimental network, leveraging Transatlantic R&D network partnerships; packet-switched + dynamic optical paths R&D network partnerships; packet-switched + dynamic optical paths 10 GbE across US and the Atlantic: NLR, DataTAG, TransLight, 10 GbE across US and the Atlantic: NLR, DataTAG, TransLight,

NetherLight, UKLight, etc.; Extensions to Japan, Taiwan, BrazilNetherLight, UKLight, etc.; Extensions to Japan, Taiwan, Brazil End-to-end monitoring; Realtime tracking and optimization; End-to-end monitoring; Realtime tracking and optimization;

Dynamic bandwidth provisioningDynamic bandwidth provisioning Agent-based services spanning all layers of the system,Agent-based services spanning all layers of the system, from the from the

optical cross-connects to the applications.optical cross-connects to the applications.

UltraLight Collaboration:UltraLight Collaboration:http://ultralight.caltech.eduhttp://ultralight.caltech.edu

Caltech, UF, FIU, UMich, SLAC,FNAL,CERN, UERJ(Rio), NLR, CENIC, UCAID,Translight, UKLight, Netherlight, UvA, UCLondon, KEK, Taiwan

Cisco, Level(3)

Page 47: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

NEWS: Bulletin: ONE TWOWELCOME BULLETIN General InformationRegistrationTravel Information Hotel RegistrationParticipant List How to Get UERJ/Hotel Computer AccountsUseful Phone Numbers ProgramContact us: Secretariat Chairmen

 CLAF  CNPQ FAPERJ        UERJ

SPONSORS

HEPGRID and Digital Divide Workshop

UERJ, Rio de Janeiro, Feb. 16-20 2004Theme: Global Collaborations, Grids

and Their Relationship to the Digital Divide

For the past three years the SCIC has focused on understanding and seeking the means of reducing or eliminating the Digital Divide. It proposed to ICFA that these issues, as they affect our field of High Energy Physics, be

brought to our community for discussion. This led to ICFA’s approval, in July 2003, of the

Digital Divide and HEP Grid Workshop. 

Review of R&E Networks; Major Grid Projects

Perspectives on Digital Divide Issues by Major HEP Experiments, Regional Representatives

Focus on Digital Divide Issues in Latin America; Relate to Problems in Other Regions

More Info: http://www.lishep.uerj.br

TutorialsC++Grid TechnologiesGrid-Enabled

AnalysisNetworksCollaborative Systems

Sessions &Tutorials Available

(w/Video) on the Web

Page 48: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Computing Model Progress CMS Internal Review of Software and Computing

International ICFA Workshop on HEP International ICFA Workshop on HEP Networking, Grids and Digital Divide Networking, Grids and Digital Divide Issues for Global e-ScienceIssues for Global e-Science

Dates: May 23-27, 2005

Venue: Daegu, Korea

Dongchul SonCenter for High Energy PhysicsKyungpook National University

ICFA, Beijing, ChinaAug. 2004 Approved by

ICFA August 20, 2004

Page 49: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

고에너지물리연구센터 CENTER FOR HIGH ENERGY PHYSICS

International ICFA Workshop on HEP International ICFA Workshop on HEP Networking, Grids Networking, Grids and Digital Divide Issues for Global e-Scienceand Digital Divide Issues for Global e-Science

ThemesNetworking, Grids, and Their Relationship to the Digital Divide for

HEP as Global e-ScienceFocus on Key Issues of Inter-regional Connectivity

Workshop Goals Review the current status, progress and barriers to the effective use

of the major national, continental and transoceanic networks used by HEP

Review progress, strengthen opportunities for collaboration, and explore the means to deal with key issues in Grid computing and Grid-enabled data analysis, for high energy physics and other fields of data intensive science, now and in the future

Exchange information and ideas, and formulate plans to develop solutions to specific problems related to the Digital Divide in various regions, with a focus on Asia Pacific, as well as Latin America, Russia and Africa

Continue to advance a broad program of work on reducing or eliminating the Digital Divide, and ensuring global collaboration, as related to all of the above aspects.

Page 50: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Networks and Grids for HENP and Global Science

Networks and Grids for HENP and Global Science

Network backbones and major links used by major experimentsNetwork backbones and major links used by major experiments in HENP and other fields are advancing rapidly in HENP and other fields are advancing rapidly

To the 10 G range in < 3 years; much faster than Moore’s LawTo the 10 G range in < 3 years; much faster than Moore’s Law New HENP and DOE Roadmaps: a factor ~1000 improvement per decadeNew HENP and DOE Roadmaps: a factor ~1000 improvement per decade Important advances in Asia-Pacific, notably Korea, Japan, ChinaImportant advances in Asia-Pacific, notably Korea, Japan, China

We are learning to use long distance 10 Gbps networks effectively We are learning to use long distance 10 Gbps networks effectively 2004 Developments: to 7.5 Gbps flows with TCP over 16 kkm2004 Developments: to 7.5 Gbps flows with TCP over 16 kkm

A transition to community-owned and operated R&E networks (us, ca, nl, pl, A transition to community-owned and operated R&E networks (us, ca, nl, pl, cz, sk, co, jp …); A new generation of “hybird” optical networks is emergingcz, sk, co, jp …); A new generation of “hybird” optical networks is emerging

We Must Work to Close to Digital DivideWe Must Work to Close to Digital Divide To Allow Scientists and Students from All World Regions To Allow Scientists and Students from All World Regions

to Take Part in Discoveries at the Frontiers of Science to Take Part in Discoveries at the Frontiers of Science Removing Regional, Last Mile, Local Bottlenecks and Removing Regional, Last Mile, Local Bottlenecks and

Compromises in Network Quality are now On Compromises in Network Quality are now On the Critical Path the Critical Path Important ExamplesImportant Examples on the Road to Progress in Closing the Digital Divide on the Road to Progress in Closing the Digital Divide

CLARA, CHEPREO, and Brazil HEP Grid in Latin AmericaCLARA, CHEPREO, and Brazil HEP Grid in Latin America Optical Networking in Central and Southeast Europe Optical Networking in Central and Southeast Europe APAN Links in the Asia PacificAPAN Links in the Asia Pacific Leadership and Outreach: HEP Groups in Korea, Japan, US and EuropeLeadership and Outreach: HEP Groups in Korea, Japan, US and Europe

Page 51: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Extra Slides FollowExtra Slides Follow

Page 52: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

ATLAS CMS

LHC Global CollaborationsLHC Global Collaborations

CMS 1980 Physicists and Engineers

36 Countries, 161 Institutions

Page 53: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

SC2004: HEP Network LayoutPreview of Future Grid systems

SC2004: HEP Network LayoutPreview of Future Grid systems

Joint Caltech, CERN, SLAC, Joint Caltech, CERN, SLAC, FNAL, UKlight, HP, Cisco… DemoFNAL, UKlight, HP, Cisco… Demo

6 to 8 10 Gbps waves to HEP6 to 8 10 Gbps waves to HEP setup on the show floor setup on the show floor

Bandwidth challenge: aggregate Bandwidth challenge: aggregate throughput goal throughput goal of 40 to 60 Gbps of 40 to 60 Gbps

3*10GbpsTeraGrid

Australia

JapanBrazil

SLACUK

10 GbpsAbilene

10 GbpsNLR

2*10 GbpsNLR

Caltech CACR CERN

Geneva

StarLight

LA

10 GbpsLHCNet 2 Metro

10 Gbps Waves LA-Caltech

FNAL

Page 54: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

18 State Dark Fiber Initiatives

In the U.S. (As of 3/04)

California (CALREN), Colorado (FRGP/BRAN)Connecticut Educ. Network,Florida Lambda Rail, Indiana (I-LIGHT), Illinois (I-WIRE), Md./DC/No. Virginia (MAX),Michigan, Minnesota, NY + New England (NEREN), N. Carolina (NC LambdaRail), Ohio (Third Frontier Net) Oregon, Rhode Island (OSHEAN), SURA Crossroads (SE U.S.), Texas,Utah, Wisconsin

FiberCO

The Move to Dark Fiber is Spreading

Page 55: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Grid and Network Workshopat CERN March 15-16, 2004

Grid and Network Workshopat CERN March 15-16, 2004

WORKSHOP GOALS Share and challenge the lessons learned by nat’l and

international projects in the past three years; Share the current state of network engineering and

infrastructure and its likely evolution in the near future; Examine our understanding of the networking needs of

Grid applications (e.g., see the ICFA-SCIC reports); Develop a vision of how network engineering and

infrastructure will (or should) support Grid computing needs in the next three years.

CONCLUDING STATEMENT

"Following the 1st International Grid Networking Workshop(GNEW2004) that was held at CERN and co-organized byCERN/DataTAG, DANTE, ESnet, Internet2 & TERENA, there is a wide consensus that hybrid network services capable ofoffering both packet- and circuit/lambda-switching as well as highly advanced performance measurements and a newgeneration of distributed system software, will be required inorder to support emerging data intensive Grid applications, Such as High Energy Physics, Astrophysics, Climate andSupernova modeling, Genomics and Proteomics, requiring 10-100 Gbps and up over wide areas."

Page 56: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International
Page 57: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

HENP Lambda Grids:Fibers for Physics

HENP Lambda Grids:Fibers for Physics

Problem: Extract “Small” Data Subsets of 1 to 100 Terabytes Problem: Extract “Small” Data Subsets of 1 to 100 Terabytes from 1 to 1000 Petabyte Data Storesfrom 1 to 1000 Petabyte Data Stores

Survivability of the HENP Global Grid System, with Survivability of the HENP Global Grid System, with hundreds of such transactions per day (circa 2007)hundreds of such transactions per day (circa 2007)requires that each transaction be completed in a requires that each transaction be completed in a relatively short time. relatively short time.

Example: Take 800 secs to complete the transaction. ThenExample: Take 800 secs to complete the transaction. Then Transaction Size (TB)Transaction Size (TB) Net Throughput (Gbps)Net Throughput (Gbps) 1 101 10 10 10010 100 100 1000 (Capacity of 100 1000 (Capacity of

Fiber Today) Fiber Today) Summary: Providing Switching of 10 Gbps wavelengthsSummary: Providing Switching of 10 Gbps wavelengths

within ~2-4 years; and Terabit Switching within 5-8 years within ~2-4 years; and Terabit Switching within 5-8 years would enable “Petascale Grids with Terabyte transactions”,would enable “Petascale Grids with Terabyte transactions”,to fully realize the discovery potential of major HENP programs, to fully realize the discovery potential of major HENP programs, as well as other data-intensive research.as well as other data-intensive research.

Page 58: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

SCIC in 2003-2004http://cern.ch/icfa-scic

SCIC in 2003-2004http://cern.ch/icfa-scic

Strong Focus on the Strong Focus on the Digital DivideDigital Divide Continues Continues A Striking Picture Continues to Emerge: Remarkable A Striking Picture Continues to Emerge: Remarkable

Progress in Some Regions, and a Deepening Digital Progress in Some Regions, and a Deepening Digital Divide Among NationsDivide Among Nations

IntensiveIntensive Work in the Field: > 60 Meetings and Workshops: Work in the Field: > 60 Meetings and Workshops: E.g., Internet2, TERENA, AMPATH, APAN, CHEP2003, SC2003, E.g., Internet2, TERENA, AMPATH, APAN, CHEP2003, SC2003,

Trieste, Telecom World 2003, SC2003, WSIS/RSIS, GLORIAD Trieste, Telecom World 2003, SC2003, WSIS/RSIS, GLORIAD LaunchLaunch, Digital Divide and HEPGrid Workshop (Feb. 16-20 in , Digital Divide and HEPGrid Workshop (Feb. 16-20 in Rio), Rio), GNEW2004, GridNets2004, NASA ONT Workshop, … etc. GNEW2004, GridNets2004, NASA ONT Workshop, … etc.

33rdrd Int’l Grid Workshop in Daegu (August 26-28, 2004); Plan for Int’l Grid Workshop in Daegu (August 26-28, 2004); Plan for 22ndnd ICFA Digital Divide and Grid Workshop in Daegu (May 2005) ICFA Digital Divide and Grid Workshop in Daegu (May 2005)

HENP increasingly visible to governments; heads of state:HENP increasingly visible to governments; heads of state: Through Network advances (records), Grid developments,Through Network advances (records), Grid developments,

Work on the Digital Divide and issues of Global Collaboration Work on the Digital Divide and issues of Global Collaboration Also through the World Summit on the Information Society Also through the World Summit on the Information Society

Process. Next Step is Process. Next Step is WSIS II in TUNIS November 2005WSIS II in TUNIS November 2005

Page 59: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Coverage Now monitoring 650 sites in 115 countries In last 9 months added:

Several sites in Russia (thanks GLORIAD)Many hosts in Africa (5 36 now; in 27 out of 54 countries)Monitoring sites in Pakistan and Brazil (Sao Paolo and Rio)

Working to install monitoring host in Bangalore, India

Monitoring siteRemote site

Page 60: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Achieving throughput User can’t achieve throughput available (Wizard gap)

TCP Stack, End-System and/or Local, Regional, Nat’l Network Issues

Big step just to know what is achievable(e.g. 7.5 Gbps over 16 kkm Caltech-CERN)

Page 61: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Latin America: CLARA Network (2004-2006 EU Project)

Significant contribution from European Comission and Dante through ALICE project

NRENs in 18 LA countries forming a regional network for collaboration traffic

Initial backbone ring bandwidth f 155 Mbps

Spur links at 10 to 45 Mbps (Cuba at 4 Mbps by satellite)

Initial connection to Europe at 622 Mbps from Brazil

Tijuana (Mexico) PoP soon to be connected to US through dark fibre link (CUDI-CENIC) access to US, Canada and Asia -

Pacific Rim

Page 62: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

To East Coast

ClaraClara

To West Coast

to West Coast to East Coast

to Europ

eNSF IRNC 2004: Two Proposals to

Connect CLARA to the US (and Europe)1st Proposal: FIU and CENIC

2nd Proposal: Indiana and Internet2

Note: CHEPREO (FIU, UF, FSU Caltech, UERJ, USP, RNP)

622 Mbps Sao Paolo – Miami Link Started in August

Page 63: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

GIGA Project: Experimental Gbps Network: Sites in Rio and Sao Paolo

FapesptelcosUnesp

USP – IncorUSP - C.Univ.

CPqDLNLS

Unicamp

LNCC

CPTEC UFF

CTAINPE

CBPFLNCC

FiocruzIME

IMPA-RNP

PUC-Rio telcosUERJUFRJ

UniversitiesIMEPUC-RioUERJUFFUFRJUnespUnicampUSP

R&D CentresCBPF - physicsCPqD - telecomCPTEC - meteorologyCTA - aerospaceFiocruz - healthIMPA - mathematicsINPE - space sciencesLNCC - HPCLNLS - physics

About 600 km extension - not to scale

Slide from M. Stanton

Page 64: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Maceió

João Pessoa

“This is wonderful NEWS!our colleagues from Salvador-Bahia will can start to workwith us on CMS.”

Extension of the GIGA Project Using 3000 km of dark fiber.

“A good and real Advancement for Science in Brazil” – A. Santoro.

GIGA Project in Rio and Sao Paolo

Page 65: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Subject Argentina Brazil Chile Colombia Costa Rica

Equator Mexico

Astrophysics

e-VLBI

High Energy Physics

Geosciences

Marine sciences

Health and Biomedical applications

Environmental studies

Latin America Science Areas Interested in Improving Connectivity ( by Country)

Networks and Grids: The Potential to Spark a New Era of Science in Latin America

Page 66: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

Trans-Eurasia Information NetworkTEIN (2004-2007)

Trans-Eurasia Information NetworkTEIN (2004-2007)

Circuit between KOREN(Korea) and RENATER(France). Circuit between KOREN(Korea) and RENATER(France). AP Beneficiaries: AP Beneficiaries:

China, Indonesia, Malaysia, Philippines, Thailand, VietnamChina, Indonesia, Malaysia, Philippines, Thailand, Vietnam (Non-beneficiaries: (Non-beneficiaries: Brunei, Japan, Korea, SingaporeBrunei, Japan, Korea, Singapore EU partners: EU partners: NRENs of France, Netherlands, UKNRENs of France, Netherlands, UK The scope expanded to South-East Asia and China recently. The scope expanded to South-East Asia and China recently. Upgraded to 34 Mbps in 11/2003. Upgrade to 155Mbps planned Upgraded to 34 Mbps in 11/2003. Upgrade to 155Mbps planned

12M Euro EU Funds12M Euro EU Funds Coordinating PartnerCoordinating Partner

DANTE DANTE Direct EU-AP Link; Direct EU-AP Link;

Other Links go Other Links go Across the USAcross the US

Page 67: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

AFRICA: Key TrendsAFRICA: Key Trends

Growth in traffic and lack of infrastructure Growth in traffic and lack of infrastructure Predominance of Satellite;Predominance of Satellite;But these satellites are heavily subscribed But these satellites are heavily subscribed

Int’l Links: Only ~1% of traffic on links is for Internet connections;Int’l Links: Only ~1% of traffic on links is for Internet connections;Most Internet traffic (for ~80% of countries) via satelliteMost Internet traffic (for ~80% of countries) via satellite Flourishing Grey market for Internet & VOIP traffic using VSAT dishesFlourishing Grey market for Internet & VOIP traffic using VSAT dishes

Many Regional fiber projects in “planning phase” (some languished in Many Regional fiber projects in “planning phase” (some languished in the past); Only links from South Africa to Nimibia, Botswana done so far the past); Only links from South Africa to Nimibia, Botswana done so far

Int’l fiber Project: SAT-3/WASC/SAFE Cable from South Africa to PortugalInt’l fiber Project: SAT-3/WASC/SAFE Cable from South Africa to PortugalAlong West Coast of AfricaAlong West Coast of Africa Supplied by Alcatel to Worldwide Consortium of 35 CarriersSupplied by Alcatel to Worldwide Consortium of 35 Carriers 40 Gbps by Mid-2003; Heavily Subscribed. Ultimate Capacity 120 Gbps40 Gbps by Mid-2003; Heavily Subscribed. Ultimate Capacity 120 Gbps Extension to Interior Mostly by Satellite: < 1 Mbps to ~100 Mbps typical Extension to Interior Mostly by Satellite: < 1 Mbps to ~100 Mbps typical

M. Jensen and P. Hamilton Infrastructure Report, March 2004

Page 68: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

APAN Recommendations(July 2004 Meeting in CAIRNS, Au)

APAN Recommendations(July 2004 Meeting in CAIRNS, Au)

Central Issues for APAN this decadeCentral Issues for APAN this decade Stronger linkages between applications and infrastructure - Stronger linkages between applications and infrastructure -

neither can exist independently; also among APAN members. neither can exist independently; also among APAN members. Continuing focus on APAN as an organization that represents Continuing focus on APAN as an organization that represents

infrastructure interests in Asiainfrastructure interests in Asia Closer connection between APAN the infrastructure & Closer connection between APAN the infrastructure &

applications organization, and regional political organizations applications organization, and regional political organizations (e.g. APEC, ASEAN)(e.g. APEC, ASEAN)

New issues demand attentionNew issues demand attention Application measurement, particularly end-to-end Application measurement, particularly end-to-end

network performance measurement (for deterministic network performance measurement (for deterministic networking)networking)

Security now a consideration for every application Security now a consideration for every application and every network.and every network.

Page 69: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

APAN Link Information (2 Of 2) 2004.7.7 [email protected]

Countries Network Bandwidth (Mbps) AUP/Remark(JP)-US-EU SINET 155 R&E / No TransitJP-US SINET 5 Gbps R&E / No TransitJP-US IEEAF 10Gbps R&E wave serviceJP-US IEEAF 622 R&EJP-US Japan-Hawaii 155 R&EJP-VN AI3(IOIT) 1.5/0.5 R&EKR-FR KOREN/RENATER 34 Research (TEIN) KR-SG APII 8 R&EKR-US KOREN/KREONet2 1.2Gbps R&ELK-JP LEARN 2.5 R&E MY-SG NRG/SICU 2 Experiment (Down)SG-US SingaREN 90 R&ETH-US Uninet 155 R&E TW-HK ASNET/TANET/TWAREN 622 R&ETW-JP ASNET/TANET 622 R&ETW-SG ASNET/SingAREN 155 R&ETW-US ASNET/TANET/TWAREN 6.6 Gbps R&E(TW)-US-NL ASNET/TANET/TWAREN 2.5 Gbps R&E

Page 70: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

APAN China ConsortiumAPAN China Consortium Has been established in 1999.  The China Education and Research Has been established in 1999.  The China Education and Research

Network (Network (CERNETCERNET), the Natural Science Foundation of China ), the Natural Science Foundation of China Network (Network (NSFCNETNSFCNET) and the China Science and Technology ) and the China Science and Technology Network (Network (CSTNETCSTNET) are the main three advanced networks. ) are the main three advanced networks.

CERNet

2.5 Gbps

NSFCnetTsinghua --- Tsinghua UniversityPKU --- Peking UniversityNSFC --- Natural Science Foundation of ChinaCAS --- China Academy of SciencesBUPT --- Beijing Univ. of Posts and Telecom.BUAA --- Beijing Univ. of Aero- and Astronautics

Page 71: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

GLORIAD and HENP Example:GLORIAD and HENP Example:Network Needs of IHEP Beijing Network Needs of IHEP Beijing

ICFA SCIC Report: Appendix 18, on Network Needs ICFA SCIC Report: Appendix 18, on Network Needs for HEP in China (See for HEP in China (See http://cern.ch/icfa-scichttp://cern.ch/icfa-scic))

““IHEP is working with the Computer Network Information Center (CNIC) and other universities and institutes to build Grid applications for the experiments. The computing resources and storage management systems are being built or upgraded in the Institute. IHEP has a 100 Mbps link to CNIC, so it is quite easy

to connect to GLORIAD and the link could be upgraded as needed.” Prospective Network Needs for IHEP Bejing

Experiment Year 2004-2005 Year 2006 and on

LHC/LCG 622Mbps 2.5Gbps

BES 100Mbps 155Mbps

YICRO 100Mbps 100Mbps

AMS 100Mbps 100Mbps

Others 100Mbps 100Mbps

Total (Sharing) 1Gbps 2.5Gbps

Page 72: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

World Summit on the Information Society(WSIS): Geneva 12/2003 and Tunis in 2005 World Summit on the Information Society

(WSIS): Geneva 12/2003 and Tunis in 2005 The UN General Assembly adopted in 2001 a resolution The UN General Assembly adopted in 2001 a resolution

endorsing the organization of the endorsing the organization of the World Summit on the World Summit on the Information Society (WSIS),Information Society (WSIS), under UN Secretary-General, under UN Secretary-General, Kofi Annan, with the ITU and host governments taking Kofi Annan, with the ITU and host governments taking the lead role in its preparation. the lead role in its preparation.

GOAL: To Create an Information Society:GOAL: To Create an Information Society: A Common Definition was adoptedA Common Definition was adoptedin the “Tokyo Declaration” of January 2003:in the “Tokyo Declaration” of January 2003:“… One in which highly developed ICT networks, equitable “… One in which highly developed ICT networks, equitable and ubiquitous access to information, appropriate content and ubiquitous access to information, appropriate content in accessible formats and effective communication can in accessible formats and effective communication can help people achieve their potential”help people achieve their potential”

Kofi Annan Challenged the Scientific Community to Help (3/03) Kofi Annan Challenged the Scientific Community to Help (3/03) CERN and ICFA SCIC have been quite active in the WSIS in CERN and ICFA SCIC have been quite active in the WSIS in

Geneva (12/2003) Geneva (12/2003)

Page 73: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

The Open Science GridThe Open Science Gridhttp://www.opensciengrid.orghttp://www.opensciengrid.org

The Open Science Grid will

Build on the experience of Grid2003, as a persistent, production-quality Grid of national and international scope

Ensure that the U.S. plays a leading role in defining and operating the global grid infrastructure needed for large-scale collaborative and international scientific research.

Combine computing resources at several DOE labs and at dozens of universities to effectively become a single national computing infrastructure for science, the Open Science Grid.

Provide opportunities for educators and students to participate in building and exploiting this grid infrastructure and opportunities for developing and training a scientific and technical workforce. This has the potential to transform the integration of education and research at all levels.

Page 74: Networks and Grids for Global Science Networks and Grids for Global Science Harvey B. Newman Harvey B. Newman California Institute of Technology 3 rd International

The Move to OGSA and then The Move to OGSA and then Managed Integrated SystemsManaged Integrated Systems

Incr

ease

d f

un

ctio

nal

ity,

stan

dar

diz

atio

n

Time

Customsolutions

Open GridServices Arch

GGF: OGSI, …(+ OASIS, W3C)

Multiple implementations,including Globus Toolkit

Web services + …

Globus Toolkit

Defacto standardsGGF: GridFTP, GSI

X.509,LDAP,FTP, …

App-specificServices~Integrated Systems~Integrated Systems

Stateful; ManagedWeb Services

Resrc Framwk