19 th north america-europe data exchange meeting 3-5 may 2006 silver spring, md, united states

21
© Crown copyright Page 1 19 th North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States David Hennings, Met Office

Upload: eliza

Post on 13-Jan-2016

26 views

Category:

Documents


1 download

DESCRIPTION

19 th North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States. David Hennings, Met Office. Telecommunication Links Status Report. Datalinks Link Speeds Message switching systems Frost Netlink Washington Link Data Volumes Toulouse Link Data Volumes - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 1

19th North America-Europe Data Exchange Meeting

3-5 May 2006 Silver Spring, MD, United States

David Hennings, Met Office

Page 2: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

Telecommunication Links Status Report

Datalinks

Link Speeds

Message switching systems

-Frost

- Netlink

Washington Link Data Volumes

Toulouse Link Data Volumes

RMDCN, ECMWF stats

Supercomputer News

Page 3: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 3

Main Communications Links from Exeter

Page 4: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 4

RMDCN Connections with Exeter

National Meteorological Service Protocol PVC Speed (Kbs-1)

Belgium FTP 32 in / 32 out

Denmark TCP Sockets 32 in / 32 out

DWD FTP 64 in / 64 out

France FTP 128 in / 384 out

Iceland FTP 16 in / 16 out

Ireland FTP 64 in / 64 out

Italy FTP 16 in / 16 out

Netherlands TCP Sockets 64 in / 64 out

Norway TCP Sockets 32 in / 32 out

Portugal FTP 32 in / 32 out

Russian Federation FTP 8 in / 64 out

Spain TCP Sockets 32 in / 32 out

From http://rmdcn.ecmwf.int/services/computing/rmdcn

Page 5: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 5

Message Switching Systems - Frost

Page 6: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 6

Frost WMO Message Switching System

HP UNIX 9000 L3000 servers running HP-UX 11i

Active and Hot Stand-by set-up

Synchronisation via 1Gbs-1 Fibre

100Mbs-1 to LAN for data transfers. Upgrading to 1Gbs-1

Corobor MessirComm for WMO switching

Nexor Mailer for X.400 & SMTP

Page 7: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 7

GTS Link with NOAA TOC Washington

BT Frame Relay link – NOT RMDCN

64 Kbs-1 Committed Information Rate

Three logical data channels (Alpha-Numeric, GRIB & T4)

TCP Sockets protocol

Number of Messages (Data Volume in Mb). (compared with previous year)

On 12th March 2006 via Frost system. An increase in GRIB of approx. 29% was due to additional Eumetsat bulletins switched from Offenbach to Washington

Type Received Transmitted

Alpha-Numeric 40815 (49)44502 (41.3) +10%, (-19)%

30128 (17.3)38395 (19) +27%, (+10)%

GRIB 46083 (190)

45619 (205) -1%, (+9)%42790 (318)

50896 (410) +19%, (+29)%

T4 39 (3.7)

177 (7.9) +450%, (+213)%78 (6.9)

69 (6.3) -12%, (-9)%

Page 8: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 8

GTS Link with NOAA TOC Washington- trends

Yearly (1 Day Average)

Page 9: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 9

GTS link to NOAA TOC

Issues: Require regular exercising of ISDN backup Use non-specialist operations staff working from documentation

Page 10: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 10

File transfer links with Nesdis

Issues:Swing tail circuit to new offices (Aug 2005!)

Consider viable backup routes and procedures (use of Internet now feasible at UK end)

Page 11: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 11

Message Switching Systems – oVMS Netlink

Page 12: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 12

Netlink FTP File Switch

Dec Alpha DS15 servers running OpenVMS

Active and Hot Stand-by set-up

100Mbs-1 to LAN for data transfers

In-House application for file switching

Non WMO switch for Model & Sat products

Switches fewer messages than Frost, but 10 times data volume.

Interim upgrade completed Oct 2004, est 2 years growth

“Rationalisation of File Transfer” project to replace these systems.Rollout of Linux/RH on commodity h/w Dell/Intel

Security issues – DMZ working.

Page 13: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 13

Present Data Volumes on Washington NOAA – OSA (NESDIS) Link

Requirements Description Daily Data Volume (MBytes)

NOAA AMSU-A Level 1B 115

NOAA AMSU-B Level 1B 301

DSMP SSM/I Brightness temperatures 227

NOAA TOVS MSU Level 1B 1

NOAA TOVS SSU Level 1B 3

QuikScat Scatterometer data 216

NOAA AVHRR Products on a HIRS Grid. 23

NOAA AVHRR 100km and 50Km SSTs 8

NOAA AVHRR Mapped Global Area Composites 6

NOAA Ozone Retrieved profiles and/or total column from SBUV 1

AQUA AIRS Brightness temperatures 569 (100%)

AQUA AMSU-A Brightness temperatures 12

NOAA TOVS HIRS Level 1B 66

NOAA ATOVS HIRS Level 1B 255 (+20%)

GOES cloud-tracked VIS/IR/WV Winds 9

SSMIS Level 1c (test mode) 295

TOTAL 2106 (+23%)

Page 14: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 14

Page 15: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 15

Netlink data: NOAA-OSA (NESDIS) Washington

Page 16: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 16

GTS Link with Toulouse (RMDCN)

Via RMDCN

Three logical data channels (Alpha-Numeric, GRIB & T4) for output

Two logical data channels (Alpha-Numeric + GRIB, & T4) for input

Link capacity 384 out.

Number of Messages (Data Volume in Mb).

Type Received Transmitted

Alpha-Numeric 18549 (43) (inc GRIB) 53541 (80)

GRIB 18549 (43) (inc A-N) 30144 (105)

T4 & Radar 1275 (18) 1527 (65)

Page 17: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 17

File Transfer Links with Toulouse (RMDCN)(Netlink)

Node TRMTF

Number of files daily and data Volume in Mb. () = previous year

Note:Received - increase due SAF/OCEAN ICETransmitted - NOAA – 8 SSM/I gone (via ECMWF)

Type Received Transmitted

SAF/Ocean & Ice, Arpege Ensemble etc.

94 (73) files85 (69) Mb

---

Satellite Imagery, AIRS, ATOVS, Qscat, SSM/I

---- 580 (590 ) files1120 (1025) Mb

Page 18: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 18

Traffic over RMDCN to Toulouse

Page 19: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 19

2Mb/s Megastream link(saturation at times)

Data link ECMWF

Page 20: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 20

Supercomputing -NEC [2004-]

No change since April 2005 upgrade, the 128-processor NEC SX-8 system doubled the computing power of each of the two existing 120-processor NEC SX-6 systems, which remain operational since April 2004.

See http://www.metoffice.gov.uk/corporate/pressoffice/2005/pr20050412.html

Theoretical peak power of an industry-leading 16 billion calculations per second per processor

Page 21: 19 th  North America-Europe Data Exchange Meeting 3-5 May 2006 Silver Spring, MD, United States

© Crown copyright Page 21

Future Plans

To continue to move away from legacy protocols (X.25)

IP links only

Make use of Internet VPN’s where possible

Upgrade Internet connectionUpgrade Link to ECMWF

Replace Netlink service – new architecture – DMZ’s for all!new hardware, O/s and applications (RH and AFD)rationalise FT applications across production and switching areas