operational satellite wind product processing at noaa...

30
8th International Winds Workshop Beijing Operational Satellite Wind Product Operational Satellite Wind Product Processing at NOAA/NESDIS: Processing at NOAA/NESDIS: A Status Report A Status Report Antonio Irving Antonio Irving NOAA/NESDIS, Office of Satellite Processing and Distribution NOAA/NESDIS, Office of Satellite Processing and Distribution Hongming Hongming Qi Qi NOAA/NESDIS, Office of Satellite Processing and Distribution NOAA/NESDIS, Office of Satellite Processing and Distribution William William Pennhoyer Pennhoyer Northtrop Northtrop Grumman Information Technology Grumman Information Technology Bob Potash Bob Potash Perot Systems Government Services Perot Systems Government Services Rickey Rollins Rickey Rollins SM Research Corporation SM Research Corporation

Upload: others

Post on 24-Sep-2020

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Operational Satellite Wind Product Operational Satellite Wind Product Processing at NOAA/NESDIS: Processing at NOAA/NESDIS:

A Status ReportA Status Report

Antonio IrvingAntonio IrvingNOAA/NESDIS, Office of Satellite Processing and DistributionNOAA/NESDIS, Office of Satellite Processing and Distribution

HongmingHongming QiQiNOAA/NESDIS, Office of Satellite Processing and DistributionNOAA/NESDIS, Office of Satellite Processing and Distribution

William William PennhoyerPennhoyerNorthtropNorthtrop Grumman Information TechnologyGrumman Information Technology

Bob PotashBob PotashPerot Systems Government ServicesPerot Systems Government Services

Rickey RollinsRickey RollinsSM Research CorporationSM Research Corporation

Page 2: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

TOPICSTOPICS• Status of NESDIS’ geostationary satellites

• Operational AMV System– System Architecture/Current configuration– Wind products– Formats and dissemination– Product monitoring– AMV processing updates

• Research to Operations- The SPSRB process

Page 3: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

NESDIS Operations Status ReportNESDIS Operations Status ReportStatus of GOES SatellitesStatus of GOES Satellites

http://http://www.oso.noaa.gov/goesstatuswww.oso.noaa.gov/goesstatus//

Page 4: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Status of NESDISStatus of NESDIS’’ Geostationary SatellitesGeostationary Satellites

GOESGOES--88 4/13/19944/13/1994 DeDe--Orbited Orbited (May 4, 2004)(May 4, 2004)

GOESGOES--99 5/23/19955/23/1995 DecommissionedDecommissioned (June 15, 2007)(June 15, 2007)

GOESGOES--1010 4/25/19974/25/1997 OperationalOperational @ 60W @ 60W (July 27, 1998)(July 27, 1998)

On loan to South America (Dec 02, 2On loan to South America (Dec 02, 2006) 006)

GOESGOES--1111 5/03/20005/03/2000 Operational Operational @ 135W@ 135W (July 20, 2006)(July 20, 2006)

GOESGOES--1212 7/23/20017/23/2001 Operational Operational @ 75W @ 75W (May 1, 2003)(May 1, 2003)

GOES 13 5/24/2006 GOES 13 5/24/2006 On Orbit Storage @ 105WOn Orbit Storage @ 105W

SpacecraftSpacecraft LaunchedLaunched Status Status (Effective Date)(Effective Date)

SpacecraftSpacecraft Launch DateLaunch Date

GOESGOES--O O August 2008August 2008

GOESGOES--P TBDP TBD

GOESGOES--R December 2014R December 2014

Page 5: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

NESDIS Operations Status ReportNESDIS Operations Status Report

Operational AMV System:System Architecture, Wind products, dissemination, product monitoring,

and updates

Page 6: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

System Architecture Changes (~1978 – 2008)

•• ~ 1978 ~ 1978 –– 1994 IBM 360 Mainframe (MVS) 1994 IBM 360 Mainframe (MVS) (MIDAS and VDUC) (MIDAS and VDUC)

•• 1994 1994 –– 1997 IBM Servers (AIX)1997 IBM Servers (AIX)•• 1997 1997 –– 2001 SGI Origin 2000 (IRIX)2001 SGI Origin 2000 (IRIX)•• 2001 2001 –– 2008 Dell Servers (LINUX)2008 Dell Servers (LINUX)•• April 2008 and beyond IBM P570 Server with April 2008 and beyond IBM P570 Server with

Linux Partitions (Linux)Linux Partitions (Linux)

Operational AMV System ArchitectureOperational AMV System Architecture

Page 7: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

SATEPSPRODx IBM 9117-p57016 Processors1.9 Ghz CPU 64Bit256 GB of Memory2 - 73GB Hdisk and 1 TB SAN Disk

SATEPSDISTx IBM P55A8 Processors1.65 Ghz CPU 64 bit16 GB of Memory4-146 GB HDisk / 2-73 GB Hdisk2 TB SAN Disk

SATEPS Operational Hardware/Physical Environment at ESPC/NSOF

AIX 5.32 Processor1.65 Ghz CPU 64 Bit3 GB of Memory2-73 GB HDisk 1-146 GB HDisk

SATEPSANON IBM P52A

SATEPSPROD1LINUX RHEL4 WSMcIDAS 2007FortranCShellLINUX Script

SATEPSPROD2LINUX RHEL4 WSMcIDAS 2007FortranCShellLINUX Script

SATEPSPROD3LINUX RHEL4 WSMcIDAS 2007FortranCShellLINUX Script

SATEPSPROD4LINUX RHEL4 WSMcIDAS 2007FortranCShellLINUX Script

SATEPSPROD5

SATEPSNIM

SATEPSDIST1AIX 5.3McIDAS 2007FortranCShell

SATEPSDIST2AIX 5.3McIDAS 2007FortranCShell

SATEPSDIST3AIX 5.3McIDAS 2007FortranCShell

SATEPSDIST4LINUXMcIDAS 2007FortranCShell

SATEPSDIST5LINUXMcIDAS 2007FortranCShell

SATEPSDIST6LINUXMcIDAS 2007FortranCShell

SATEPSDIST7LINUXMcIDAS 2007FortranCShell

SATEPSDEV1AIX5.3McIDAS 2007Fortran, C, Shell, Script

SATEPSDEVx IBM 9117-p57016 Processors1.65 Ghz CPU 64Bit32 GB of Memory8 – 73 GB Hdisk and 2 TB SAN Disk

SATEPSDEV2LINUX RHEL4 WSMcIDAS 2007Fortran, C, Shell, Script

SATEPSDEV3LINUX RHEL4 WSMcIDAS 2007Fortran, C, Shell, Script

SATEPSDEV4LINUX RHEL4 WSMcIDAS 2007Fortran, C, Shell, Script

SATEPSDEV5LINUX RHEL4 WSMcIDAS 2007Fortran, C, Shell, Script

SATEPSDEV6LINUX RHEL4 WSMcIDAS 2007Fortran, C, Shell, Script

SATEPSDEV7LINUX RHEL4 WSMcIDAS 2007Fortran, C, Shell, Script

SATEPSDEV8LINUX RHEL4 WSMcIDAS 2007Fortran, C, Shell, Script

SATEPSDEV9LINUX RHEL4 WSMcIDAS 2007Fortran, C, Shell, Script

DRAFTDRAFTDRAFT

Formerly GP12

Formerly GP16

Page 8: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

SATEPSPROD5 10.144.2.105

SATEPSPROD5 (LINUX)

SATEPSPROD4 10.144.2.104

SFOV, Gridded Cloud Product,Lightning,Profiler Winds,Radar Data

SATEPSPROD4(LINUX)

SATEPSPROD3 10.144.2.103

Polar Mapping,HD WindsPolarWinds,TRaP,FIMMA

SATEPSPROD3(LINUX)

SATEPSAIX 10.144.2.100

SATEPSPROD5(AIX NIM)

SATEPSPROD2 10.144.2.102

CSBT,GASP,Genesis Parameter,AWIPS Composite

SATEPSPROD2(LINUX)

SATEPSPROD1 10.144.2.101

Imager ASOS,DPI,Hyrdo-Estimator,SPE(AWIPS), GICP,GSIP,ABBA,Volcano PCI,Volcano Imagery,GOES-SST,MTSAT SST,MSG SST

SATEPSPROD1(LINUX)

IP AddressProductsSystem

SATEPSPROD P570 (LPARS)

Page 9: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

NESDIS Operations Status ReportNESDIS Operations Status Report

Operational AMV System:System Architecture, Wind products, dissemination, product monitoring,

and updates

Page 10: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing 30Extended NH; SH3 (Daytime)

15PACU/CONUS3 (Daytime)

JHCX11- GOES-EJJCX11- GOES-W

7.5RISOP3 (Daytime)Vis Cloud-drift (0.65um)

JECX11- GOES-EJGCX11- GOES-W

60Extended NH; SH3Water Vapor (6.7um)

30Extended NH: SH3 (Night-time)

15CONUS3 (Night-time)

JQCX11- GOES-EJRCX11- GOES-W

7.5RISOP3 (Night-time)SWIR (3.9um) Cloud-drift

30Extended NH: SH3

15CONUS3

JACX11- GOES-EJCCX11-GOES-W

7.5RISOP3LWIR (11um) Cloud-drift

GOES IMAGER

GTS WMOHeader

Image Interval (min)

ImageSector (s)

Frequency(Hours)AMV Product

Page 11: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

TERRA/AQUA MODIS

JFCX11- TerraJLCX11- Aqua

100NHEM; SHEM(poleward 65o Lat)

2Water Vapor (6.7um)

JBCX11- TerraJICX11- Aqua

100NHEM; SHEM(poleward 65o Lat)

2LWIR (11um) Cloud-drift

JNCX11- GOES-EJPCX11- GOES-W

60CONUS/Tropical3,6Sounder WV(7.0um)

JKCX11- GOES-EJMCX11-GOES-W

60CONUS/Tropical3,6Sounder WV (7.4um)

GOES SOUNDER

GTS WMOHeader

Image Interval (min)

ImageSector (s)

Frequency(Hours)Wind Product

Page 12: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

NESDIS Operations Status ReportNESDIS Operations Status Report

Operational AMV System:System Architecture, Wind products, dissemination, product monitoring,

and updates

Page 13: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Dissemination of NESDIS Operational Wind Products and Formats SupportedMTSAT*

ASCAT*

Sounder

Ch. 11

Binary(Archive)

ASCII WMO No 306

McIDASMD File

BUFR WMO FM 94

InternetFiles

QUICKSCATSounder

Ch. 10WVMODIS

LWIRMODIS

VisibleWV (6.7um)

SWIR (3.9 um)

LWIR (11um)

GP16 GP12 GTS AWIPS

Page 14: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Dissemination of NESDIS Operational Dissemination of NESDIS Operational Wind Products Wind Products

•• GOES GOES AMVsAMVs are routinely disseminated to the National Weather Service are routinely disseminated to the National Weather Service (NWS) Advanced Weather Interactive Processing System (AWIPS)(NWS) Advanced Weather Interactive Processing System (AWIPS)–– AWIPS is an operationally supported network that gives NWS AWIPS is an operationally supported network that gives NWS

field forecasters access to a multitude of digital data to help field forecasters access to a multitude of digital data to help them in their daily forecast preparationthem in their daily forecast preparation

–– AWIPS display software allows for easy integration of GOES AWIPS display software allows for easy integration of GOES AMVsAMVs with a multitude of other data sources (model with a multitude of other data sources (model analyses/analyses/fcstsfcsts, observations from other observation systems), observations from other observation systems)

–– OB9.0 (Operational Build) last build schedule for deployment OB9.0 (Operational Build) last build schedule for deployment (January 2009) before AWIPS moratorium. MTSAT high density (January 2009) before AWIPS moratorium. MTSAT high density winds currently in end to end test mode will be included in OB9.winds currently in end to end test mode will be included in OB9.

Page 15: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Integration of GOES MTSAT Satellite WindsIntegration of GOES MTSAT Satellite Winds within the within the NOAA/NWS Advanced Weather Interactive Processing NOAA/NWS Advanced Weather Interactive Processing

System (AWIPS)System (AWIPS)

Page 16: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

NESDIS Operations Status ReportNESDIS Operations Status Report

Operational AMV System:System Architecture, Wind products, dissemination, product monitoring,

and updates

Page 17: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Page 18: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Page 19: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Page 20: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Page 21: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

AMV Product Quality MonitoringAMV Product Quality Monitoring

•• RadiosondeRadiosonde Observations Observations Statistics reported quarterly to CGMS

Daily Comparisons of Daily Comparisons of AMVsAMVs withwith……

Page 22: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

NESDIS Operations Status ReportNESDIS Operations Status Report

Operational AMV System:System Architecture, Wind products, dissemination, product monitoring,

and updates

Page 23: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

• Implementation of Expected Error (EE) Technique (Jan 2008)• Proposed by J. LeMarshall and developed at Australian BoM• Extension of EUMETSAT QI • At NESDIS we have integrated the EE software within our winds processing system

• Executing routinely within our experimental parallel systems• Modified BUFR encoder to include EE after other quality indicators in BUFR message• Collecting AMV/Rawinsonde collocations and “tuning” up coefficients• Supporting JCSDA efforts to assess impact of MODIS AMV data thinning based on EE

• MODIS Winds Upgrades (April 2008)• Parallax correction

• Pre-cursor for mixed Terra & Aqua winds processing

• AVHRR Winds Capability (2008)– Serving CIMSS derived AMVS on GP16 (Summer 2006) – NESDIS in house processing to begin May 2008

• Hourly Winds– Demonstrated capability (April 2008)– Routine processing (2009)

• Challenges– Need to prepare user community for increase in volume– Need to retool software to be more sensitive to timeliness issues– Need to possibly upgrade systems for increase storage and CPU capacity

OpnlOpnl AMV System:AMV System: Updates ComingUpdates Coming

Page 24: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

NESDIS AMV Processing

Image Registration QC

Target Selection

Height Assignment

Wind Vector Computation

Auto Editing And Quality Control

Format and Distribution

MODELDATA

Temp GuessWind GuessSfc Analysis

Page 25: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

LWIR AMVSNorthern

Hemisphere

LWIR AMVSSouthern

Hemisphere

Water Vapor AMVS

Northern Hemisphere

Water Vapor AMVS

Southern Hemisphere

Auto Editing And Quality Control

Format and Distribution

Ensemble Auto Editing For Operational AMVS

LWIR CONUS

Page 26: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

NESDIS Operations Status ReportNESDIS Operations Status Report

Research To Operations

Page 27: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Research to Operations• Three Distinct Paths

- User Request: Users can identify a need for new or improved observations or products.

- Mature Science Development: Scientists can identify maturing scientific development or algorithm thought to provide significant user benefit.

- NOAA Program/NESDIS Project Manager Directed Project: NOAA/NESDIS program or project managers can provide requirements to develop new or improved products. These acquisition managers formulate plans to acquire the new products

Page 28: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

Satellite Products and Services Review Board (SPSRB)

• Composed of principals from OSDPD, STAR and OSD• Provides oversight and decision authority to effectively manage NOAA’s

satellite product life cycle process– Addresses user requests to enhance current products or generate

new products in line with requirements of NOAA Mission Goals – Focuses on the transition of research into operations– Manages product development projects– Allows for divestiture and retirement of products

• Provides a powerful evaluation mechanism– Enables a more efficient use of personnel, fiscal and information

technology resources• Meets monthly (third Wednesday in Room 707 NSC) and moderated by

executive secretary

Page 29: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

User Request1. User2. Science Improvement3. Project Manager

Resource Identification1. Annual Product Reviews2. Project Manager Reviews3. Out-of-cycle Review

Assessment1. Request and Requirement Assessment 2. Technical Assessment3. NOAA Partnership Policy Requirement

Operational Decision1. New Product

Product Development1. Development2. Pre-operational3. Operational

Reporting1. Project2. Management

Divesture or Retirement Decision NOAA Partnership Policy Requirement

Analysis of Alternatives1. Integrated Project Team Formed2. Proposal for Product Development

(Solution Analysis and Selection)

Initial Project Plan

Consolidated/Mission Observational

Requirements List(CORL/MORL)

PPBES

NOAA Observational System Architecture

(NOSA)

User

Key SPSRB Processes

PROCESS STEPS

Resource and DevelopmentPlanning

SPSRBDatabases

Change or Project Manager

Allocate Funding

Approved Project Plan

Operational Decision1. Update Product

Page 30: Operational Satellite Wind Product Processing at NOAA ...cimss.ssec.wisc.edu/iwwg/workshop9/ext_abstracts/2... · Satellite Products and Services Review Board (SPSRB) • Composed

8th International Winds Workshop Beijing

SPSRB Web Sitehttp://projects.osd.noaa.gov/spsrb/

User Request System

SPSRB Decision Briefs

Product Devel Proposal

SPSRB Process Paper: http://projects.osd.noaa.gov/spsrb/spsrb_info.htm

Project Plan

Declaring Product Operational