madis – the meteorological assimilation data ingest system current operational status and future...

1
MADIS – The Meteorological Assimilation Data Ingest System Current Operational Status and Future Plans Greg Pratt, Leon Benjamin, Thomas Kent, Gopa Padmanabhan, Leigh Cheatwood-Harris, and Michael Vrencur NOAA/Oceanic and Atmospheric Research/Earth System Research Laboratory/Global Systems Division Steven Pritchett, Michelle Mainelli, Luis Cano, Cameron Shelton, Scott Jacobs, and Rebecca Cosgrove NOAA/National Weather Service/Office of Science and Technology & National Centers for Environmental Prediction Drew Saunders and Philip Jones NOAA/National Environmental Satellite, Data and Information Service/National Climate Data Center MADIS Goal A more usable, complete, accurate, timely, and higher density observational infrastructure for use in local weather warnings and products, numerical weather prediction, and use by the greater meteorological community. MADIS Provides • Access to real-time and archived data sets • Uniform data formats, observation units, and time stamps • Observational Quality Control (QC) • Network-enabled distribution with server- site sub-setting • Authorization and authentication for proprietary data • User documentation and help desk support NOAA Mission NOAA’s mission, “To understand and predict changes in climate, weather, oceans, and coasts; To share that information with others”, increasingly demands advanced data management processes, including data integration, to achieve interoperable, accessible, and readily usable observational data. MADIS Data Scope • 66,127 stations from over 160 surface networks producing nearly 13 million observations per day • 116 Profiler sites (>200,000 observations per day) • >630,000 aircraft observations per MADIS Data Sets MADIS observations covering North America MADIS FY15 and Future Plans Additional data sets – (FAA 1 minute ASOS, Clarus, Sensing Hazards with Operational Unmanned Technology (SHOUT),…) Advanced data query and web services Improved data/metadata standards Improved QC and station monitoring Open source development environment Extend QC algorithms to meet operational and research needs •Work with Federal Highway Administration Clarus team to fully transition Clarus capabilities into MADIS operations •FAA NextGen/NWS AWIPS data discovery/dissemination capable •Conduit for efficient transfer of research and development to operations MADIS Final Operating Capability The MADIS system is currently undergoing a 30 day acceptance test at NCEP’s Central Operations (NCO) and NCDC. Operational sign off scheduled for 01/21/2015. https://madis.ncep.noaa.gov/ MADIS Users Include… •International meteorologica l centers •>200 universities •Public •NWS Forecast Offices and National Centers •OAR, NESDIS, NOS •NCAR, NASA, DOE, FAA, DOT •Hundreds of private companies MADIS Distribution Services https://madis.ncep.noaa.gov/user_resources.shtml Meteorological Surface Temperatures Available Observatio ns Surface Aircraft Radiosonde Profiler GOES Satellite POES Satellite Radiometer - - - - - - - + o X P R The MADIS Team NWS/OST&NCEP Operations NESDIS/NCDC Archive OAR/ESRL/GSD R&D/Tier 3 Support/Conduit to Operations Non-NOAA Providers Observations and Metadata https://madis.ncep.noaa.gov/ network_info.shtml Non-NOAA Data Sets https://madis.ncep.noaa.gov/madis_dataset s.shtml Surface Profiler Radiometer Aircraft Radiosonde Snow Graphical: •Meteorological Surface https://madis-data.ncep.noaa.gov/Madi sSurface / •Aircraft http://amdar.noaa.gov/java/ •Profiler https://madis-data.ncep.noaa.gov/cap/ Text/XML/CSV Dumps: •Meteorological Surface https://madis-data.ncep.noaa.gov/public/sfcd ump.html •Hydrological Surface https://madis-data.ncep.noaa.gov/public/hydr odump.html Meteorological Surface Data Query Form Text Output from Meteorological Data Query Users can pull MADIS data into their applications using the MADIS application interface: https://madis.ncep.noaa.gov/madis _api.shtml

Upload: solomon-gibson

Post on 12-Jan-2016

231 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: MADIS – The Meteorological Assimilation Data Ingest System Current Operational Status and Future Plans Greg Pratt, Leon Benjamin, Thomas Kent, Gopa Padmanabhan,

MADIS – The Meteorological Assimilation Data Ingest SystemCurrent Operational Status and Future Plans

Greg Pratt, Leon Benjamin, Thomas Kent, Gopa Padmanabhan, Leigh Cheatwood-Harris, and Michael VrencurNOAA/Oceanic and Atmospheric Research/Earth System Research Laboratory/Global Systems Division

Steven Pritchett, Michelle Mainelli, Luis Cano, Cameron Shelton, Scott Jacobs, and Rebecca CosgroveNOAA/National Weather Service/Office of Science and Technology & National Centers for Environmental Prediction

Drew Saunders and Philip JonesNOAA/National Environmental Satellite, Data and Information Service/National Climate Data Center

MADIS GoalA more usable, complete, accurate, timely, and higher density observational infrastructure for use in local weather warnings and products, numerical weather prediction, and use by the greater meteorological community.

MADIS Provides• Access to real-time and archived data sets• Uniform data formats, observation units, and time stamps• Observational Quality Control (QC)• Network-enabled distribution with server-site sub-setting• Authorization and authentication for proprietary data• User documentation and help desk support

NOAA MissionNOAA’s mission, “To understand and predict changes in climate, weather, oceans, and coasts; To share that information with others”, increasingly demands advanced data management processes, including data integration, to achieve interoperable, accessible, and readily usable observational data.

MADIS Data Scope• 66,127 stations from over 160 surface networks

producing nearly 13 million observations per day• 116 Profiler sites (>200,000 observations per day)• >630,000 aircraft observations per day• Plus global radiosonde and satellite observations

MADIS Data Sets

MADIS observations covering North America

MADIS FY15 and Future Plans

Additional data sets – (FAA 1 minute ASOS, Clarus, Sensing Hazards with Operational Unmanned Technology (SHOUT),…)

Advanced data query and web services Improved data/metadata standards Improved QC and station monitoring Open source development environment Extend QC algorithms to meet operational and

research needs

• Work with Federal Highway Administration Clarus team to fully transition Clarus capabilities into MADIS operations

• FAA NextGen/NWS AWIPS data discovery/dissemination capable

• Conduit for efficient transfer of research and development to operations

MADIS Final Operating Capability

The MADIS system is currently undergoing a 30 day acceptance test at NCEP’s Central Operations (NCO) and

NCDC. Operational sign off scheduled for 01/21/2015. https://madis.ncep.noaa.gov/

MADIS Users Include…• International

meteorological centers

• >200 universities• Public

• NWS Forecast Offices and National Centers

• OAR, NESDIS, NOS• NCAR, NASA, DOE, FAA, DOT• Hundreds of private companies

MADIS Distribution Serviceshttps://madis.ncep.noaa.gov/user_resources.shtml

Meteorological Surface Temperatures

Available Observations

Surface

Aircraft

Radiosonde

Profiler

GOES Satellite

POES Satellite

Radiometer

-

-

-

-

-

-

-

+o

X

P

R

The MADIS Team

NWS/OST&NCEP

Operations

NESDIS/NCDC

Archive

OAR/ESRL/GSD

R&D/Tier 3 Support/Conduit to Operations

Non-NOAA Providers

Observations and Metadatahttps://madis.ncep.noaa.gov/network_info.shtml

Non-NOAA Data Setshttps://madis.ncep.noaa.gov/madis_datasets.shtml

Surface Profiler

RadiometerAircraft Radiosonde

Snow

Graphical:•Meteorological Surface

– https://madis-data.ncep.noaa.gov/MadisSurface/

•Aircraft– http://amdar.noaa.gov/java/

•Profiler– https://madis-data.ncep.noaa.gov/cap/

Text/XML/CSV Dumps:•Meteorological Surface

– https://madis-data.ncep.noaa.gov/public/sfcdump.html

•Hydrological Surface– https://madis-data.ncep.noaa.gov/public/hydrodump.html

Meteorological Surface

Data Query Form

Text Output from Meteorological Data Query

Users can pull MADIS data into their applications using the MADIS application interface:https://madis.ncep.noaa.gov/madis_api.shtml