2005 assessment on noaa data and information...

NRC Committee on Archiving Environmental and Geospatial Data – March 2006

2005 Assessment on NOAA Data2005 Assessment on NOAA Data

and Information Managementand Information Management

Briefing to the NRC Committee on Archiving

Environmental and Geospatial Data

Susan McLean, Assessment Coordinator

15 March 2006 NRC Committee on Archiving Environmental and Geospatial Data

Scope of BriefingScope of Briefing

• Introduction

• What the assessment covered

• How the assessment was conducted

• Assessment results

– NOAA Ecosystems Mission Goal

– NOAA Climate Mission Goal

– NOAA Weather and Water Mission Goal

– NOAA Commerce and Transportation Mission Goal

– Overall Assessment

• Successes & Enterprise-wide Challenges

• Conclusion


IntroductionIntroduction

• Assessment conducted January 2005 – April 2005

– Assessed capability by NOAA Mission Goal and Program

• Based on Public Law 106-554 Sect. 515

– …NOAA must complete and report to Congress an assessmentof the adequacy of our environmental data and informationsystems…

• Assess capability to:

– acquire and transmit observations needed by the Program(NOAA and non-NOAA source)

– validate and describe the observations, scientific data, andproducts

– archive and provide discovery and access to these data andproducts in such a way as to enable integration acrossplatforms and disciplines.


Assessment DesignAssessment Design

• Twelve questions posed to Programs - answered with

– Excellent shape or doing with existing resources,

– Partially accomplished or need incremental additional resources, or

– Not accomplished or need substantial increase in resources to accomplish

• Areas covered

– Acquisition and transmission of observations

• 5-year plan; maintain and monitor observing systems; collect and rescue data

– Scientific management of data• 5-year plan; calibrate and validate observations; data in appropriate formats; complete

metadata describing data

– Archive of and access to data and science products

• 5-year plan; data preserved for long-term use; data easily discovered (i.e.clearinghouse catalog); data on-line in open formats for easy access anddissemination

– Contingency Planning

• for access to the observations, related products, and archives

– 10-year Objectives• Changes to improve interoperability of data and products, facility requirements, and

critical new technological components


Assessment Design cont.Assessment Design cont.

Assessment conducted by NOAA Mission Goal / Program

– Ecosystem Mission Goal – Protect, restore, and manage the use of

coastal and ocean resources through an ecosystem approach to

management

– Climate Mission Goal – Understand climate variability and change to

enhance society’s ability to plan and respond

– Weather and Water Mission Goal – Serve society's needs for weather

and water information

– Commerce and Transportation Mission Goal – Support the Nation’s

commerce with information for safe, efficient, and environmentally sound

transportation

– Support NOAA’s Mission – Provide critical support for NOAA’s Mission


Overall NOAA AssessmentOverall NOAA Assessment

Summary Assessment Chart for all NOAA Programs• Identifies common challenges in

– Collection and Rescue

– Metadata

– Archive Planning

– Long-term Preservation

– Discovery, Access, and

Dissemination of Data

• NOAA is doing a better job at:– Collection and verification

– Processing and transmission

– Calibration, validation, and quality review

– Corporate planning

• NOAA is in the process of:

– Developing an integrated Earth observing

and data management

system


Ecosystem Mission GoalEcosystem Mission Goal

Nine Programs (7 matrix Programs)

• Habitat

• Corals

• Coastal and Marine Resources

• Protected Species

• Fisheries Management

• Aquaculture

• Enforcement

• Ecosystem Observations

• Ecosystem Research

NOAA should be able to forecast theextent and impact of critical

ecosystem events and the effects ofhuman activities by 2011.


Ecosystem AssessmentEcosystem Assessment

Successes

• Ecosystems managementmodel

• Advanced Internettechnologies, especially useof GIS

• Improved data storage andWeb services

Challenges

• New Programs still in earlystages

• Integrating observationmanagement and dataaccess

• Inconsistent formatting,duplication of effort, anddata ownership / sharing


Climate Mission GoalClimate Mission Goal

Five Programs (all matrix Programs)

• Climate Observations and Analysis

• Climate Forcing

• Climate Predictions and Projections

• Climate and Ecosystems

• Regional Decision Support

During 1980–2004, the U.S. sustained 62weather- or climate-related disasters, with

damages and costs exceeding $1 billion perevent. Total inflation-adjusted direct losses from

these events were more than $390 billion.


Climate AssessmentClimate Assessment

Successes

• Improved quality of

observations

• More efficient delivery

• Improved qc procedures

• Increased spatial and

temporal coverage

Challenges

• Data Integration

• Adequate Metadata

• Data Discovery

• Rapidly growing data volumes

• Reprocessing data to extend

climatologies through instrumental

changes


Weather and Water Mission GoalWeather and Water Mission Goal

Eight Programs (6 matrix Programs)

• Local Forecasts and Warnings

• Coasts, Estuaries, and Oceans

• Space Weather

• Hydrology

• Air Quality

• Environmental Modeling

• Tsunami

• Science, Technology, and Infusion

NOAA will expand its Deep-ocean Assessmentand Reporting of Tsunamis network to 39

stations to cover the Pacific Ocean, CaribbeanSea, and East coast of the United States


Weather and Water AssessmentWeather and Water Assessment

Successes

• Improved planning and

acquisition

• Data calibrated and validated

• Data delivered in appropriate

formats

Challenges

• Access and processing greater

volumes of high-resolution data

• Distribution of products

• Expanded use of GIS

• Integrated observations and data

management plan


Commerce and Transportation Mission GoalCommerce and Transportation Mission Goal

Seven Programs (1 matrix Program)

• Marine Transportation Systems

• Geodesy

• Surface Weather

• Aviation Weather

• Marine Weather

• NOAA Emergency Response

• Commercial Remote Sensing

Licensing

U.S. global maritime trade isprojected to more than double before2020. Currently, more than 2 billion

metric tons of domestic andinternational waterborne cargo move

on U.S. waterways each year.


Commerce and Transportation AssessmentCommerce and Transportation Assessment

Successes

• Improved data delivery,

expanded use of GIS

• Private / Public partnerships

• Improved awareness of data

management

Challenges

• Increasing data volumes

• Automated real-time processing,

analysis, distribution of data

• Uniform quality metadata

• Improved data discovery and

integration


NOAANOAA’’s Support Missions Support Mission

Four Mission Sub-Goals

• Satellite Services

• Fleet Services

• Leadership– Includes Homeland Security

• Mission Support– Includes Administrative,

Financial, and Facilities

Informed decision making is critical in an erawhere threats are ubiquitous ... The ability to

intervene early to detect and defeat threats, orrespond effectively to an incident depends on

our ability to make sound decisions inapplication of operational forces, policies, and

finite resources.


NOAANOAA’’s Support Mission Data Strategiess Support Mission Data Strategies

• Acquisition and delivery of satellite-derived information

• Applied research for current and future satellite

products and services

• Meet NOAA requirements for ship and aircraft support

• Coordinate NOAA’s homeland security-related plans,

programs, and policies

• Plan for, construct, and maintain facilities

• Develop and maintain an Information Technology

Enterprise that:

– supports the life cycle of NOAA’s programs

– is secure, reliable, and cost-effective

– encourages information sharing, and

– complies with all applicable policies


Overall NOAA AssessmentOverall NOAA Assessment

Summary Assessment Chart for all NOAA Programs• Identifies common challenges in

– Collection and Rescue

– Metadata

– Archive Planning

– Long-term Preservation

– Discovery, Access, and

Dissemination of Data

• NOAA is doing a better job at:– Collection and verification

– Processing and transmission

– Calibration, validation, and quality review

– Corporate planning

• NOAA is in the process of:

– Developing an integrated Earth observing

and data management

system


Ongoing ChallengesOngoing Challenges

NOAA faces ongoing challenges in:

Size: Managing exponentially growing data volumes

Metadata: Appropriately describing data to ensure long-

term utility

Integration: Providing data in standard formats and

protocols to enable integration

Access: Providing clear and easy discovery of and access

to data and products

At Risk Data Sets: Collecting data at risk to extend the

environmental record


Challenges Challenges –– Data Volume Data Volume

NOAA must acquire, transmit, process, quality assure,

document, develop and deliver products, and archive

greatly increasing volumes of data


NOAANOAA’’s Near-term Implementation Goalss Near-term Implementation Goals

• Identify and address integration gaps

• Create interoperability across NOAA

• Develop and adopt standards for

format and terminology

• Integrate measurements, data, and

products

• Examine future data management

requirements


Questions?Questions?

2005 assessment on noaa data and information...

Documents