Consultative Lab on Climate Change Impact on Water Resources (3rd September 2012)

“Issues and Challenges in

Meteorological Data Collection, Organization and Usage”

Kang Thean Shong

Malaysian Meteorological Department

Ministry Of Science, Technology and Innovation

CONTENT • Introduction to Malaysian Meteorological

Department (MMD)

• Simple Introduction to Meteorological Data

• Equipments Used & Data Collected by MMD

• Organization and User of MMD Data

• Climate Related Reports

• Issues and Challenges

• Way Forward

Introduction to Malaysian Meteorological Department

(MMD)

Malaysian Meteorological Department Ministry of Science, Technology and Innovation

Jabatan

Meteorologi

Malaysia, Jalan

Sultan, 46667,

Petaling Jaya,

Selangor Darul

Ehsan.

www.met.gov.my

Fon : 03-79678227

Mission

• To Fulfill The Needs Of Malaysian, To

Acquire Meteorological, Climatological

And Geophysical Services For Security

And Societal Well Being, And For

Sustainable Socio Economy And National Security

OBJECTIVES

To produce quality and accurate weather forecast and warning, climatic

information, earthquake information and tsunami warning

To enhance the safety and efficiency of flight operations, shipping, military,

and public transportation and enhance the nation’s readiness in facing

disaster and climate change for societal well being

To provide scientific advice and technical expertise for policy and decision

making

To safeguard the national interest in the science of meteorology ,

seismology and geophysics and archive quality data for future generations

To enhance the quality and delivery of services in line with the

1Malaysia concept of People First, Performance Now

Simple Introduction to

Meteorological Data

• Meteorological Data is an Atmospheric, Marine and earthquake Data collected by MMD to be used in Weather & Climate Forecasting, Warning, Study/Research and Other Application.

Meteorological Data Provided by MMD

Example Atmospheric Data Collected by MMD

• Rainfall

• Temperature

• Pressure

• Wind Speed & Direction

• Relative Humidity

• Visibility

• Cloud Type & Cover

• Vertical condition of Atmosphere etc.

• MMD also provide Marine & Oceoneography,

Geophysic & Sysmology, Agrometeorology,

Aviation Meteorology, Environmental

Meteorology, Radar, Satellite AND Numerical weather Prediction (NWP) Data.

BUT !

Equipments Used & Data Collected by MMD

METEOROLOGICAL

STATION (38) UPPER AIR STATION (8)

RADAR STATION (11)

SATELLITE

WEATHER CAMERA

STATION (17)

DATA ACCUSATION

AUXILIARY STATIONS

(180)

TSUNAMI BUOY (3)

DATA ACCUSATION

TIDE GAUGE (17)

COASTAL

CAMERA (18)

SEISMIC STATIONS (29)

RMAF Butterworth

Bayan Lepas

RMAF Gong Kedak Kota Kinabalu

Kuching

RMAF Kuantan

Subang

KLIA

Central Forecast Office

Petaling Jaya

Main Meteorological Offices (9)

KLIA Meteorological Office

Central Forecasting Office

Gong Kedak Meteorological Office

Surface Observational Stations Network

Alor Star

Bayan

Lepas

Gong Kedak Kota Kinabalu

Kuching

Kuantan

Subang

KLIA

Petaling Jaya

Chuping

P. Langkawi

Labuan

Sandakan

Kudat

Limbang

Tawau

Kapit

Mulu

Lahad Datu

Bintulu

Lawas

Miri

Keningau

Sibu

Mukah

Seri Aman

Batu Embun

Muadzam Shah

Batu Pahat

Kluang

Mersing

Senai

Temerloh

Cameron Highlands

Kota Bharu

K. Trengganu

Sitiawan

Melaka

Lubuk Merbau

Ipoh

Kuala Pilah Tioman

Bario

Butterworth

To be implemented (10th Malaysia Plan)

Main Meteorolgical Stations (existing)

Prai

To be implemented (9th Malaysia Plan)

Cameron Highlands

Subang

Sitiawan

Alor Star

Bayan

Lepas

Kota Kinabalu

Kuching

Kuantan

KLIA

Tawau

Bintulu

Kota Bharu

Upper Air Stations (8)

KLIA Upper Air Station

Marine Observational Network

• 8 Acoustic Doppler

Current Profiler (ADCP)-

real time

• 3 Tsunami Buoys-real time

• Data from various

agencies : Royal Navy,

Marine Dept, Oil & Gas,

Scientific Expedition etc

• Voluntary Observing Ship

(VOS)

KLUANG

SETAR

KUANTAN BINTULU

Omar

BUTTERWORTH SANDAKAN

SUBANG

KOTA BHARU

KUCHING

KOTA

KINABALU

KLIA

P. JAYA

SATELLITE AND RADAR STATIONS

LEGEND

(Doppler)

RADAR STATION

(11)

SATELLITE STATION

(1)

MIRI

RADAR ECHOES

NOAA GEO-STATIONARY

Hotspot & Haze Monitoring

Weather Monitoring

MODIS

Research & Analyses:

Chlorophyll, SST & Vegetation Index

SATELLITE PRODUCTS

NWP MODELS

MMD-MM5

MMD-WRF

MARINE MODELS

JMA-MMD MRI III Wave Model

MMD-WAM Wave Model

JMA-MMD Storm Surge Model

JMA-MMD Oil Spill Model

HYSPLIT TRAJECTORY MODEL

http://www.met.gov.my/fdrs/ FIRE DANGER RATING SYSTEM

MARINE REGIONS

FORECASTS FOR PORT AND FERRY OPERATORS

Kuantan

PTP

Bintulu

Miri

K. Kinabalu

n

South China Sea Sulu Sea

Penang

Kuching

P. Klang

Johor Bahru

Sandakan

Visual Strong Wind Warning System

Red Flag

Geting Fishery Complex

K. Trengganu

P. Chendering Fishery Complex

K. Pahang Fishermen Association

Nenasi Fishermen Association

K. Rompin Fishermen Association

Mersing

Mukah Fishermen Association

Bintulu Fishermen Association

Miri Fishermen Association

K. Kinabalu (SAFMA)

n

South China Sea Sulu Sea

Notice Board

KULIM

IPOH

FRIM

KLUANG

KOTA TINGGI

KUALA TERENGGANU LAHAD DATU

TAWAU

SIBU

KUCHING

SANDAKAN

KUDAT

BINTULU

KOTA KINABALU

SEPULUT

BAKUN

JERANTUT

17 Seismic

Stations

Earthquake Monitoring

Malaysian National Seismic Network

Porto Malai

Pulau Perak

Teluk Bahang

Pulau Perhentian

Kuala Terengganu

Pulau Tioman

Pulau Sembilan

One Fathom Bank

Tanjung Keling

Tanjung Gelang

Sibu

Bintulu

Miri

Labuan

Kota Kinabalu

Layang-layang

Sandakan

Semporna

Tawau

Lahad Datu

Kudat

Sea Level Measurement

21 Tidal Gauge Stations

Sea Level Measurement

MMD also monitors sea levels in the Indian Ocean and Pacific Ocean through

networks operated by the Global Sea Level Observing System (GLOSS).

Rondo Island ,Indonesia

Layang - - Layang Island

( )

3 Deep Ocean Buoys

Sulu Sea

Pantai Chenang

Pasir Panjang

Batu Feringgi

Kuala Muda

Pulau Pangkor

Pulau Ketam Pulau Tioman

Teluk Cempedak

Kuala Terengganu

Sibu

Bintulu

Miri

Labuan

Kota Kinabalu

Semporna

Sandakan

Kudat

Tawau

LEGEND : Phase 1: 4

Phase 2:

14

Coastal Camera Network

To monitor the sea conditions

Pantai Chenang

Sandakan Kuala Kurau

Pulau Pangkor

Pulau Ketam Pulau Tioman

Kuala Terengganu

Miri

Labuan

Kota Kinabalu Lahad Datu

Kudat

Teluk Bahang Kg. Kuala Sg. Muda

Kuala Kedah Tg. Bunggah

Batu Feringgi

Pasir Panjang

Kuala Teriang

Teluk Cempedak Semporna Tawau Kunak

Tsunami Siren Network

Stesen AWS Vaisala

Hospital Johor Bahru

Stesen AWS Vaisala

Hospital Tapah

Stesen AWS Vaisala

Empangan Semenyih

Stesen AWS 108

Penghulu Kerteh

Stesen Hujan Pos Brooke

Stesen Hujan Pos Ali

Senderut

Summary of MMD Observational Network

INSTRUMENTATION PARAMETER DATA TYPE

Wet-Only Sampler/ APS Wet fallout: pH,EC,Cl-,NO3-,SO4

2-,Na+,K+, Ca2+, Mg2+,NH4+,

oxalate, acetate, formate, mercury, copper, iron, manganese, nickel, lead, zinc, cadmium

Weekly

Anderson Precipitation Sampler (APS)

Dry fallout: Dust, Ca2+, Mg2+, mercury, copper, iron, manganese, nickel, lead, zinc

Monthly

High Volume Sampler / Tapered Element Oscillating Microbalance (TEOM)

Total suspended particulate (TSP) concentration / Particulate Matter (PM-10) concentration

Minutes Hourly Daily

Brewer Ozone Spectrophotometer Total Column Ozone, DUV, UV-B, AOD Daily

Passive Sampler SO2,NH3,NO2, HNO3, Oxalic acid Weekly Monthly

Filter Pack SO2,NH3,HNO3,HCl, Cl-,NO3-,SO4

2-,Na+,K+, Ca2+, Mg2+,NH4+ Weekly

Multigas Analyzer NO,NO2,NOx,SO2,CO,O3 Hourly

LoFlo Mark2 CO2 Analyzer CO2 Minutes

Nephelometer Aerosol scattering coefficient Minutes

Multi Angle Absorption Photometer (MAAP)

Black carbon concentration, Aerosol absorption coefficient Minutes

Precision Filter Radiometer (PFR) Aerosol optical depth (AOD) Minutes

Ozonesonde Vertical ozone profile Minutes

Persistent Organic Pollutants (POPs) PUF disk sampler

Persistent organic pollutants (POPs) Monthly

Flask sampling CO2, CH4, CO, H2, N2O, SF6, Delta 13C, Delta 18O Weekly

Environmental Data

Meteorological Radar Data

Bil Sistem Satelit Jenis Data Format Data

1. Satelit mengorbit kutub FY1D dan

NOAA

Data Level 1 HRPT

Imej JPG

Data Hotspot doc, xls

2. Satelit mengorbit kutub TERRA dan

AQUA (MODIS)

Data Level 0 PDS

Imej JPG

3. Satelit geopegun Feng Yun Data Level 0 S-VISSR

Imej JPG

4. Satelit geopegun MTSAT Data Level 1 Section File

Imej JPG

6. Satellite MTSAT Software Application:

i) Rainfall Rate Estimation

ii) Wind vector

iii) Mosaic

iv) Sector Projection

v) Source Image

Imej

JPG

Nota :

HRPT - High Rate Picture Transmission

PDS - Production Data Sets

S-VISSR - Stretched Visible and Infrared Spin Scan Radiometer

HRIT - High Resolution Information Transmission

Meteorological Satellite Data

Organization and User

of MMD Data

Weather Forecasts

Marine

Meteorology &

Oceanography

Climatology

Agrometeorology

Environmental

Meteorology

Seismology & Tsunami

Warnings

Weather Modification

Training

Services Provided

CLIENTS

Recrectional Special events Aviation

Plantations Air force Fisheries

Shipping

Special events

Oil exploration

Organization Involve

• International : WMO, ASEAN and etc

• Local : Government & NGO

• Government : DOE, DCA, JKR, JPS, JPSM and etc

• NGO : Individual, Insurance Company, Consultant Company, and etc.

Climate Related Reports

Example of Reports by MMD • Monthly Weather Bulletin – brief description weather condition with

statistical information on rainfall, temperature, solar radiation, evaporation and particulate matter (PM 10, < 10 micron) as well as synoptic climatology analysis

• Monthly Abstract of Meteorological Observations – data summary of daily mean sea level pressure, temperature, dew point, sun shine, global radiation, rainfall, evaporation, wind

• Annual Summary of Meteorological Observation – data summary of monthly

• Annual Climate Summary

• Monthly weather report – forecast, mainly rainfall amount, for the next 3 months

• Agroclimatic Analysis and Outlook – Monthly (weekly rainfall outlook for 3 weeks)

• Agrometeorological Bulletion – Decadal ( decadal rainfall outlook)

• Climate Projection till 2099

• Weather and Haze Reporting during dry/haze season

• Fire Danger Rating System

• Drought Monitoring

Issues And Challengers

Issues and Challenges in Data Collection 1. Late Delivery of Data - auxiliary stations from external agencies, such as from

FELDA and orang asli settlements 2. Interruption in Communication Lines - mobile network problem: causing late delivery of AWS data

to IMS data server. - Stremyx line problem: causing late delivery of data from

principle stations to IMS data server. 3. Sensors breakdown/unserviceable - causing data from automatic stations not complete 4. Repeated transmission of identical Data from stations - need to quality check data

5. Operational Cost

– RM120,000 – RM140,000 per new AWS, maintenance twice per year, Communication Cost (internet/mobile), Part Replacement Cost, Observer Cost and accessibility for auxiliary stations, especially remote areas

6. Closing and moving of stations,

- causing interruption and inconsistency of data

7. Strategic Location of stations

- Not able to meet the request of data for certain strategic locations, MARDI, need more station and staff for management

- Other than cost, the challenge of obtaining land for new stations

- Station in a remote places such as Orang Asli settlements is difficult to reach and manage. At times, no data available due to person responsible on leave and away from the settlement. Also take time to replace if lost

Issues and Challenges in Collection

Issues and Challenges in Collection

8. Lack of spare parts - late replacement and recovery of instruments. - quality of data collection affected 9. Lack of staff - maintenance work affected and delayed - repair of breakdown delayed 10. Lack of transport - maintenance and repair works affected 11. Aviation data are shared internationally & world wide

according to agreement by ICAO & WMO. The UTC time is used for this purpose. Data have to be transmit and collect on time

Issues and Challenges in Data Collection

12. Data Standard

- Internationally, all MMD data used the WMO and ICAO standard.

- Locally, MMD station maintenance obtained MS ISO standard

13. Managing Various Format of Data

• Historical Data : Pre war data, data from 1800.

• In situ Data in numerical value : Rainfall, Temperature, RH & etc.

• Data in Raster : Radar, Satellite & NWP.

• Coded Data : METAR, TAF, SYNOP & etc.

Commonly, the essential information content of the station will be simply

of the general form “at station x, for an elapsed period of time e, ending at

time” The associated metadata, which is needed to fully interpret the data,

could include such things as the:

•Reference date used by the database (GMT, time zone, others);

•Quality which has been ascribed to the observation;

•History of the values ascribed to the meteorological parameter and any

associated flags;

•Instrument used to record the observation, together with more fine detail

on its own maintenance programme, tolerances, internal parameters, etc;

•Name of the observer;

•Full details of the station and its history;

•Programme of observations in effect at the time and its history;

•the inventory of the elements stored in the database, their units, their

boundaries; and

•Topographical and ground-cover details of the site, information on

surrounding trees, buildings, etc, and how these have changed with time.

Issues & Challenges Station Record

ISSUES AND CHALLENGES IN DATA ORGANIZATION

1. The present data base management, e-cuaca, MAKLIM dan IMS, for real-time operation, data checking and extraction still not sufficiently comprehensive

2. Data Management need additional staff from the aspects of station maintenance, data quality control and publication

ISSUES AND CHALLENGES IN DATA ORGANIZATION

3. Quality Control of MMD data

• Data undergo Quality Control process. Non retrievable and unavailable data is mark in the data base

• Duplicate Data are removed.

• The historical data is manually ‘key in’ in the data base.

• Missing valued are ‘push in’ in the data base once the data is received.

• All data have to be complete, any incomplete data would not be used

• All the data is archived

ISSUES AND CHALLENGES IN DATA USAGE

1. Publics awareness and understand of meteorological terms lacking – a challenge for MMD to explain in simple terms

2. Lack of utilizing the data available for studies and research, including micro and local climate

3. Late Receipt and Provision of Incomplete Data - cannot meet the request for data from clients - bad image if defective data is provided to clients 4. Publication Interruption - late publication: not fulfilling KPI 5. Interruption in Data Analysis - interruption in preparing reports to government, monthly

weather reports etc 6. Interruption in Updating Web Page - not able to provide latest information for internal

operational web page (e-cuaca) and department external public web page

ISSUES AND CHALLENGES IN DATA USAGE

7 . Data Sharing - Internationally share through a WMO/ICAO

platform called Global Telecommunication System

(GTS)

- Aviation Briefing Terminal

- Locally shared through intranet (e-cuaca) and

departmental external/public web page to be used

by disaster manager, government agencies and

others.

MMD Data is under a Fi Act 1961

• Summary of the Fi

- Daily data RM 20.00/parameter/station/year

- Monthly data RM30.00/parameter/station/10year

• Good because it makes people appreciate data.

• Not good because MMD get so many complain from less affordable customer.

Increasing Demand for Meteorological Data

• Meteorological Data is used in Extension of Time (EOT), Insurance, Disaster Report.

• Below is a graph showing the increasing of Meteorological Data from 1971 to 2011

Percentage of Data

Request According to the

Main Requesting Agencies.

Mahkamah Tinggi 75%

Mahkamah seksyen

17%

Regional Centre for Arbitration

8%

Percentage of Tribunal Court

Percentage of case in court

Issues & Challenges in Climate Services

• Perintah Fi

• Services to all users, including future users

• Data structure must include all user applications

• Quality of data meets the demand of high quality

• Improved measurement and monitoring of climates

• Increased understanding of the causes and patterns of natural variability

• More reliable methods of predicting climate over seasons and years ahead

• Better understanding of the linkages between climate/atmospheric chemicals and a range of social and economic activities and ecological changes

• Capacity building

Way Forward • Mechanisms to ensure that the climate information and prediction

needs of all users are recognized;

• Extensive and systematic collection of climate observations, management of databases and the provision of data;

• Coordination of meteorological, oceanographic, hydrological and related scientific research to improve climate services;

• Multidisciplinary studies to determine national risk and sectoral and community vulnerability related to climate variability and change, to formulate appropriate response strategies, and to recommend national policies;

• Development and provision of extensive climate information and accurate prediction services to meet user needs;

• Linkages to other programmes with similar or related objectives to enhance services and to avoid unnecessary duplication of efforts.

• To establish a single coordinating authority in data handling to ensure that there is no divergence among datasets

• Partnership and capacity enhancement

Terima kasih

THANK YOU