GOFC / GOLD Fire IT MeetingGOFC / GOLD Fire IT MeetingMontreal, CanadaMontreal, Canada

7 7 –– 9 Feb 20059 Feb 2005

Australian Burnt Area Mapping Validation Network

Grant AllanGrant AllanBushfires Council NTBushfires Council NT

Alice Springs AustraliaAlice Springs Australia

Australian Burnt Area Mapping Validation Network

• Initial conception : June 2002Fire in Savanna Landscapes ConferenceDarwin, Australia

• First network meeting: Oct. 20033rd International Wildland Fire ConferenceSydney, Australia

• Second network meeting : Oct. 2004Australasian Remote Sensing ConferenceFremantle, Australia

Source: WA Dept of Land Information (DLI)

Australian AVHRR-derivedburnt area map :1997 to 2003

3 major climate / fire regions of Australia(Myers et al. 2004)

Wet-dry tropical savannas

End of Wet Season Fuel Loads Early Dry Season ACB

Dry Season FiresLate Dry Season Extensive andIntensive Wildfires

Semi-arid and arid interiorExtensive sandplains and dunefields Dry rivers and open shrublands

Complex topography Infrequent large fires

Southern Temperate ZoneCoastal and Urban areas Mixed Land Use and WUI

Forests and Shrublands

Destructive Fires

Australian burnt area mapping validation sites

2002 AVHRR-derived burnt areas

7 sites used in initial 2002 validation analysis

Australian Validation Network 2005 Program (1)

• Second phase of 2002 analysis– Improved spatial and temporal representativeness

• Incorporate all 11 validation sites• Assess seasonal robustness

– Check areas of uncertainty in global dataset• Reporting schedule

– Contribute to 2002 report– Summary report and one-page flyer– Website of site characteristics, process and results– Contribute to qualitative product performance

reporting metrics (concept from SAFNet)

Australian Validation Network 2005 Program (2)

• 2004/2005 Second Validation Exercise– Minimum of 6 validation sites

• Savannas: Arnhem Land, Cape York• Arid zone: Southern Tanami, Pilbara• Temperate: Sydney Basin, SW Qld Forests

– Comparison of global burnt area mapping with 3 existing Australian fire affected area products:

• DLI weekly accumulated near-real time 250m MODIS product;

• DLI AVHRR 1km product, and• NAFI (North Australian Fire Information) 250m MODIS

(object-oriented) product.• Establish links with GOFC/GOLD and other

regional fire programs (i.e. CIFOR in SE Asia)

6 sites for initial 2004 validation analysisin relation to 2004 AVHRR-derived burnt area map

Northern Australia Accuracy Assessments

• BIBLE-B Project 1999

• GLOBSCAR Australia 2000

• State of Environment Report 2001

• Kakadu / West Arnhem 2003

• BFCNT vs. DLI MODIS Mapping 2004

BIBLE-B Project 1999(Japanese Space Agency Biomass Burning and Lightning Expt.)

• Burnt area mapping and assessment– Aerial transects vs. Landsat vs. AVHRR

• Fuel accumulation curves

• Biomass burning estimates

Ref: Russell-Smith, J, Edwards, AC and Cook, GD (2003) Journal of Geophysical Research – Atmospheres, 108

Mapped data Aerial transect data

Burnt Unburnt Total

Burnt 542 68 610 (88.9)

Unburnt 149 603 752 (80.2)

TOTAL 691 (78.4) 671 (89.9) 1362 (84.1)

36178329.227.472.6Mean (n=5)

65178348 (1.48)71109052 (1.61)(v) 32 km2

92080179 (0.89)174555147 (0.73)(iv) 202 km2

451090318 (1.35)252377239 (1.02)(iii) 235 km2

422674394 (1.16)164852232 (0.68)(ii) 341 km2

1912881390 (1.08)1711891,365 (1.06)(i) 1,293 km2

Five individual fires2

3121794,866 (1.11)2235653,873 (0.88)Over entire LANDSAT scene—4,396 km2

Commission(%)

Omission(%)

Intersection(%)

Burnt area(km2)

Commission (%)

Omission(%)

Intersection(%)

Burnt area(km2)

BFCNT AVHRR mappingDLI AVHRR mappingLANDSAT TM

GLOBSCAR Australia 2000

• Comparison of GLOBSCAR active fire detection vs AVHRR burnt area maps

Ref: Allan, GE (2002) unpublished

2000 GLOBSCAR % of DLI DLI

January 241.4 0 0

February 18.7 0 0

March 73.1 0 0

April 82.9 0 0

May 62.2 2.9 2134.2

June 3.6 0.9 412.5

July 615.6 28.4 2166.2

August 1858.1 10.3 17999.2

September 2552.2 6.4 39720.5

October 621.7 1.8 34473.4

November 454.4 112.8 402.8

December 257.5 71.5 360.0

TOTAL 6841.4 7.0 97668.7

2000 GLOBSCAR % of DLI DLI

January 574.6 0.0 0.0

February 113.4 0.0 0.0

March 247.6 0.0 0.0

April 100.8 0.0 0.0

May 3565.2 32.6 10937.3

June 8472.2 45.6 18598.1

July 7554.5 105.5 7161.4

August 11889.7 52.1 22807.5

September 15479.6 45.7 33875.0

October 3958.5 17.1 23192.4

November 1497.1 58.1 2576.2

December 231.7 13.4 1735.4

TOTAL 53684.8 44.4 120883.3

Top End Central Australia

Landsat burnt area

100 km

DLI AVHRR burnt area

GLOBSCAR fire detection

State of Environment Report 2001

• 5 study areas within the tropical savannas– 1997 to 2000

• Aerial and vehicle transects• Landsat TM mapping• AVHRR mapping

Ref: Yates, CP and Russell-Smith, R (2002) State of Environment Report Appendix 2

Landsat vs. AVHRR burnt area maps

Kakadu / West Arnhem 2003

• Aerial transects• Landsat TM burnt area mapping• MODIS 250m burnt area mapping

– Using Ecognition(object-oriented classification)

Ref: Edwards, AC (2004) Australasian Remote Sensing Conference, Fremantle

Validation Point

Unburnt

Burnt

Aerial Validation data over Landsat Fire Mapping

Fire MappingMayJulyOctober

kilometres

Area Burnt in 2003:11,600 km2 (27%)

Validation dataBurnt Unburnt Row total

Burnt 94 20 114Unburnt 58 244 302column total 152 264 416

mapped data

Kakadu National Park Aerial Validation Data

Overall accuracy = 81.3%

244139105column total14812820Unburnt961185Burntmapped

data

Row totalUnburntBurntValidation dataWest Arnhem Land

Aerial Validation Data

Overall accuracy = 87.3%

Map Grid over Study Area

Results of Regression Analysis

SatelliteSensor

Terra MODIS

NOAA AVHRR

Landsat ETM - Early 0.90 0.65

Landsat TM - Late 0.91 0.39

Landsat ETM/TM - Season Total 0.93 0.55

TerraMODIS - Early

0.61

Terra MODIS - Late 0.49

Terra MODIS - Season Total 0.54

• 348 grid cells• 10 x 10 kms• unique values

BFCNT vs. DLI MODIS Mapping 2004

• MODIS 250m BFCNT burnt area mapping using Ecognition (object-oriented classification)

• MODIS 250m DLI automated burnt area mapping

Study area = N.T. north of – 19°(approx. 700,000 km²)

Ref: Edwards, AC (2004) unpublished

Sum of count BFCNT

DLI WA Notmapped April May Jun July Aug Sept Oct TOTAL

NotMapped 120162 146555 197358 275978 143721 193137 992595 2069506

April 1735 620 3 25 15 30 163 2591

May 8009 1571 2125 87 114 46 49 145 12146

Jun 1926 8 588 2024 451 144 78 156 5375

July 18286 695 958 369 92920 436 489 675 114828

Aug 27057 1440 996 847 27898 175230 2439 2571 238478

Sept 40737 1898 1209 1294 1671 8620 462798 9459 527686

Oct 245706 3434 2451 1176 1835 679 13512 905159 1173952

TOTAL 343456 129828 154885 203155 400892 328891 672532 1910923 4144562

0.28kappa

0.40overall accuracy

0.470.690.530.230.010.010.00omission

0.770.880.730.810.380.170.24commission

OctSeptAugJulyJuneMayApril

GOFC / GOLD Fire IT MeetingGOFC / GOLD Fire IT MeetingMontreal, CanadaMontreal, Canada

7 7 –– 9 Feb 20059 Feb 2005