keith eggleston regional climatologist northeast rcc climate data tools: xmacis, nowdata and...
TRANSCRIPT
Keith EgglestonKeith Eggleston
Regional ClimatologistRegional Climatologist
Northeast RCCNortheast RCC
Climate Data Tools:Climate Data Tools:xmACIS, NOWData and ThreadExxmACIS, NOWData and ThreadEx
Applied Climate Information System Applied Climate Information System (ACIS)(ACIS)
ACIS Database
xmACIS ThreadEx
NOWData
ACIS MapsCLIMOD
AgACIS
ACIS DatabaseACIS Database
NCDC archiveNCDC archive
ACIS DatabaseACIS Database
NCDC archive NCDC archive
ACIS DatabaseACIS Database
NCDC archive –NCDC archive –Data from Climate Data from Climate
Database Database Modernization ProgramModernization Program
ACIS DatabaseACIS Database
Daily Summary Daily Summary Messages for ASOS Messages for ASOS
stations added as stations added as received, beginning received, beginning
around 4am ETaround 4am ET
ACIS DatabaseACIS Database
Daily CLI Messages Daily CLI Messages from NWS added as from NWS added as received, beginning received, beginning
4am ET4am ET
ACIS DatabaseACIS Database
Preliminary COOP Preliminary COOP station data from NWS station data from NWS
added as received added as received throughout the daythroughout the day
ACIS DatabaseACIS Database
Some data is keyed Some data is keyed and QC’ed at the and QC’ed at the Regional Climate Regional Climate
Centers – about 2-3 Centers – about 2-3 weeks after the end of weeks after the end of
the data monththe data month
ACIS DatabaseACIS Database
Unique data contributed Unique data contributed by NWS offices allows by NWS offices allows
extension of record extension of record back in timeback in time
ACIS DatabaseACIS Database
NCDC datasets NCDC datasets updated as data are updated as data are
released – preliminary released – preliminary keyed, preliminary keyed, preliminary quality control, final quality control, final
quality controlquality control
ACIS DatabaseACIS Database
Other Networks:Other Networks:High Plains automated High Plains automated
networknetwork
ACIS DatabaseACIS Database
Other Networks:Other Networks:USDA SNOTEL and USDA SNOTEL and
SCAN networksSCAN networks
ACIS DatabaseACIS Database
Flexible architecture Flexible architecture allows for future allows for future
expansionexpansion
Buffalo ACIS DataBuffalo ACIS Data
Jan 1871 - Dec 1921 CRB
Jan 1922 - Dec 1945 DSI-3200 (COOP id 301012)
Jan 1946 - Apr 2007 DSI-3210 (WBAN id 14733)
May - June 2007 Extracted from CLI
DSI-3210 updated monthly as received from NCDC.CLI statements added to database every morning.Datzilla updates added as processed.
Ithaca ACIS DataIthaca ACIS Data
Jan 1893 - Dec 1925 DSI-3206 (COOP id 304174)
Jan 1926 - Jan 2007 DSI-3200 (COOP id 304174)
Feb 2007 DSI-3202 NCDC Prelim
Mar - Apr 2007 NRCC Keyed
May - June 2007 Extracted from RR3
DSI-320x updated 3/month as received from NCDC.SHEF-encoded data added to database every morning.Datzilla updates added as processed.
xmACIS - New FeaturexmACIS - New Feature
xmACIS - New FeaturexmACIS - New Feature
NOWDataNOWData
Public interface to ACIS database.Public interface to ACIS database.
Available on all NWS climate web pages.Available on all NWS climate web pages.
Subset of data and products available on Subset of data and products available on
xmACIS interface.xmACIS interface.
Station lists can be modified upon request Station lists can be modified upon request
through the Regional CSPMs.through the Regional CSPMs.
NOWDataNOWData
NOWDataNOWData
Station list• All real-time stations with normals• Other stations as requested by NWS offices
ThreadEx - The IssueThreadEx - The Issue
What climatological records should be used What climatological records should be used as the basis for U.S. daily climate extremes as the basis for U.S. daily climate extremes that are reported by the media, NWS, and that are reported by the media, NWS, and others?others?
Current extreme records reporting are Current extreme records reporting are inconsistent, based on varying combinations inconsistent, based on varying combinations of multiple observing sites.of multiple observing sites.
Example - ChicagoExample - Chicago
1870 1880 1890 1900 1910 1920 1930 1940 1950 1960 1970 1980 1990 2000
Chicago O’Hare Airport 1958-Present
Chicago Midway Airport 1928-Present
University of Chicago 1916-95
1872-1970 Chicago Weather Bureau City Office
Threading ProcessThreading Process
Target Stations: Published LCD sites (~260)Target Stations: Published LCD sites (~260) Starting Point: Current ASOS SiteStarting Point: Current ASOS Site Consideration of Historical PrecedentConsideration of Historical Precedent
1) NWS / WB 1) NWS / WB
2) COOP2) COOP Overlaps: Yield to the More Recent Site Overlaps: Yield to the More Recent Site No Adjustments for InhomogeneitiesNo Adjustments for Inhomogeneities!! Station Threads Vetted by Partners:Station Threads Vetted by Partners:
• Northeast Regional Climate Center (Developer)Northeast Regional Climate Center (Developer)• NWS Field, State Climatologists (Reviewers)NWS Field, State Climatologists (Reviewers)
Back to Chicago ExampleBack to Chicago Example
1. Chicago CRB
5. Chicago O’Hare Airport
4. Chicago Midway Airport
3. University of Chicago
2. Chicago WB Office
1958-Present
1870 1880 1890 1900 1910 1920 1930 1940 1950 1960 1970 1980 1990 2000
1958-Present
1942-58
1926-41
1896-1925
1871-95
Threaded RecordThreaded Record Unused Portion of RecordUnused Portion of RecordUnused Portion of Record
ThreadEx ExtremesThreadEx Extremes
Station tables are available on the webStation tables are available on the web• Will be updated at least annuallyWill be updated at least annually• http://threadex.rcc-acis.orghttp://threadex.rcc-acis.org
Daily top three records and years for:Daily top three records and years for:• Highest Maximum TemperatureHighest Maximum Temperature• Lowest Maximum TemperatureLowest Maximum Temperature• Highest Minimum TemperatureHighest Minimum Temperature• Lowest Minimum TemperatureLowest Minimum Temperature• Greatest PrecipitationGreatest Precipitation
ThreadEx BenefitsThreadEx Benefits
ThreadEx will provide…ThreadEx will provide…
• MaximizedMaximized• ConsistentConsistent• Routinely updatedRoutinely updated• Freely available Freely available
… … daily climate records for principal observing stations daily climate records for principal observing stations in the United States.in the United States.
ThreadEx is for general public use, NOT for research (no ThreadEx is for general public use, NOT for research (no homogeneity adjustments).homogeneity adjustments).
Additions to ACIS DatabaseAdditions to ACIS Database
NOAA’s Climate Database Modernization Program NOAA’s Climate Database Modernization Program (CDMP) has keyed a large amount of pre-1948 data – (CDMP) has keyed a large amount of pre-1948 data – data that has not been consistently used before.data that has not been consistently used before.
NRCC, in cooperation with the National Weather NRCC, in cooperation with the National Weather Service, has obtained a significant amount of historical Service, has obtained a significant amount of historical data digitized by local NWS offices that was not part of data digitized by local NWS offices that was not part of the NCDC archives.the NCDC archives.
NRCC is performing quality control of historical data from NRCC is performing quality control of historical data from the CDMP Climate Record Books project. This will add the CDMP Climate Record Books project. This will add as much as 75 years to the beginning of station records.as much as 75 years to the beginning of station records.
San Francisco ThreadSan Francisco Thread
SAN FRANCISCO INTL AP (DSI-3210) 07/1945 to 12/2005
SAN FRANCISCO CITY (DSI-3210) 01/1921 to 06/1945
SAN FRANCISCO CITY (CRB) 01/1871 to 12/1920
SAN FRANCISCO CITY (supplied by NWS) 10/1849 to 12/1870
NWS-Contributed DataNWS-Contributed Data
Daily data - max and min temperature, precipitation, Daily data - max and min temperature, precipitation,
snowfall and snow depthsnowfall and snow depth
Variety of formatsVariety of formats• XMClimate netCDFXMClimate netCDF• Excel spreadsheetExcel spreadsheet• Text fileText file
Data has been contributed for 70 stations to dateData has been contributed for 70 stations to date
Contact Keith Eggleston (Contact Keith Eggleston ([email protected]@cornell.eduedu))
ATL 090456: 10/1878-08/1928 090451: 09/1928-12/2005 ATT 410420: 09/1891-08/1942 410428: 09/1942-11/2005 BDL 063451: 10/1904-12/1948 BHM 010836: 04/1895-11/1945 010831: 12/1945-12/2005 BIL 240807: 08/1934-11/2005 BIS 320819: 10/1874-09/2005 BOS 190775: 01/1872-12/1919 BRO 413259: 01/1878-10/1916 …411136: 04/1942-11/2005 BTV 431081: 01/1893-05/2005 BWI 180470: 01/1871-07/1950 180465: 07/1950-11/2005 CNK 141769: 05/1885-04/1962 141767: 05/1962-01/2005 CRP 412010: 02/1887-10/1942 412015: 10/1942-12/2005 DCA 189290: 01/1871-06/1929 448906: 07/1929-11/2005 DRT 412357: 01/1906-04/1951 …412360: 03/1963-11/2005 DSM 132208: 08/1878-11/2005 DTW 202118: 12/1894-12/1933 …202103: 04/1966-12/2005 EKA 042910: 12/1886-04/2003 ELP 412799: 01/1879-11/1942 412797: 12/1942-12/2004 FAI 509641: 09/1904-11/1929 502968: 12/1929-12/2002 FLG 023007: 09/1898-12/1949 023010: 01/1950-11/2005 FSD 397667: 01/1893-01/2006 FSM 032580: 06/1882-12/1900 GEG 457938: 02/1881-11/2005 GJT 053485: 01/1893-04/1946 053488: 05/1946-01/2006 GRI 253395: 10/1895-12/1899 GRR 203337: 04/1892-12/1940 …203333: 12/1963-12/2005 GTF 243749: 12/1891-03/1937 243751: 04/1937-11/2005 HLN 244057: 04/1880-04/1940 244055: 05/1940-11/2005 HON 394135: 07/1881-02/1939 394127: 02/1939-01/2006 HSV 014976: 02/1894-12/1936 …014064: 09/1958-11/2005 HVR 243994: 01/1880-01/1961 243996: 02/1961-11/2005 IND 124264: 02/1871-12/1942 124259: 01/1943-11/2004 IPT 369733: 02/1895-12/1944 369728: 01/1945-12/2004 LAN 202394: 04/1863-04/1948 …204641: 05/1959-10/2005
LBF 256070: 09/1874-12/1947 256065: 01/1948-12/2005 LIT 034248: 07/1879-12/1897 LMK 154958: 11/1995-12/2005 LOT 117457: 01/1992-08/1997 LSE 474375: 10/1872-12/1950 474370: 01/1951-08/2004 LWS 105230: 09/1881-12/1947 105241: 08/1948-11/2005 LYH 445121: 01/1893-01/1930 445120: 02/1930-01/2005 MCI 234370: 07/1888-12/1893 MDT 363711: 01/1889-05/1939 …365703: 10/1991-12/2004 MEM 405964: 01/1872-12/1939 405954: 01/1940-12/2005 MGM 015555: 09/1892-06/1948 015550: 07/1948-12/2005 MIA 085668: 12/1900-01/1939 085663: 02/1939-12/1945 MSP 217386: 01/1871-06/1933 OMA 256220: 01/1871-05/1935 …256255: 01/1994-11/2005 ORD 111582: 01/1871-12/1896 ORF 446144: 01/1874-12/1945 446139: 01/1946-04/1951 ORH 199928: 01/1904-12/1947 PBI 084471: 01/1888-12/1899 …089520: 01/1930-12/1945 PHL 366909: 01/1872-6/1940 366889: 06/1940-01/1999 PHX 026486: 08/1895-09/1963 026481: 10/1963-11/2005 PVD 376703: 11/1904-05/1932 376698: 06/1932-12/1947 RAP 396937: 08/1942-12/1948 RIC 447206: 01/1887-12/1929 447201: 01/1930-04/1951 RST 217004: 07/1886-02/1893 SAT 417950: 03/1885-12/1940 …417945: 07/1942-11/2005 SDF 154956: 08/1872-06/1945 154954: 07/1945-12/2005 SFO 047772: 10/1849-01/1871 SPI 118184: 07/1879-12/1879 SUX 137712: 07/1889-04/1941 137708: 05/1941-01/2006 TOP 148172: 06/1887-07/1946 148167: 08/1946-01/2005 TUL 348987: 08/1893-12/1930 348992: 01/1931-12/1992 TUP 229000: 01/1930-04/1969 229003: 05/1969-12/2005 TUS 028815: 10/1894-12/1929 028820: 01/1930-11/2005 UNR 396947: 01/1888-04/1972 396948: 01/1996-11/2005 YUM 029662: 01/1893-07/1949 …029646: 12/1995-11/2005
Climate Record BooksClimate Record Books
Daily dataDaily data• Maximum, minimum and average temperatureMaximum, minimum and average temperature• PrecipitationPrecipitation• SnowfallSnowfall
Monthly summarized dataMonthly summarized data• Totals, meansTotals, means• ExtremesExtremes• Number of daysNumber of days
Period of recordPeriod of record• Back to late-1800s for many locationsBack to late-1800s for many locations
Existing Period of RecordExisting Period of Record
Nashville, TN
Fort Worth, TX
Newark, NJ
1866 1886 1906 1926 1946 1966 1986 2006
1935-2006
1946-2006
1948-2006
Addition of CRBAddition of CRB
Nashville CRB
Nashville, TN
Fort Worth CRB
Fort Worth, TX
Newark CRB
Newark, NJ
1866 1886 1906 1926 1946 1966 1986 2006
1935-2006
1946-2006
1948-2006
1931-1990
1898-1970
1871-1970
Seattle PrecipitationSeattle Precipitation
Annual Precipitation - Seattle from TD3200
10.00
15.00
20.00
25.00
30.00
35.00
40.00
45.00
50.00
55.00
1948 1958 1968 1978 1988 1998
Precipitation (inches)
… … with CRB addedwith CRB added
Seattle Annual Precipitation - CRB and TD3200
10.00
20.00
30.00
40.00
50.00
60.00
1878 1898 1918 1938 1958 1978 1998
Precipitation (inches)
CRB TD3200
Overlap period
Number of CorrectionsNumber of Corrections
StationStation CorrectionsCorrections Total ObsTotal Obs PercentPercent
Augusta, GAAugusta, GA 18451845 218,845218,845 0.8%0.8%
Key West, FLKey West, FL 10731073 219,000219,000 0.5%0.5%
Raleigh, NCRaleigh, NC 962962 116,800116,800 0.8%0.8%
Fresno, CAFresno, CA 27272727 188,900188,900 1.4%1.4%
Syracuse, NYSyracuse, NY 11691169 124,702124,702 0.9%0.9%
Wilmington, NCWilmington, NC 19301930 219,000219,000 0.9%0.9%
Fort Worth, TXFort Worth, TX 407407 132,625132,625 0.3%0.3%
(~99% of corrections are key-entry errors)(~99% of corrections are key-entry errors)
Station HistoryStation History
Dallas Fort Worth observing sites for ThreadEx:
Begin End WBAN Coop Name and Location9/1/1898 10/31/1934 23905 - Federal Building: Jennings Ave between Texas and 11th St11/1/1934 12/31/1939# 23905 - US Courthouse: 10th St between Burnett and Lamar St1/1/1940 4/25/1953 13961 413284 Fort Worth Meacham Field4/26/1953 8/13/1974 03927 413283 Fort Worth Greater Southwest Intl Airport8/14/1974 present 03927 412242 Dallas Fort Worth Intl Airport
# Office moved 1/5/1940. Unsure when exactly instruments were moved.
WBAN ids for CRB:9/1/1898 12/31/1939 239051/1/1940 4/25/1953 139614/26/1953 12/31/1970 03927
Sources: NCDC LCD, NCDC MMS, Climate Record Books, Daniel Huckaby NWS FWD, Form 1001.
DFW - Dallas/Fort Worth