enhancing data sharing and access: storet and wqx
DESCRIPTION
Enhancing Data Sharing and Access: STORET and WQX. The STORET Program. STORET: STOrage and RETrieval of water quality monitoring data EPA’s STORET Program: promotes sound data management practices - PowerPoint PPT PresentationTRANSCRIPT
Enhancing Data Sharing Enhancing Data Sharing and Access: STORET and Access: STORET
and WQXand WQX
The STORET ProgramThe STORET Program
STORET: STOrage and RETrieval of water STORET: STOrage and RETrieval of water quality monitoring dataquality monitoring data
EPA’s STORET Program:EPA’s STORET Program: promotes sound data management practices promotes sound data management practices stores and maintains water quality data stores and maintains water quality data
submitted by agencies/groups across the submitted by agencies/groups across the nation in the STORET Data Warehousenation in the STORET Data Warehouse 3
The National STORET Data The National STORET Data WarehouseWarehouse
A national repository of water quality monitoring data – A national repository of water quality monitoring data – “Modernized STORET”“Modernized STORET”
Stores water data of all types (biological, chemical, Stores water data of all types (biological, chemical, physical) submitted by states, tribes, watershed groups, physical) submitted by states, tribes, watershed groups, other federal agencies, and universitiesother federal agencies, and universities
Web-enabled: Data are available -- and can be Web-enabled: Data are available -- and can be submitted -- using the Websubmitted -- using the Web
Encourages data sharing at a national levelEncourages data sharing at a national level
Who Puts Data in?Who Puts Data in?
State environmental agenciesState environmental agencies
Tribal environmental agencies and groupsTribal environmental agencies and groups
Volunteer groups and watershed organizationsVolunteer groups and watershed organizations
UniversitiesUniversities
Federal AgenciesFederal Agencies
Importance of Data SharingImportance of Data Sharing
State and Tribal 106 ProgramState and Tribal 106 Program Water Quality Programs require Monitoring Strategies Water Quality Programs require Monitoring Strategies
that include monitoring objectives, design, etc.that include monitoring objectives, design, etc. Water monitoring data management and sharing is Water monitoring data management and sharing is
vitalvital
Biannual Assessment Reporting Biannual Assessment Reporting State 305(b) and 303(d) programs and Integrated State 305(b) and 303(d) programs and Integrated
ReportingReporting Cross jurisdictional monitoring data in support of Cross jurisdictional monitoring data in support of
water quality condition assessmentswater quality condition assessments
Managing Data LocallyManaging Data Locally
Data sharing at a national level benefits Data sharing at a national level benefits from:from: Well documented data at a local levelWell documented data at a local level Well managed data at a local level Well managed data at a local level
WQX FlowWQX Flow
Updated STORET
HomepageWeb Services
Mapping Applications(EM, WME)
Tools for Data Analysis National STORET
Data Warehouse
Central Data Exchange
(CDX)
WQX Node or
Node ClientSubmission
XML sent via Internet
Processing Software
WQXDatabase
State / TribeData Mgmt System
Exchange NetworkExchange Network
WQX is one of many media “flows” on the WQX is one of many media “flows” on the Exchange NetworkExchange Network
Grants available to all organizations that Grants available to all organizations that wish to submit via WQXwish to submit via WQX States (DEQs, DPHs, Ag agencies); TribesStates (DEQs, DPHs, Ag agencies); Tribes Have various goals – basic capacity to Have various goals – basic capacity to
mentoringmentoring WQX gets over 20 proposals every year WQX gets over 20 proposals every year
(more than any other flow in OW)(more than any other flow in OW)
Goals of the WQX EffortGoals of the WQX Effort
1.1. Make data submittal to WQX easierMake data submittal to WQX easier
2.2. Make data sharing more sustainableMake data sharing more sustainable
3.3. Make it easier to get data out of Make it easier to get data out of STORETSTORET
Goal 1: Data Easier to submitGoal 1: Data Easier to submit
WQX 1.0 was released in February 2007WQX 1.0 was released in February 2007 Since then we’ve received >7 million results Since then we’ve received >7 million results
via WQXvia WQX WQX 2.0 was released in July 2008WQX 2.0 was released in July 2008
Convened a workgroupConvened a workgroup Identified and discussed data elementsIdentified and discussed data elements Finalized the schema in April 2008Finalized the schema in April 2008
WQX Web currently availableWQX Web currently available Small organization’s data submission toolSmall organization’s data submission tool
Goal 2: More SustainableGoal 2: More Sustainable
WQX is based around the ‘Science of WQX is based around the ‘Science of water monitoring’, not a technologywater monitoring’, not a technology
No longer chasing a specific technologyNo longer chasing a specific technology No longer force our data partners to run a No longer force our data partners to run a
particular software in order to share dataparticular software in order to share data
Goal 3: Easier to get data out of Goal 3: Easier to get data out of STORET STORET
Began efforts to revamp sections of the Began efforts to revamp sections of the STORET web siteSTORET web site Created new mapping interfacesCreated new mapping interfaces Created Watershed summary reportsCreated Watershed summary reports Created Web ServicesCreated Web Services
What does WQX mean for users?What does WQX mean for users?
Distributed STORET users:Distributed STORET users: Need to get a replacement databaseNeed to get a replacement database Found that a lot of states where mainly using Found that a lot of states where mainly using
distributed STORET as a way of submitting – not to distributed STORET as a way of submitting – not to actually manage dataactually manage data
Non distributed STORET users:Non distributed STORET users: Can continue to use their own databasesCan continue to use their own databases Must “map” their data to the common schemaMust “map” their data to the common schema
Small usersSmall users WQX Web is the tool they can useWQX Web is the tool they can use
State / Tribal WQX UsersState / Tribal WQX Users The following organizations, by region, have submitted The following organizations, by region, have submitted
data via WQX data via WQX R1: ME DEP, VT DEC, RI DEMR1: ME DEP, VT DEC, RI DEM R3: PA DEP, DE DNREC, DRBC, WV DEPR3: PA DEP, DE DNREC, DRBC, WV DEP R4: GA EPDR4: GA EPD R5: WI DNR, MI DEQR5: WI DNR, MI DEQ R6: TX CEQR6: TX CEQ R7: EPA R7 monitoring programR7: EPA R7 monitoring program R8: Wind River TribesR8: Wind River Tribes R9: Yurok Tribe, Big Valley Rancheria, HualapaiR9: Yurok Tribe, Big Valley Rancheria, Hualapai R10: Stillaguamish TribeR10: Stillaguamish Tribe BEACHES programs across many statesBEACHES programs across many states
Data Coverage: 2004Data Coverage: 2004
20082008
A new tool that is easy to use for submitting data to EPAA new tool that is easy to use for submitting data to EPA Accepts basic input formats (i.e. Excel Spreadsheets)Accepts basic input formats (i.e. Excel Spreadsheets) Tool will have translations for mapping data to WQX Tool will have translations for mapping data to WQX
domain values or defaultsdomain values or defaults Tool creates WQX XML that a user can send through the Tool creates WQX XML that a user can send through the
WQX frameworkWQX framework
WQX WebWQX Web
Accessing DataAccessing DataThe National STORET Data Warehouse serves as the national repository for Modern STORET data as well as WQX data. Users may obtain data from the warehouse through the STORET home page : www.epa.gov/storet
Web services providing direct access to warehouse data will also provide enhanced accessibility to the data.
STORET Warehouse UpdatesSTORET Warehouse Updates
The National STORET Data Warehouse The National STORET Data Warehouse enhancements for improved data enhancements for improved data accessibilityaccessibility New Watershed Summary – Available NowNew Watershed Summary – Available Now New Web Services – Available NowNew Web Services – Available Now
Please visit the STORET website for more Please visit the STORET website for more information : www.epa.gov/storetinformation : www.epa.gov/storet
Watershed Summary ExamplesWatershed Summary Examples