diggs: geotechnical data collection and use€¦ · states of wv, nj, ca, co, ny, and others case...

DIGGS: Geotechnical DataDIGGS: Geotechnical DataCollection and UseCollection and Use

GeohazardsGeohazards in Transportationin TransportationIn the Appalachian RegionIn the Appalachian Region——66thth Annual Technical ForumAnnual Technical Forum

August 2August 2--3, 20063, 2006Lexington, KentuckyLexington, Kentucky

Scot D. Weaver, VPScot D. Weaver, VPMitch Beard, CEOMitch Beard, CEO

GeohazardsGeohazards in Transportationin Transportation——August 2August 2--3, 20063, 2006

A Word on StandardsA Word on Standards

What makes a standard successful?What makes a standard successful?

What makes a standard fail?What makes a standard fail?

Will DIGGS be ‘just another standard’?

(Our own selfish reason for wanting a standard)


From the Environmental and From the Environmental and HydrogeologicHydrogeologic IndustriesIndustries

•• MODFLOW (USGS)MODFLOW (USGS)•• SEDD (USACE, USEPA HQ)SEDD (USACE, USEPA HQ)•• ERPIMS (US Air Force)ERPIMS (US Air Force)•• STORETSTORET•• NWIS (USGS)NWIS (USGS)•• dbQuerydbQuery (NOAA)(NOAA)•• NIRIS/NEDD/NEDTSNIRIS/NEDD/NEDTS•• EarthSoft experience with EPA Regions 2,3,4,5, and EarthSoft experience with EPA Regions 2,3,4,5, and

states of WV, NJ, CA, CO, NY, and othersstates of WV, NJ, CA, CO, NY, and others

Case StudiesCase Studies


A Word on StandardsA Word on Standards

•• OpenOpen–– JAVA, XMLJAVA, XML (we acknowledge Microsoft/ESRI exceptions!)(we acknowledge Microsoft/ESRI exceptions!)–– Consultants are generally unable to set standardsConsultants are generally unable to set standards

•• ““BottomBottom--upup”” rather than rather than ““TopTop--downdown”” standards are more standards are more powerfulpowerful–– MODFLOWMODFLOW

•• Solves a Solves a ‘‘realreal’’ problem?problem?•• ScalabilityScalability•• Sense of Urgency?Sense of Urgency?•• Volume/Price (Microsoft, Oracle, Java, XML, ESRI)Volume/Price (Microsoft, Oracle, Java, XML, ESRI)•• Complexity vs. SimplicityComplexity vs. Simplicity

–– SEDD (DEEMS)SEDD (DEEMS)


Volume:Volume:•• Adopted by state DOTsAdopted by state DOTs•• Adopted by federal agenciesAdopted by federal agencies•• Adopted internationallyAdopted internationally•• Adopted by consultantsAdopted by consultants•• Mandated by state DOTsMandated by state DOTs•• Mandated by federal agenciesMandated by federal agencies•• Mandated internationallyMandated internationally

What Constitutes Success?What Constitutes Success?

…… the DIGGS format needs to be the DIGGS format needs to be usedused to be successfulto be successful


Electronic Data Deliverable (EDD): Data FormatElectronic Data Deliverable (EDD): Data Format

Tab or commaTab or comma--delimited text EDDdelimited text EDD–– aka aka ‘‘flat fileflat file’’ or or ‘‘ASCII fileASCII file’’


Spreadsheet EDDSpreadsheet EDD



XML/GML EDDXML/GML EDD<sample gml:id="bf6615a0-6a74-11da-8cd6-0800200c9a66">

<gml:name codeSpace=“keylab1">12345678452</gml:name> <depthTop uom="m">1.00</depthTop> <type>B</type> <reference>1</reference> <specimen> tests are preformed on a specimen

<gml:name codeSpace=“keylab1">12345678452</gml:name> <depthTop>1.00</depthTop> <depthBase>1.00</depthBase> <description>Soft brown Clay</description> <reference>23</reference> <remarks/> <subsamplingMethod></subsamplingMethod> <roles/> <description>-</description>

</specimen></sample>



XML/GML is great for programmers (and programs), but XML/GML is great for programmers (and programs), but not user friendly for people. Few human users are not user friendly for people. Few human users are going to sit down and write XML without advanced going to sit down and write XML without advanced user interfaces, which may not be available user interfaces, which may not be available at first.at first.

SEDD: A Case StudySEDD: A Case Study

After 4 years, the largest lab in the country has told us After 4 years, the largest lab in the country has told us that EVERY time they deliver the SEDD XML EDD, that EVERY time they deliver the SEDD XML EDD, the client says the client says ““Can you send us the spreadsheet?Can you send us the spreadsheet?””

ieie. They find XML un. They find XML un--readable by humansreadable by humansPS. These are users that are VERY EXPERIENCED with EDDs!PS. These are users that are VERY EXPERIENCED with EDDs!

How will the geotechnical market, new to EDDs, respond to XML?!



XMLXML

•• XMLXML--only EDDs are possible, but is this practical?only EDDs are possible, but is this practical?

•• Many of the users are human, they are not code, Many of the users are human, they are not code, ieie, other software., other software.

•• Most of the users are NOT programmers!Most of the users are NOT programmers!



EDD formatsEDD formats

EarthSoftEarthSoft’’s recommendation: s recommendation:

Publish the exact same EDD in 3 forms: Publish the exact same EDD in 3 forms: flat file, spreadsheet, flat file, spreadsheet, andand XML, with XML, with conversion parsers.conversion parsers.



What Will Make DIGGS Used?What Will Make DIGGS Used?

…… implementation by many independent software implementation by many independent software developersdevelopers……

•• Tools that generate data in DIGGS formatTools that generate data in DIGGS format•• Tools that consume data in DIGGS formatTools that consume data in DIGGS format•• Tools that check for DIGGS correctness/ completenessTools that check for DIGGS correctness/ completeness•• EnterpriseEnterprise--level implementation (Automated Workflow)level implementation (Automated Workflow)•• Added value: application of validation rulesAdded value: application of validation rules•• Added value: facilitation/simplification of data transferAdded value: facilitation/simplification of data transfer•• Added value: enhancement of data useAdded value: enhancement of data use•• Added value: improvement of modeling and analysisAdded value: improvement of modeling and analysis


DIGGS EDD:DIGGS EDD:Flat file,Flat file,

XML/GML orXML/GML orSpreadsheetSpreadsheet

1.1. Intelligent Data Entry Form (IDEF) that creates Intelligent Data Entry Form (IDEF) that creates DIGGS EDDsDIGGS EDDs

How is EarthSoft Implementing DIGGS?How is EarthSoft Implementing DIGGS?


Valid value not found,select correct value from

pull down menu

Required field not populated,

make correction ‘on the fly’

Errors highlighted

EDDs with errorshighlighted

2.2. The EQuIS Data Processor (EDP) will check The EQuIS Data Processor (EDP) will check DIGGS EDDs, using validation rulesDIGGS EDDs, using validation rules



DIGGS EDDDIGGS EDD

3.3. DIGGS EDDs imported into EQuIS using EDPDIGGS EDDs imported into EQuIS using EDPImport tool is Import tool is ‘‘mirror imagemirror image’’ of checking toolof checking tool……..


EQuISData

Processor(EDP)

EQuIS™


4.4. EQuIS exports data in the DIGGS EDDEQuIS exports data in the DIGGS EDD


DIGGS EDD:DIGGS EDD:Flat file,Flat file,

XML/GML orXML/GML orSpreadsheetSpreadsheet

EQuIS™


AccessVB

SQL ServerOracle

.NET, C#, Java


5.5. EQuIS 5 Enterprise ArchitectureEQuIS 5 Enterprise Architecture

Access vs. SQL Server or OracleAccess vs. SQL Server or Oraclea few boreholes vs. thousands of boreholes in the same databasea few boreholes vs. thousands of boreholes in the same database……

a few concurrent users vs. hundreds of concurrent usersa few concurrent users vs. hundreds of concurrent users……



5.5. EQuIS 5 Enterprise ArchitectureEQuIS 5 Enterprise Architecture


AgentsAgents: Reports (or graphics) delivered : Reports (or graphics) delivered automatically via email or web portal automatically via email or web portal (dashboard)(dashboard)

•• May be eventMay be event--driven, i.e.driven, i.e.““a new borehole was entered into the database so a new borehole was entered into the database so AUTOMATICALLY email me the gINT logAUTOMATICALLY email me the gINT log”” (don(don’’t make me come t make me come over there and askover there and ask……))

OrOr

•• May be scheduled, i.e.May be scheduled, i.e.““every Friday at 1 p.m. email me the report plus the updated logsevery Friday at 1 p.m. email me the report plus the updated logsof all new drilling activity for the week.of all new drilling activity for the week.””



Data ProviderStandalone

EDPData Correct?

NoNoEnterprise EDP

on your server:Data Correct?

NoNo

SAME CODE &

CHECKS !!

EQuIS™

YesYes

YesYes——emailemailconfirmation to confirmation to data providerdata provider


Automated Data LoadingFor very large operations


What Will This Exchange of DIGGS Data Mean?What Will This Exchange of DIGGS Data Mean?

?

??

?

? ?

?

?


Scot D. WeaverScot D. WeaverEarthSoft, VPEarthSoft, VP

[email protected]@earthsoft.com435435--245245--93539353

diggs: geotechnical data collection and use€¦ · states of wv, nj, ca, co, ny, and others case...

Documents