1
SICoP 2011:Transforming Government through
Innovation with Semantic TechnologiesSemantic Tech and Business Conference, November 29 – December 1, 2011Brand Niemann, Director and Senior Data Scientist, Semantic Community
Mills Davis, Managing Director, Project 10XChuck Rehberg, CTO, Semantic Insights
2
Some Examples of Build Systems of Systems in the Cloud
• Semantic Community - US EPA and Federal CIO Council• 1105 Government Information Group – Wyatt Kash• SEMIC.EU – Francisco Garcia Moran• DoD CIO – Teri Takai• Army Systems of Systems Engineering – Terry Edwards• NIEM PMO – Donna Roy• FAA – NextGen – Steve Cooper• Intelligence Community – Gus Hunt and Todd Myers• METI – Hiroyuki Hotta• DoD DCMO CTO – Dennis Wisnosky
3
DoD Deputy Chief Management Officer (DCMO) Request for Information (RFI)
http://semanticommunity.info/Build_DoD_in_the_Cloud/Enterprise_Information_Web_for_Semantic_Interoperability_at_DoDhttp://fcw.com/Articles/2011/11/25/DOD-RFI-semantic-web-data-sharing.aspx
4
Build DoD in the Cloud
http://semanticommunity.info/Build_DoD_in_the_Cloud
5
6
System of Systems Architecture
SSemantic Index ofLinked Data(e.g. Excel)
Dynamic Case Management (e.g. Be Informed)
Data Science Library (e.g. Spotfire)
Data Science Products (e.g. Spotfire)
7
DoD CIO: IT Enterprise Strategic Management Tutorial
Brand NiemannDirector and Senior Data Scientist
Semantic CommunityOctober 28, 2011
8
My Best Strategic Advice to You Is:Service Steps Tool Process
1. Provision Instead of Procure
Amazon Federal (secure) Web Services
AWS’s Migrating Applications to the Cloud
2. Linked Data on Mobile Devices for the Warfighter
MindTouch, Excel, SIRA, & Spotfire
Build DoD in the Cloud
3. Dynamic Case Management for Business Agility
Be Informed Be Structured
Demos Title URL
AWS Gov Cloud Summit II AWS Provision and Migrate Web
Army Weapons 2011 Knowledge and Capability Management Services for ASA(ALT) SOSE
Web
SemTech 2011 Washington DC
So Our Veterans Can Be Informed
Web
9
Applying Data Science to Build a Knowledgebase
• Knowledgebase = Model + Instances• Model = Vocabulary, Taxonomy, and
Ontology/Rules• Instances = Linked Data Semantically Linked to
the Model
10
Applying Data Science to Build a Knowledgebase
• Model =– Vocabulary – Glossary in MindTouch– Taxonomy - Contents and Resources in MindTouch– Ontology/Rules in Be Informed
• Instances =– Linked Data Semantically Linked to the Model –
MindTouch, Excel and Spotfire
11
Business Process
• Best Content to a Knowledgebase (MindTouch)– DoD IT Enterprise Strategy and Roadmap, etc.
• Knowledgebase to Spreadsheet (Excel)– Linked Data to Subparts of the Knowledgebase
• Excel to Dashboard (Spotfire)– Data integration and interoperability interface
• Spotfire Dashboard to Dynamic Case Management (Be Informed)– Structured process for updating data in the dashboard
12
Best Content to a Knowledgebase (MindTouch)
http://semanticommunity.info/DoD_CIO/DoD_IT_Enterprise_Strategy_and_Roadmap
Well-defined URLs tosubparts of the documentand figure and tables.
13
Best Content to a Knowledgebase (MindTouch)
http://semanticommunity.info/DoD_CIO/DoD_IT_Enterprise_Strategy_and_Roadmap#Executive_Summary
Desktop publishing-like control of content.
14
Knowledgebase to Spreadsheet (Excel)
http://semanticommunity.info/@api/deki/files/15416/=DoDCIO.xlsx
15
Knowledgebase to Spreadsheet (Excel)
http://semanticommunity.info/@api/deki/files/15416/=DoDCIO.xlsx
16
Excel to Dashboard (Spotfire)
PC Desktop
17
Excel to Dashboard (Spotfire)
Web Player
See the DataSort/Facet Search the DataDownload the DataShare the Data (iPad)
18
Spotfire to Be Informed• Be Structured Questions:
– Greenfield: Are you starting the report from scratch?– Legacy: Are you updating the report?– Dynamic Case Management: Does Spotfire need to be updated
frequently?• So the Business Process Pattern Includes:
– Greenfield, Legacy, and Dynamic Case Management• Definitions (and Rules!):
– DoD Dictionary and JCDIS Manual• Executable Model:
– Semantically Linked Taxonomy, Ontology, and Rules (started in previous slides)
19
Spotfire to Be Informed
http://semanticommunity.info/DoD_CIO#Live_Demos
Semantic Insights Research Assistant (SIRA).See next slide.
20
SIRA: Builds a simple report and an ontology of the content
http://semanticommunity.info/@api/deki/files/15875/=Automated_Traceability_of_Key_Success_Factors-f.pptx
21
Spotfire to Be Informed
Web Player
DoD Dictionary Terms (5093) and Acronyms (6599)DoD Campaign Plan (100 Linked data URLs)GAO DoD Enterprise Architecture (113 Linked data URLs)JCDIS Manual (405 Linked data URLs)
Note: There are additional Spotfire files with DoD data:Build DoD (Vocabulary) in the CloudBuild DoD Semantic Data Architecture in the CloudBuild the DoD IG Report to Congress in the CloudSee: Binary Services for DoD CIO and DHS NIEM PMO,PowerPoint, October 14, 2011, 48 slides.
22
Work in Process
http://semanticommunity.info/Build_DoD_in_the_Cloud/Enterprise_Information_Web_for_Semantic_Interoperability_at_DoD#Spotfire_Dashboard
23
Federation of Data Sets Strategy• One Table:
– Two Columns• Example: Column 1: Section and Column 2: URL
– Note: A Column 3: Description could be in the URL– Example: See Slide 14
– Three Columns:• Example: Column 1: Subject, Column 2: Object, and Column 3: Predicate
– Note: This is the Semantic Web’s Linked Open Data Cloud as Linked Open Data for Network Analytics!
– Example: See Next Slide
– Four Columns:• Examples: Column 1: Subject, Column 2: Attribute, Column 3: From, and
Column 4: To, or Column 1: City, Column 2: Country, Column 3: Longitude, and Column 4: Latitude– Note: This is the format for Spotfire’s Network Analytics Module developed for the CIA– Example: See Slide 25
24
Linked Open Data Cloud as Linked Open Data for Network Analytics
http://semanticommunity.info/@api/deki/files/8824/=VIVO.xlsx
Is it easy to add columns for who links to who? Not in a single table. SPARQL can't do cross-tabulation (Richard Cyganiak).
25
Spotfire Network Analytics
http://semanticommunity.info/AOL_Government/Social_Media_-_Six_Degrees_of_Separation_and_Now_Even_Less
26
Federation of Data Sets StrategyMultiple Data Tables
http://semanticommunity.info/Build_DoD_in_the_Cloud/Enterprise_Information_Web_for_Semantic_Interoperability_at_DoD/Spotfire_Data_Federationhttp://semanticommunity.info/Build_DoD_in_the_Cloud/Enterprise_Information_Web_for_Semantic_Interoperability_at_DoD/Spotfire_Information_Designer
27
Spotfire Information Designer
28
Spotfire Information Designer
29
Federated SPARQL Query: CKAN
http://semantic.ckan.net/snorql/
Federated SPARQL Query across 14 data sourcesfor 40,000 results (Richard Cyganiak). See Slide 31.
30
Federated SPARQL Query: Virtuoso
https://plus.google.com/112399767740508618350/posts/i8rsLhugG6V
Linked Data Virtualization meets Oracle via ODBC (Kingsley Idehen)
31
Spotfire: Semantic Web Data
W3C Linked Data Community Directory (David Wood, as of November 28, 2911)
Web Player
32
DoD RFI Questions• Can the interview be done at/after the November 30th Industry Discussion? • Can one see the EIW work done so far in presentations and Web content? • Can one use the EIW public content to pilot semantic technologies while all of this RFI process is going
on?• Is the overall goal to significantly reduce the number and cost of DoD Information Systems as my first
story found?• Is the RFI goal to federate selected DoD content for delivery to the warfighter on mobile devices over
secure networks? E.g. my TBI knowledgebase• Is the RFI goal to deliver public DoD content so the public can better understand and use it? E.g. my
Weapons Systems 2011 knowledgebase• Is the RFI goal to use the most advanced semantic technology that I know of to do Dynamic Case
Management (e.g. Be Informed)?• Is the DoD considering forming a Semantic Interoperability Center of Excellence like the EU’s SEMIC.EU?• Should industry form a non-profit consortium with multiple organizations to do this kind of work under
say a CRADA like the NCOIC is doing for the FAA NextGen and National Geospatial Intelligence Agency?• Will there be a follow-up event to discuss the results of the RFI with the participants/public?• How many have responded to the RFI/are registered to attend the two Industry Events?