perfect picture: visualization techniques for monitoring content quality - brian bueling
TRANSCRIPT
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com1
Perfect Picture: Visualization Perfect Picture: Visualization Techniques for Monitoring Techniques for Monitoring Content QualityContent Quality
October 24, 2014October 24, 2014
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com2
Session AgendaSession Agenda
1. Introduction
2. Current State of Content Monitoring
3. Content Quality Defined
4. Key Metrics for Content Quality
5. Visualization Techniques
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
Dakota HighlightsDakota Highlights
subpara1 to n and para0
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
Hundreds of ImplementationsHundreds of Implementations
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
IntroductionIntroduction
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
State of Content MetricsState of Content Metrics
How do you define high quality content?
How do measure content quality?
How do you communicate progress?
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
State of Content MetricsState of Content Metrics
How do you define high quality content?
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
I Know It When I See ItI Know It When I See It
“I shall not today attempt further to defi ne the kinds of material I understand to be embraced within ["obscenity"], and perhaps I could never succeed in intelligibly doing so. But I know it when I see it, and the content involved is not that.”
Justice Potter Stewart
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
State of Content MetricsState of Content Metrics
How do measure content quality?
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com10
Current State: Evolution of CMS MetricsCurrent State: Evolution of CMS Metrics
Metrics:Metrics:
- Available with Web analytics
- Tracks access to technical documentation
- Relies on user feedback
- No insight into effectiveness
Usage Metrics
Metrics:Metrics:
- Available with CMS Available with CMS technologytechnology
- Led to over Led to over complicated complicated workflowsworkflows
- Modelled after Modelled after product life-cycle product life-cycle managementmanagement
- No insight into usageNo insight into usage
Process Metrics
Metrics:
- Focus on resources
- Basic metrics on what is bought
- No insight into utilization
System Metrics Content Metrics
Metrics:
- Available with XML database technology
- Tracks access to component level metrics
- Builds models for effectiveness
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com11
Content Metrics: System ViewContent Metrics: System View
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com12
Content Metrics: System View Content Metrics: System View
• Number of Technical Writers• Number of Reviewers• Number of Users• Number of Publications• Number of Distribution Channels• Ratio of Technical Writers / Publication
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com13
Content Metrics: Process View Content Metrics: Process View
• Average Publishing Cycle Time• % Time Spent in Each State• % Time Spent on Each Document• % Documents Behind Schedule• Number of Releases / Period
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com14
Content Metrics: Process ViewContent Metrics: Process View
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com15
Usage View: Content Metrics Usage View: Content Metrics
• Usage Feedback / Comments• Number of Document Accesses • % Time Spent on Each Document• Indirect Determination of
Effectiveness
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com16
Content Metrics: Usage ViewContent Metrics: Usage View
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com17
Content Metrics: VisualizationContent Metrics: Visualization
=
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com18
Content Metrics: Guidance for AuthorsContent Metrics: Guidance for Authors
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com19
Content Metrics: Quality Indicator and Content Metrics: Quality Indicator and ScorecardScorecard
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com20
Content Metrics: Quality DashboardContent Metrics: Quality Dashboard
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
State of Content MetricsState of Content Metrics
How do communicate progress?
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com22
Project Killer – CFOProject Killer – CFO
‘There is no budget for this project'
Risks:
* Finance personnel don't have the technology background to fully understand the ROI of CMS's.
* Finance personnel have a bias toward preventing any new IT cost expenditures.
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
The ROI Picture
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
The ROI Formula
(Co x Rf) – Ci
ROI = ___________ X Sf
Ci
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
Reuse (multi-level) Repurposing
� Reduces content creation costs
� Reduces content maintenance costs
� Reduces content translation costs
� Increases content accuracy
Content View: Content Metrics
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com
Profiled Documents
Dynamic Assembly
� More relevant info to customers
� Easier creation of new products
� Fresher, real-time information
� Information on demand
Content View: Content Metrics
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com27
Common Content Metrics ErrorsCommon Content Metrics Errors
• Believing Efficiency Gains Equal Cost Savings• Not Allocating Cost Correctly Across Budgets• Not Timing Submissions with Budget Cycles • Interpreting Fixed Costs Inappropriately• Miscalculating the ROI Horizon• Not Targeting Cost Savings and Revenue Generation• Not Factoring in Risk• Not Addressing Perceived Value
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com28
Content Metrics: VisualizationContent Metrics: Visualization
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com29
Content Metrics: Content ReportContent Metrics: Content Report
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com30
Content Metrics: Good Content is Content Metrics: Good Content is SymmetricalSymmetrical
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com31
Content Metrics: Content DistributionsContent Metrics: Content Distributions
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com32
Content Metrics: VisualizationContent Metrics: Visualization
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com33
Content Metrics: VisualizationContent Metrics: Visualization
Presented By: [email protected] ©1999-2013 Dakota Systems Inc., All Rights Reserved
www.daksys.com34
Questions / Answers