quality dashboard-may-2015

16
TAUS Presents: The Quality Dashboard Measuring and benchmarking quality, productivity and efficiency of translation on an industry-shared platform www.taus.net

Upload: taus-enabling-better-translation

Post on 25-Jul-2015

1.820 views

Category:

Technology


0 download

TRANSCRIPT

Page 1: Quality dashboard-may-2015

TAUS Presents:

The Quality DashboardMeasuring and benchmarking quality, productivity and efficiency of

translation on an industry-shared platformwww.taus.net

Page 2: Quality dashboard-may-2015

What About Translation Quality

Old School: “One size fits all”Since the 1980’s

LISA QA Model, SAE J2450 prescribe today’s quality processes:

1. Static:• One quality fits all purposes, all content, all audiences

2. Subjective:• Evaluations are often subjective and anecdotal

3. Costly:• QE causes friction, delays• QE can cost up to 25% of total translation costs

4. Non-transparent:• Necessity without remedy

Dynamic Quality Framework

Page 3: Quality dashboard-may-2015

Industry Collaborative ProgramDQF started in 2011

AdobeAppenAutodeskAVBCA TechnologiesCiscoCrestecCrosslangDellDFKIeBay EMCGoogleHewlett PackardIntelLDS ChurchLingo24

This slide may not be used or copied without permission from TAUS

Participating members

LionbridgeMedtronicMicrosoftMoraviaNikonOraclePacteraPangeanicPaypalPhilipsPTCSiemensSpil GamesSystranVMwareWelocalizeYahoo!

Page 4: Quality dashboard-may-2015

From DQF Tools to Quality Dashboard

DQF ToolsSince January 2014

Tools on TAUS web site:to measure:• Productivity• Adequacy• Fluency

to review and count:• Translation errors

to get:• Stats and reports

Used by 100+ members

Quality DashboardLaunched June 2015

DQF integrated in:• TRADOS Studio• MateCat• Memsource (planned)• WorldServer (planned)

Use of DQF plug-in provides:• Enhanced statistics• Benchmarking

Open to everyone

Page 5: Quality dashboard-may-2015

TRADOS Studio Plug-in

Page 6: Quality dashboard-may-2015

MateCat Plug-In

Page 7: Quality dashboard-may-2015

The Power and Value of the Quality Dashboard

• DQF collects data and generates reports on the Dashboard real-time

• Translators, managers, buyers, developers get their own stats, benchmarks and analytics

• Not only track and benchmark against your own data, but also against industry averages, between translators, customers

Quality Evaluation

Business Intelligence

Page 8: Quality dashboard-may-2015

i

>

August 31, 2015: 566,987,756 words have been measured

May-150

50

100

150

200

250

300

350

287

ProductivityAcross all languages, industries, technologies,

processes, content, translators

Num

ber

of

Word

s p

er

Hour

Quality DashboardProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project

Quality Dashboard

Content profiling

Quality evaluation Adequacy/Fluency Error review

MT Ranking

Productivity measurement

DQF API

Home Services Academy Events Blog Membership My TAUS

Benchmark

More information

Review

What is the average productivity?

Page 9: Quality dashboard-may-2015

i

>

August 31, 2015: 566,987,756 words have been measured

Quality Dashboard

Quality Dashboard

Content profiling

Quality evaluation Adequacy/Fluency Error review

MT Ranking

Productivity measurement

DQF API

Home Services Academy Events Blog Membership My TAUS

Benchmark

More information

Review

ProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project

MT+PE TM+Human0

50

100

150

200

250

300

350

400

450

Productivity

What is the average productivity of MT vs. TM?

Page 10: Quality dashboard-may-2015

i

>

August 31, 2015: 566,987,756 words have been measured

Quality Dashboard

Quality Dashboard

Content profiling

Quality evaluation Adequacy/Fluency Error review

MT Ranking

Productivity measurement

DQF API

Home Services Academy Events Blog Membership My TAUS

Benchmark

More information

Review

Industry Average My Productivity0

50

100

150

200

250

300

350

400

287

345

My Productivity Compared to Industry AverageN

um

ber

of

Word

s p

er

Hou

r

ProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project

What is my productivity compared to industry?

Page 11: Quality dashboard-may-2015

i

>

August 31, 2015: 566,987,756 words have been measured

Quality Dashboard

Quality Dashboard

Content profiling

Quality evaluation Adequacy/Fluency Error review

MT Ranking

Productivity measurement

DQF API

Home Services Academy Events Blog Membership My TAUS

Benchmark

More information

Review

20%

40%

20%

15%

5%

My Distribution of segments

TM + Human TM + MT + Human + PE

MT + PE TM only

MT only

ProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project

Where do my translations come from?

Page 12: Quality dashboard-may-2015

i

>

August 31, 2015: 566,987,756 words have been measured

Quality Dashboard

Quality Dashboard

Content profiling

Quality evaluation Adequacy/Fluency Error review

MT Ranking

Productivity measurement

DQF API

Home Services Academy Events Blog Membership My TAUS

Benchmark

More information

Review

Me Industry Average0%

20%

40%

60%

80%

100%

120%

My Distribution of Segments Compared to Industry

TM+Human TM+MT+Human+PEMT+PE TM onlyMT only

ProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project

Where do my translations come from vs. industry?

Page 13: Quality dashboard-may-2015

i

>

August 31, 2015: 566,987,756 words have been measured

Quality Dashboard

Quality Dashboard

Content profiling

Quality evaluation Adequacy/Fluency Error review

MT Ranking

Productivity measurement

DQF API

Home Services Academy Events Blog Membership My TAUS

Benchmark

More information

Review

Project A Project B Project C Project D0

50

100

150

200

250

300

350

400

Productivity by Language by Project

FRDEZHKONL

Projects

Num

ber o

f wor

ds p

er h

our

ProductivityEfficiencyAdequacyFluency Language Time Technology Process Content Industry Project Translator/vendor CustomerStatistics Language Time Technology Process Content Industry Translator/vendor CustomerDistribution of segments Language Time Content Industry Project

What is my productivity by language and by project?

Page 14: Quality dashboard-may-2015

Benefits of the Quality Dashboard

DQF elevates the discussion about quality to an industry level.

The resulting benefits are:

1. Sharing knowledge and standard references

2. Increased credibility

3. Lower cost

4. Increased satisfaction

5. Increased flexibility

Page 15: Quality dashboard-may-2015

What’s next?

Find out more on the TAUS web site:

Download the Quality Dashboard description

Find the API specifications and integrate your translation tool

Page 16: Quality dashboard-may-2015

This slide may not be used or copied without permission from TAUS