software l10n qa from the tester’s perspective overview over the internationalization and...

47
Software L10n QA from the Tester’s Perspective ATA55 Carola F. Berger

Upload: hoangmien

Post on 15-May-2018

217 views

Category:

Documents


1 download

TRANSCRIPT

Page 1: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Software L10n QA from the Tester’s Perspective ATA55 Carola F. Berger

Page 2: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Outline�!   Overview over the Internationalization and

Localization Process for Software Apps

!   The QA Testing Process

!   Problem Types

!   Software Problem Reports

!   The QA Testing Process – A Practical Example

!   Summary

!   References and Further Reading

Carola F. Berger, L10n QA Testing, ATA55 2

Page 3: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Software L10n Process Flow�

Carola F. Berger, L10n QA Testing, ATA55 3

Preparation • i18n (engineering) • Style guides/glossaries (linguistic)

Translation (linguistic)

• Translation of strings • Review

Localized software

(engineering)

• Compilation • Functionality testing

QA testing (linguistic)

Final product Adapted from (Bodeux, Whitty 2014)

Page 4: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Software L10n Process Flow�

Carola F. Berger, L10n QA Testing, ATA55 3

Preparation • i18n (engineering) • Style guides/glossaries (linguistic)

Translation (linguistic)

• Translation of strings • Review

Localized software

(engineering)

• Compilation • Functionality testing

QA testing (linguistic)

Final product Adapted from (Bodeux, Whitty 2014)

Internationalization (i18n): •  Make software localizable without design changes •  Take into account different character sets •  Take into account different locales (= set of

parameters such as number formats, currency, date/time formats…)

•  Adapt layout to different directionality Style guides/glossaries: •  Ensure consistency in terminology •  Identify potential challenges for localization

Page 5: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Software L10n Process Flow�

Carola F. Berger, L10n QA Testing, ATA55 4

Preparation • i18n (engineering) • Style guides/glossaries (linguistic)

Translation (linguistic)

• Translation of strings • Review

Localized software

(engineering)

• Compilation • Functionality testing

QA testing (linguistic)

Final product Adapted from (Bodeux, Whitty 2014)

Page 6: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Software L10n Process Flow�

Carola F. Berger, L10n QA Testing, ATA55 4

Preparation • i18n (engineering) • Style guides/glossaries (linguistic)

Translation (linguistic)

• Translation of strings • Review

Localized software

(engineering)

• Compilation • Functionality testing

QA testing (linguistic)

Final product Adapted from (Bodeux, Whitty 2014)

Translation and review: •  Usually without full context •  Format varies •  Review can catch grammatical and spelling errors,

but not errors due to missing context (nouns vs. Verbs)

Page 7: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Software L10n Process Flow�

Carola F. Berger, L10n QA Testing, ATA55 5

Preparation • i18n (engineering) • Style guides/glossaries (linguistic)

Translation (linguistic)

• Translation of strings • Review

Localized software

(engineering)

• Compilation • Functionality testing

QA testing (linguistic)

Final product Adapted from (Bodeux, Whitty 2014) Adapted from (Bodeux, Whitty 2014)

Also development of test plan/script

Page 8: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Software L10n Process Flow�

Carola F. Berger, L10n QA Testing, ATA55 6

Preparation • i18n (engineering) • Style guides/glossaries (linguistic)

Translation (linguistic)

• Translation of strings • Review

Localized software

(engineering)

• Compilation • Functionality testing

QA testing (linguistic)

Final product Adapted from (Bodeux, Whitty 2014) Adapted from (Bodeux, Whitty 2014)

Page 9: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Globalization = i18n + L10n�

Carola F. Berger, L10n QA Testing, ATA55 7

Preparation • i18n (engineering) • Style guides/glossaries (linguistic)

Translation (linguistic)

• Translation of strings • Review

Localized software

(engineering)

• Compilation • Functionality testing

QA testing (linguistic)

Final product Adapted from (Bodeux, Whitty 2014)

Page 10: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

QA Process Flow�

Carola F. Berger, L10n QA Testing, ATA55 8

Familiarize yourself with product, test script (or write test script)

Set up OS (language, locale)

Follow test script; document all bugs

File bug report(s)

Wait for new build of product

Page 11: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Problem Types�!   Linguistic problems

!   Layout problems

!   Functionality problems

!   Installation/delivery problems

See e.g (Globalme/Golota 2013), (Esselink 1998)

Carola F. Berger, L10n QA Testing, ATA55 9

Photo by ThreeHeadedMonkey (http://www.flickr.com/���photos/threeheadedmonkey/3856171871/)

Page 12: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Linguistic Problems�!   Grammatical, spelling, and punctuation errors

!   Translation errors due to context

!   Linguistic consistency

!   Missing translations

!   Cultural aspects

Carola F. Berger, L10n QA Testing, ATA55 10

Page 13: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Layout and Formatting Issues�!   Truncations, text expansion in the entire interface

including error messages, pop-up windows, text boxes, etc.

!   Wrong alignment – especially in left-to-right versus right-to-left languages

!   Character corruption issues, wrongly displayed (non-ASCII or accented) characters

!   Line breaks !   Number, date/time, currency formats, addresses,

zip-codes, phone numbers !   Symbols and icons

Carola F. Berger, L10n QA Testing, ATA55 11

Page 14: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Layout and Formatting Issues�

Carola F. Berger, L10n QA Testing, ATA55 12

!   Floor grinder rental

Page 15: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Functional Problems�!   Link, button, menu functionality !   Input/output validation !   Number, date/time, currency formats, addresses,

postal codes, phone numbers, paper sizes !   Problems with character display, sorting, or input !   Keyboards and shortcuts !   Interaction with OS functions such as copy/paste

and locale and language settings in the OS !   Installation/delivery problems

Carola F. Berger, L10n QA Testing, ATA55 13

Page 16: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

A Practical (Fictional) Example�!   Localization of a fictional

starship app for controlling a warp drive

!   Source language and locale: Earth English

!   Target language and locale: Klingon (zIfan Hol)

References: Doohan, J. & Okrand, M. (1979, 1985). Creators of the Klingon language. See http://en.wikipedia.org/wiki/Klingon_language and references therein. Okrand, M. (1992). The Klingon Language Dictionary. New York City: Pocket Books. Schoen, L. M. (1992). Founder of The Klingon Language Institute. http://www.kli.org

Carola F. Berger, L10n QA Testing, ATA55 14

Page 17: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Familiarization�

Carola F. Berger, L10n QA Testing, ATA55 15

Page 18: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Test Script�Test of main interface: 1.  Change headings 1, 2; check

functionality of buttons, allowed range (0-360)

2.  Change distance; check functionality of buttons

3.  Check functionality of “Engage” button (simulated by main computer)

4.  Change warp speed; check functionality of buttons => above max warp speed (set in settings, default 9.3) a warning message appears and the Engage button changes to “Override”

Carola F. Berger, L10n QA Testing, ATA55 16

Page 19: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Test Script�Test of “Override”: 5.  Check appearance of pop-up 6.  Attempt voice authorization with

“random” false code, check pop-up message

7.  Voice authorization with correct code (test account: The Borg 123); check pop-up message

8.  Check functionality of override: engage higher warp speed - simulated

Carola F. Berger, L10n QA Testing, ATA55 17

Page 20: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Test Script�Test of “Settings” page: 9.  Enter settings page from main page

by tapping on button 10.  Change units (currently non-

functional – skip step) 11.  Change max speed – voice

authorization required 12.  Check functionality of voice

authorization with wrong authorization code

13.  Check functionality of voice authorization with correct code – see step 7.

Carola F. Berger, L10n QA Testing, ATA55 18

Page 21: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Familiarization�

Carola F. Berger, L10n QA Testing, ATA55 19

Page 22: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Familiarization�

Carola F. Berger, L10n QA Testing, ATA55 19

Page 23: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Familiarization�

Carola F. Berger, L10n QA Testing, ATA55 19

Page 24: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Familiarization�

Carola F. Berger, L10n QA Testing, ATA55 19

Page 25: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Familiarization�

Carola F. Berger, L10n QA Testing, ATA55 19

Page 26: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Familiarization�

Carola F. Berger, L10n QA Testing, ATA55 19

Page 27: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 1: Familiarization�

Carola F. Berger, L10n QA Testing, ATA55 19

Page 28: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Example – Step 2: Set Up OS�1. Set OS language to Klingon (zIfan Hol)

(left to right, Klingon font)

2. Set locale/region to Kronos (konos)

3. Set number formats etc. to Klingon (zIfan Hol) (decimal system, Klingon units, e.g. 1 Kellicam (qeliqam) = 2 km = 1.24 miles)

4. Remind yourself how to take screenshots etc. on the testing device

5. Set up test accounts (if applicable)

Carola F. Berger, L10n QA Testing, ATA55 20

Page 29: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 3: Go Through Test Script�Test of main interface: 1.  Change headings 1, 2; check functionality of buttons, allowed

range (0-360) 2.  Change distance; check functionality of buttons 3.  Check functionality of “Engage” button (simulated by main

computer) 4.  Change warp speed; check functionality of buttons => above

max warp speed (set in settings, default 9.3) a warning message appears and the Engage button changes to “Override”

Carola F. Berger, L10n QA Testing, ATA55 21

Page 30: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 3: Go Through Test Script�

Carola F. Berger, L10n QA Testing, ATA55 22

Page 31: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 3: Go Through Test Script�

Carola F. Berger, L10n QA Testing, ATA55 22

Page 32: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 3: Go Through Test Script�Test of “Override”: 5.  Check appearance of pop-up 6.  Attempt voice authorization with “random” false code, check

pop-up message 7.  Voice authorization with correct code (test account: The Borg

123); check pop-up message 8.  Check functionality of override: engage higher warp speed -

simulated

Carola F. Berger, L10n QA Testing, ATA55 23

Page 33: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 3: Go Through Test Script�

Carola F. Berger, L10n QA Testing, ATA55 24

Page 34: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 3: Go Through Test Script�

Carola F. Berger, L10n QA Testing, ATA55 24

Page 35: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 3: Go Through Test Script�

Carola F. Berger, L10n QA Testing, ATA55 24

Page 36: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 3: Go Through Test Script�Test of “Settings” page: 9.  Enter settings page from main page by tapping on button 10.  Change units (currently non-functional – skip step) 11.  Change max speed – voice authorization required 12.  Check functionality of voice authorization with wrong

authorization code 13.  Check functionality of voice authorization with correct code –

see step 7.

Carola F. Berger, L10n QA Testing, ATA55 25

Page 37: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 3: Go Through Test Script�

Carola F. Berger, L10n QA Testing, ATA55 26

Page 38: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 3: Go Through Test Script�

Carola F. Berger, L10n QA Testing, ATA55 26

Page 39: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 4: Bug Report - Bad�Bug report: Bug Nr. 1234

Language: Klingon

Stardate: 92457.3

Issue: Layout for speed

Carola F. Berger, L10n QA Testing, ATA55 27

Page 40: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 4: Bug Report - Bad�Bug report: Bug Nr. 1234

Language: Klingon

Stardate: 92457.3

Issue: Layout for speed

Not very helpful!!!

Carola F. Berger, L10n QA Testing, ATA55 27

Page 41: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Bug Reports�ü  Number or ID of the problem ü  Software version, platform, OS version, firmware

etc. ü  Date, (internal) build version ü  Language and locale, format settings etc. ü  Precise description of where bug occurred

(screen title, etc.) ü  Precise steps to reproduce the problem ü  Precise description of the problem ü  Suggested solution

Carola F. Berger, L10n QA Testing, ATA55 28

Page 42: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 4: Bug Report - Good�Bug report: Bug Nr. 1235 Language: Klingon Stardate: 92457.3 Warp Drive v3.14159 OS: Terran WarpOS v1.0.0.1 Brief description: Layout for speed overlaps Description: 1.  Set language/locale to Klingon,

Kronos 2.  Go to main warp drive screen 3.  Observe that the words “warp

factor” (pivgob) and the numbers for the warp factor (e.g. 3.4 (3.4)) and the arrows overlap. See screenshot.

Carola F. Berger, L10n QA Testing, ATA55 29

Page 43: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 4: Bug Report - OK�Bug report: Bug Nr. 1234 Language: Klingon Stardate: 92457.3 Warp Drive v3.14159 OS: Terran WarpOS v1.0.0.1 Brief description: Translation missing, identifier displayed instead of translated string Description: 1.  Set language/locale to Klingon,

Kronos 2.  Go to main warp drive screen 3.  Go to settings screen – tap on

settings (cer) 4.  Observe that the word Units has not

been translated – instead, the ID strg.units is displayed.

Carola F. Berger, L10n QA Testing, ATA55 30

Page 44: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Ex. – Step 4: Bug Reports - Better�Bug report: Bug Nr. 1234 Language: Klingon Stardate: 92457.3 Warp Drive v3.14159 OS: Terran WarpOS v1.0.0.1 Brief description: Translation missing, identifier displayed instead of translated string Description: 1.  Set language/locale to Klingon,

Kronos 2.  Go to main warp drive screen 3.  Go to settings screen – tap on

settings (cer) 4.  Observe that the word Units has not

been translated – instead, the ID strg.units is displayed.

Suggestion: juv

Carola F. Berger, L10n QA Testing, ATA55 31

Page 45: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

SUMMARY�

Carola F. Berger, L10n QA Testing, ATA55 32

Familiarize yourself with product, test script (or write test script)

Set up OS (language, locale)

Follow test script; document all bugs

File bug report(s)

Wait for new build of product

Page 46: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

Thank You!�Kapla�

Carola F. Berger, L10n QA Testing, ATA55 33

Page 47: Software L10n QA from the Tester’s Perspective Overview over the Internationalization and Localization Process for Software Apps ! The QA Testing Process ! Problem Types ! Software

References & Further Reading�!   Berger, C. F. (2014). Software Localization (L10n) Quality Assurance from the

Tester’s Perspective. Proceedings of ATA55. http://www.cfbtranslations.com/ > About > Publications.

! Bodeux, E. & Whitty, T. (2013). Two Sides of a Coin: Software Localization from Both the Translator’s and Project Manager’s Perspectives. Presentation at ATA54, T-6.

! Bodeux, E., McKay, C., & Whitty, T. (2014). Software localization: insights from the translator and PM perspectives. Speaking of Translation audio recording, http://speakingoftranslation.com/listen/software-localization-insights-from-the-translator-and-pm-perspectives-new/

!   Dudgeon, R. & D. (2014). Internationalization and Localization for Translators. Presentation at ATA55, T-6.

! Esselink, B. (1998). A Practical Guide to Software Localization. Amsterdam/Philadelphia, John Benjamins Publishing Company.

! Globalme/Golota H. (2013). The Localization Testing Checklist. http://www.globalme.net/blog/the-localization-testing-checklist

Carola F. Berger, L10n QA Testing, ATA55 34