my world of work user survey · my world of work user survey 7 users were asked to identify the...

My World of Work User Survey1

tt

My World of Work

User Survey

September 2013

My World of Work User Survey 2

SDS Evaluation & Research


Contents

1. Executive Summary 4

2. Introduction 8

3. Headline results 10

4. Use of My World of Work 11

5. Usability of My World of Work 14

6. Usefulness of My World of Work 16

7. Effectiveness of My World of Work 20

8. User groups 25

9. Comments 31

Annex A - Profile of Survey Respondents 39

Annex B - Weighted vs Non-weighted results 40

Annex C - Frequency of use analysis 41


SDS’ My World of Work web service was launched in August 2011 as part of the organisation’s Careers Information Advice and Guidance service modernisation. It forms the on-line, self-help service delivery mechanism for this service.

This report provides the results of the first comprehensive user survey of the My World of Work service. It is based upon the analysis of an online survey taken by 859 users of My World of Work. The aim of the survey was to capture user feedback on the use, usability, usefulness and effectiveness of the My World of Work web service. Potential improvements to the web service are also identified.

The research was conducted by SDS’ Evaluation and Research Team during June 2013 and forms part of a wider SDS programme of work to inform the Careers Information Advice and Guidance service.

1. Executive Summary

Key Results

Overall the headline results show:

• Users like the option of a web based careers service, seeing it as an accessible and convenient ‘one stop shop’ resource.

• My World of Work is a clear and easy to use web service that sees regular and sustained use.

• My World of Work has content that users find very useful, easy to understand, accurate and current.

• My World of Work is highly effective as an online service, with the majority of users identifying a task or next step that it has helped them with.


• 49 per cent of users found out about My World of Work through an SDS careers advisor, a teacher or a lecturer. 18 per cent found out about the service via the internet.

• As many new users (less than 1 month) as long-term users (over 12 months) responded to the survey. Nearly half (46 per cent) had been users for over 6 months.

• Almost half (49 per cent) of respondents used My World of Work on a weekly or monthly basis.

• 92 per cent of users found the language used on My World of Work clear and simple.

• 84 per cent of users found My World of Work easy to use.

• Over 80 per cent of users felt that My World of Work contains useful information that is easy to understand, accurate and up-to-date and that is presented in a way that they like.

• Generally over 80 per cent of users found the various features, tools and format of content to be very useful / useful.

Use

Usability

Usefulness

• Over 75 per cent of users could find the information that they needed and they could do so quickly.


• 91 per cent of users like the option of a web based careers information service.

• 88 per cent understand the services that My World of Work offers and 86 percent are satisfied with these services. 88 per cent would recommend My World of Work to others.

• Two thirds of users (69 per cent) believed that My World of Work had already helped them take the next steps. This rose to over three quarters (76 per cent) of those using the service on a weekly or monthly basis.

• 95 per cent identified at least one thing that My World of Work has helped them to do, for example make subject choices. 80 per cent identified more than one. The most commonly identified steps were improve CV, learn about self and interview preparation.

• Registered users were more likely to choose the extreme affirmative ratings about the My World of Work service than non-registered users

• Younger users, those aged 16 – 24 years old, were more likely to choose the extreme affirmative ratings about the My World of Work service than those in other age groups.

• On the whole there were few notable differences in headline responses between male and female users of the service. On some occasions female users were more likely to choose the extreme affirmative ratings than male users.

Effectiveness User Groups

1 Choosing the always / strongly agree / very useful responses


Users were asked to identify the best thing about My World of Work and responses fell into 4 broad categories:

• Delivery mechanism – My World of Work is accessible.

• Usability – the service is easy to use.

• Usefulness – My World of Work has a range of useful content, the My CV tool in particular.

• Outcomes – using My World of Work increased users’ confidence, aided self-improvement and helped users take the next steps.

Users were also asked how My World of Work could be improved. The most common response was that no improvement was necessary.

Suggested improvements then fell into 3 categories:

• Delivery mechanism – there is a need to raise awareness of My World of Work through better promotion

• Usability – some users suggested im-proving the aesthetics of the site, mak-ing content easier to find and improving site performance

• Usefulness – generally users requested more content. Other comments noted the importance of content being current, accurate, easy to understand and ap-propriate for all customer groups.

Comments


In March 2011, the Scottish Government called for a modernisation and improvement of careers information, advice and guidance services.

SDS’ Career Management Skills (CMS) Framework2 for Scotland outlines this modernised approach. Since it needs to work for all individuals in all contexts, the framework sets out a blended careers information, advice and guidance service (web, telephone, face to face and through partners). It supports a model of differentiated service delivery, including self-help, assisted and intensive services.

The My World of Work web service, launched in August 2011, was intended specifically to be the on-line, self-help service delivery mechanism of the approach.

2. Introduction

To gather user feedback on My World of Work an online survey was carried out by SDS’ Evaluation and Research team during June 2013. The research focussed on the use of My World of Work and user satisfaction in terms of the usability, usefulness and effectiveness of the web service.

Information was collected on:

• routes to using My World of Work,

• registration status,

• duration and frequency of use of the web service,

• navigation of the site,

• the content of My World of Work,

• the effectiveness of the services offered,

• the outcomes resulting from use of M World of Work, and

• future improvements to the web service.

2. Introduction

2 Career Management Skills Framework for Scotland, http://www.skillsdevelopmentscotland.co.uk/media/752669/career_management_skills_framework_scotland.pdf


Given that the survey respondents included both registered and non-registered users of My World of Work, weighting the responses of the full sample was not possible.

However, the registered users were weighted for age against the profile held of registered users of My World of Work. Weighting did not result in significant differences, see Annex B.

As such, the results are based on the un-weighted responses from all 859 respondents, both registered and non-registered users.

The survey was made available to users aged 16 years and over. It was placed on the web service for any user to complete and was also e-mailed to a random selection of registered users.

A detailed breakdown of the respondents to the survey by registration status, age, gender and current employment status is provided in Annex A.

My World of Work has both registered and non-registered users. For those who are registered an age profile is known. However, there is no way of knowing the profile of the web service’s non-registered users.


Users like the option of a web based careers service, seeing it as an accessible and convenient ‘one stop shop’ resource.

My World of Work is a clear and easy to use web service that sees regular and sustained use.

My World of Work has content that users find useful, easy to understand, accurate and current.

3. Headline results

My World of Work is seen by users as highly effective as an online careers service, with the majority of users identifying a task or next step that it has helped them with.


Table 4.1 shows the route through which users first accessed My World of Work.

• A quarter of users found out about My World of Work through an SDS Careers Adviser with almost a further quarter (24 per cent) finding out from a teacher or lecturer. 18 per cent used an internet search engine or found the service via a link on another website

• Social media, marketing literature and newspapers and magazines led few users to the site.

4. Use of My World of Work• 95 per cent of users felt that it was very

easy or easy to find My World of Work on the web.

Route to using My World of Work

Table 4.1 - Route to using My World of WorkSDS Careers Adviser 25%Teacher / lecturer 24%Search engine 12%Other (please specify) 11%Friends / family 7%Training provider 7%Link from another website 6%Employer 4%Social media 2%Marketing literature 1%Newspaper or magazine 0%

Registering with My World of Work

• 80 per cent were registered users of My World of Work.

• Of these 80 per cent, almost all (96 per cent) found registering with My World of Work very easy or easy.


Duration of Use of My World of Work

Figure 4.1 shows how long users had been accessing the My World of Work service.

• Users were spread fairly evenly in terms of their duration of use with as many new users (less than 1 month) as long-term users (over 12 months).

• That nearly half (49 per cent) had been users for over 6 months further suggests that the web service sees prolonged rather than singular use.

Figure 4.1 Duration of use of My World of Work

23%28%

21%

13% 15%

0-1 1-6 7-12 13-18 18+

months


Frequency of Use of My World of Work

Figure 4.2 shows how often users accessed the My World of Work service.

• Around half (49 per cent) used My World of Work on a weekly or monthly basis.

• Of those who only used the web service once, around half (49 per cent) answered the survey through the web link suggesting they completed the survey on their first use.

• The remainder were e-mailed a link to the survey which suggests that they may have used My World of Work once and not returned since.

Figure 4.2 Frequency of use of My World of Work

31%

18% 21% 21%

9%

weekly monthly every few months only used it once can't remember/ don't know

frequency


Figure 5.1 illustrates users’ views on the usability of the My World of Work service.

• 92 per cent found the language used to be clear and simple always or most of the time, whereas 1 per cent felt this was rarely true.

• 84 per cent found My World of Work easy to use always or most of the time, compared with 3 per cent who felt this was rarely true.

• 77 per cent felt that the homepage led them to the information they needed always or most of the time, as compared with 4 per cent who felt this was rarely true.

5. Usability of My World of Work• 76 per cent can find the information they

need quickly always or most of the time, whereas 6 per cent felt this was rarely or never true.

• 75 per cent believe that it is obvious where to find the information they need always or most of the time, compared with 5 per cent who felt this was rarely true.

These results show that most users can find the information that they need and that they can do so easily and quickly. In addition 9 out of 10 users find the language on My World of Work clear and simple.


Figure 5.1 Usability of My World of Work

• Frequent users were more likely to choose the affirmative3 responses when rating the usability of the My World of Work service than infrequent users. These results are displayed in Annex B, Table A.

3 Choosing the always & most of the time responses

37%

37%

44%

52%

60%

38%

39%

33%

32%

32%

18%

17%

17%

10%

6%

It is obvious where to find the information I need

I can find the information I need quickly

The homepage leads me to the information I need

My World of Work is easy to use

The language used is clear and simple

Always Most of the time Sometimes


Figure 6.1 highlights how useful users find the content of My World of Work as an av-enue for career management support.

• 89 per cent of users found the informa-tion on My World of Work easy to un-derstand always or most of the time compared with 2 per cent who felt this was rarely true.

• 87 per cent felt that My World of Work has useful information always or most of the time as opposed to 3 per cent who felt this was rarely or never true.

• 85 percent believe the information to be accurate always or most of the time whereas 1 per cent felt this was rarely true.

6. Usefulness of My World of Work• 82 per cent believe the information to be

up-to-date always or most of the time compared with 1 per cent who felt this was rarely true.

• 81 per cent like the way content is presented always or most of the time whereas 4 per cent rarely or never like the way it is presented.

The results show that for the most part users feel that My World of Work presents useful information in a way that they like and that is easy to understand, accurate and up-to-date.


Figure 6.1 Usefulness of My World of Work

48%

48%

50%

53%

52%

33%

34%

35%

34%

37%

13%

10%

10%

9%

8%

I like the way content is presented

The information is up to date

My World of Work provides accurate information

My World of Work has useful information

The information is easy to understand

Always Most of the time Sometimes

• Frequent users were more likely to choose the affirmative4 responses when rating the usefulness of the My World of Work service than infrequent users. See Annex B, Table A.

4 Choosing the always & most of the time responses


User satisfaction with the usefulness of specific features and tools of My World of Work was also explored. The following types of content were considered:

• general features / content of the service, for example advice articles;

• specific, practical tools, for example a CV builder; and

• the format of content, for example written.

Figure 6.2 demonstrates that the high level of satisfaction amongst users with the content of My World of Work is broadly consistent across the range of features, tools and formats.

• In this case, frequent users were only slightly more likely to choose the affirmative5 responses when rating the various content of My World of Work than infrequent users. See Annex B, Table B.

5 Choosing the very useful & useful responses


Figure 6.2 Usefulness of My World of Work6

Features

Tools

Format

6 don’t know, haven’t used responses have been excluded from analysis. The percentages are based on those respondents who had used the feature, tool or format or content.

38%

50%

53%

43%

51%

53%

46%

47%

59%

55%

32%

40%

38%

36%

40%

43%

40%

44%

49%

50%

45%

44%

44%

41%

40%

47%

46%

35%

40%

45%

43%

45%

51%

48%

46%

51%

48%

45%

Audio

Video

Written

My DNA

Job Search

My Strengths

My Interview

Course Choices

My CV

Careers A-Z

Blogs

MAs

Graduate Portal

Industry articles

Real people case studies

Interest Explorer

Tools guide

News and events

Advice articles / videos

Very useful Useful


Figure 7.1 shows the results to a series of statements that users were asked to agree or disagree with. The statements explored how effective users find My World of Work to be as an avenue for career management support.

• 91 per cent of users like the option of a web based careers information service compared with 1 per cent who disagreed with this.

• 88 per cent understand the services that My World of Work offers whereas 2 per cent of users do not understand them.

7. Effectiveness of My World of Work• 86 percent are satisfied with the ser-

vices offered by My World of Work compared with 4 per cent who are not satisfied.

• 88 per cent would recommend My World of Work to others compared with 3 per cent who would not.

• 69 per cent believed that My World of Work had already helped them take the next steps. This compares with 8 per cent of users who felt that it had not helped them to do this.

54%

53%

43%

44%

35%

37%

35%

45%

42%

34%

8%

9%

9%

10%

23%

I like the option of a web based careers information service

I would recommend My World of Work to others

I understand the services that My World of Work offers

I am satisfied with the the service offered by My World of Work

My World of Work has helped me to take the next steps

Strongly agree Agree Neither agree nor disagree


Figure 7.1 Effectiveness of My World of Work

54%

53%

43%

44%

35%

37%

35%

45%

42%

34%

8%

9%

9%

10%

23%

I like the option of a web based careers information service

I would recommend My World of Work to others

I understand the services that My World of Work offers

I am satisfied with the the service offered by My World of Work

My World of Work has helped me to take the next steps

Strongly agree Agree Neither agree nor disagree


Once again, frequent users were more likely to choose the affirmative7 responses when rating the My World of Work service than infrequent users. See Annex B, Table C.

This was particularly noticeable with regards to the statement My World of Work has helped me to take the next steps.

This concept of helping users to take the next steps implies an effect of My World of Work beyond the actual use of the web service itself.

Figure 7.2 shows the effect of frequency of use on user responses to this statement.

Figure 7.2 Frequency of use and the impact of My World of Work

81% 76% 71%48% 52%

weekly monthly every few months only used it once can't remember / don't know

frequency

Cumulative strongly agree / agree responses for 'My World of Work has helped me to take the next steps'

7 Choosing the strongly agree & agree responses


A higher percentage of regular users be-lieved that My World of Work had helped them to take the next steps in their career.

For those who only used it once or who can’t remember / don’t know around half of users still felt that My World of Work had helped them to take the next steps.

• Almost all users (95 per cent) identified something that the My World of Work service had helped them do.

• Four in every five users (80 per cent) identified more than one thing that the My World of Work service had helped them do.

In addition, the survey sought to further assess the impact of the My World of Work service by asking users to identify specific steps that it had helped them with in managing their career.

Figure 7.3 summarises these findings.


Figure 7.3 Next steps identified after using My World of Work

6%

27%

29%

31%

34%

36%

37%

40%

44%

51%

63%

Other

Subject choices

FE/HE choices

Find a job

Career choices

Choose a job

Future learning

Improve confidence

Interview preparation

Learn about self

Improve CV


Comparing registered and non-registered users8:

• Registered users were more likely to have been using the My World of Work service for longer.

• Those users who had only used the service once were more likely to be non-registered users.

8. User groups

Registered and non-registered users

8 Some users were unclear as to whether or not they were actually registered for My World of Work9 Choosing the always / strongly agree / very useful responses

• Registered users were more likely to favour the extreme affirmative9 responses when rating the My World of Work service than non-registered users.

Table 8.1 summarises the findings for registered and non-registered users across usability, usefulness and effectiveness.


Table 8.1 Registered vs non-registered10 user comparisons

10 R = Registered users; NR = Non-registered users; Diff. = Difference between groups (R-NR)

Cumulative Always / Most of the time Always

R NR Diff. R NR Diff.USABILITYThe language used is clear and simple 92% 86% 6% 62% 46% 16%My World of Work is easy to use 86% 77% 9% 54% 43% 11%The homepage leads me to the information I need 79% 70% 9% 46% 34% 11%I can find the information I need quickly 77% 72% 4% 38% 34% 4%It is obvious where to find the information I need 76% 69% 7% 38% 31% 7%USEFULNESSThe information is easy to understand 90% 83% 7% 54% 41% 14%My World of Work has useful information 88% 82% 6% 56% 37% 19%My World of Work provides accurate information 87% 79% 8% 52% 39% 13%The information is up to date 83% 77% 6% 50% 39% 11%I like the way content is presented 82% 77% 5% 49% 41% 9%

Cumulative Strongly Agree / Agree Strongly Agree

R NR Diff. R NR Diff.EFFECTIVENESSI like the option of a web based careers information service 92% 89% 2% 55% 49% 6%I understand the services that My World of Work offers 89% 82% 7% 45% 33% 12%I would recommend My World of Work to others 88% 88% 0% 56% 40% 16%I am satisfied with the service offered by My World of Work 86% 84% 2% 46% 36% 10%My World of Work has helped me to take the next steps 70% 64% 6% 37% 24% 14%

Cumulative Very Useful / Useful Very Useful

R NR Diff. R NR Diff.Average rating across features 87% 86% 1% 42% 33% 9%Average rating across tools 93% 92% 1% 53% 41% 11%Average rating across formats 93% 95% -2% 48% 43% 5%


Users were identified as one of 4 age groups: 16 – 19 years, 20 – 24 years, 25 – 49 years and 50 years and over.

There were a few notable trends in the results across age groups.

• In general there was little difference between the 16 – 19 years and 20 – 24 years age groups.

• Similarly, few differences were found between the 25 – 49 years and 50 years and over groups.

• Younger users, those aged 16 – 24 years old, were more likely to favour the extreme affirmative11 responses when rating the My World of Work service than those in other age groups.

Table 8.2 summarises the findings for the combined age groups (16 - 24 years and 25 years and over) across usability, usefulness and effectiveness.

Age groups

11 Choosing the always / strongly agree / very useful responses



16-24 25+ Diff. 16-24 25+ Diff.USABILITYThe language used is clear and simple 94% 89% 5% 73% 49% 24%My World of Work is easy to use 89% 81% 8% 62% 43% 19%The homepage leads me to the information I need 84% 72% 12% 54% 35% 20%I can find the information I need quickly 82% 70% 13% 45% 31% 14%It is obvious where to find the information I need 82% 69% 12% 46% 28% 17%USEFULNESSThe information is easy to understand 92% 87% 5% 60% 46% 13%My World of Work has useful information 90% 84% 6% 61% 47% 14%My World of Work provides accurate information 90% 82% 7% 58% 43% 14%The information is up to date 86% 79% 8% 58% 40% 19%I like the way content is presented 86% 77% 9% 58% 38% 20%


16-24 25+ Diff. 16-24 25+ Diff.EFFECTIVENESSI like the option of a web based careers information service 93% 90% 3% 61% 48% 14%I understand the services that My World of Work offers 91% 86% 5% 50% 35% 15%I would recommend My World of Work to others 91% 86% 5% 61% 47% 13%I am satisfied with the service offered by My World of Work 91% 81% 10% 55% 34% 20%My World of Work has helped me to take the next steps 74% 64% 10% 42% 28% 14%

Table 8.2 Age group12 comparisons


16-24 25+ Diff. 16-24 25+ Diff.Average rating across features 92% 82% 10% 51% 30% 21%Average rating across tools 95% 90% 1% 63% 39% 24%Average rating across formats 94% 93% 2% 55% 39% 16%

12 16-24 = combined 16-19 & 20-24 year groups; 50+ = combined 16-19 & 20-24 year groups; Diff. = Difference between groups (16-24 - 25+)


• On the whole, there were no significant differences between male and female users of My World of Work across the key measures.

• There were a few exceptions to this: clarity and simplicity of the language used, understandability of information and currency of information. In these cases, female users were more likely to give an always response than male users.

• In terms of the usefulness of the various features and tools within My World of Work, female users were more likely to select the very useful response than male users for some: advice articles / videos, My Interview, Course Choices and Careers A-Z.

Table 8.3 summarises the findings for male and female users across usability, usefulness and effectiveness.

Gender


Table 8.3 Gender13 comparisons

13 F = Female users; M = Male users; Diff. = Difference between groups (F-M)


F M Diff. F M Diff.USABILITYThe language used is clear and simple 94% 89% 5% 65% 55% 10%My World of Work is easy to use 88% 82% 5% 55% 50% 5%The homepage leads me to the information I need 80% 76% 4% 46% 42% 4%I can find the information I need quickly 77% 75% 2% 37% 38% -1%It is obvious where to find the information I need 78% 71% 7% 38% 36% 1%USEFULNESSThe information is easy to understand 90% 87% 3% 58% 46% 12%My World of Work has useful information 89% 85% 4% 58% 49% 9%My World of Work provides accurate information 88% 83% 6% 53% 47% 6%The information is up to date 84% 81% 3% 53% 43% 10%I like the way content is presented 82% 80% 2% 52% 44% 8%


F M Diff. F M Diff.EFFECTIVENESSI like the option of a web based careers information service 91% 91% 0% 56% 52% 3%I understand the services that My World of Work offers 88% 89% -1% 44% 41% 4%I would recommend My World of Work to others 89% 87% 2% 56% 51% 6%I am satisfied with the service offered by My World of Work 86% 85% 2% 46% 41% 5%My World of Work has helped me to take the next steps 67% 70% -3% 35% 35% 0%


F M Diff. F M Diff.Advice articles / videos 96% 92% 4% 54% 44% 10%Average rating for remaining features 89% 84% 5% 41% 38% 3%My Interview 94% 92% 2% 50% 40% 10%Course Choices 96% 90% 5% 52% 42% 10%Careers A-Z 96% 95% 1% 60% 50% 11%Average rating for remaining tools 94% 89% 5% 54% 49% 1%Average rating for formats 95% 92% 3% 50% 44% 6%


641 users identified a best thing about My World of Work. User comments fell into 4 broad themes of usefulness, usability, the delivery mechanism of the service and outcomes.

Usefulness (approximately 530 comments)

A number of users noted the best thing of My World of Work as being the amount and quality of the support and advice provided by the service. Further users noted that the service provided what they were looking for.

• The content provided by My World of Work was cited by a number of users as being the best thing, most commonly in relation to the range of content.

‘There is so much useful information’

Female, Registered, 16-19 years

9. Comments

• Further descriptions of the content included aspects such as: useful, interesting, relevant, understandable, clear, comprehensive, current and helpful.

‘The variety of content it allows the user to control and use with ease’Male, Non-registered, 16-19 years

• Users also noted the options that My World of Work provides users with, including the personalised options, as being the best thing about the service.

‘Opens up more career opportunities’

Male, Registered, 25-49 years

The best thing about My World of Work


In terms of the specific tools and features of My World of Work, a number were identified by users as being the best thing about the service.

• The CV tool and the help it provides were the subject of comment most often by users.

• Further tools, features and associate content mentioned repeatedly by us-ers were: My Interview, My Strengths, My DNA, Job Search, Careers A-Z and Course Choices.

‘The best thing about My World of Work is the ‘My CV’ tool. It has helped me per-fect my CV and I have been able to apply

for various jobs’Male, Registered, 16-19 years

Usability (approximately 155 comments)

The second most offered response was that My World of Work is generally easy to use.

‘Easy to use and understand’Female, Registered, 16-19 years

Further comments cited that it is easy to find what you are looking for and the layout as the best thing about My World of Work.

‘Easy to use’Male, Non-registered, over 50 years


Delivery mechanism (approximately 95 comments)

The majority of comments within this theme identified the ease of access to My World of Work as being the best thing about it.

Further comments specifically noted the best thing being that:

• it is an online service;

• it is flexible, for example in that it allows users to access support from home;

‘It’s online and accessible from anywhere’

Male, Registered, 20-24 years

• everything you need is in one place; and

‘One stop shop. Comprehensive. Packed full of information’

Female, Registered, over 50 years

• it is convenient, always available, allow-ing users to access support without an appointment.

‘It is easy to access, offers lots of useful things. Always available’

Female, Non-registered, 16-19 years


Outcomes (approximately 90 comments)

‘Since using this website I have acquired a job which has really brightened up my

life’Male, Registered, 16-19 years

Some users noted specifically that the best thing about My World of Work was that it helped them to make a decision about their career or resulted in progress in their careers such as starting a course or job.

‘Thinking about a career change the information given in the website helped me to make a decision about the next

steps that I should take with plenty of information about courses, skills,

looking for a new job, opening me to a world full of choices’


For a number of users the best thing about My World of Work was the impact that it has had for them.

The most commonly cited outcome was improved confidence, for example in relation to interviews.

Further outcomes noted repeatedly by users included:

• developing skills and self-improvement; and

• creating a plan, making changes, preparing to take the next steps for example applying for jobs.

‘The information allowed me to develop myself and create a plan on the work I

wanted to do’Male, Registered, 25-49 years


570 users commented regarding improvements that could be made to My World of Work. Of these, around one third felt that there was no improvement necessary, claiming that the service was of a high standard in its current form.

A very small minority (6 respondents) requested more access to face to face services.

‘Nothing, it is a great website to help people’s futures’

Female, Non-registered, 16-19 years

For those offering suggested improve-ments, user comments focussed on the web service and fell into 3 of the above themes: usability, usefulness and delivery mechanism of the service.

Usability (approximately 100 comments)

Comments in relation to this theme focussed on the presentation, navigation and performance of the site.

• Users noted that My World of Work should be made more appealing, with some users specifically suggesting brighter colours as an improvement.

‘Lighter website making it easier to read’Male, Registered, 16-19 years

• Users recommended a less cluttered, simpler and more modern layout.

• A number of users stated that content could be difficult to find or get to and suggested improving this.

How could My World of Work be improved?


‘I find it hard to find what I am looking for but when I do I am impressed’


• Site performance was highlighted as an issue for some. Generally this focussed on the download speed, although reliability was also mentioned, for example in relation to saving content.

Usefulness(approximately 230 comments)

In general suggested improvements in relation to the content of My World of Work focussed on requests for more content.

Specifically users suggested:

• more videos and articles, for example case studies,

• update / job alerts,

• more links,

• more content for those aiming for higher education,

• more interaction through live chat and help forums, and

• more personalisation of content in the form of additional tools / tests such as career aptitude.

Users also noted the importance of ensuring the content was current, accurate and easy to understand.


In relation to specific tools or features of My World of Work, suggested improvements were made most often for My CV, Job Search, Careers A-Z and Course Choices.

• Specific suggestions for My CV included making it easier to use, including more templates and examples and introducing a facility to check and offer advice on CVs.

• Users suggested that the Job Search facility could be easier to use, introduce a facility to apply for jobs and have a better selection of jobs, including local jobs, from more sources such as NHS and myjobscotland.

• Users felt that the Careers A-Z tool could be improved with more content and options and a simpler layout.

• Courses Choices could be improved through more current, accurate information and more options for all ages.

‘I would like to see more personality, profession choice tests, because sometimes it’s really difficult to

understand what you really want to do in this period of life’


Some users felt that the content could be more relevant to all customer groups, for example individuals of all ages.

Accessibility of the content for those with additional support needs was also raised. Suggestions were made to include more easy read documents, videos and audio feedback for outputs from tools such as My Strengths to assist those with reading difficulties.


Delivery mechanism (approximately 30 comments)

The majority of comments within this theme suggested that work should be done to raise awareness of the service.

In addition, some users requested that the service be made more compatible with mobile phones and tablets, for example creating a My World of Work application.

‘Advertise it more’Female, Registered, 16-19 years

‘More promoting so people are aware of the help out there’



Annex A - Profile of Survey RespondentsN Per cent Valid per cent

Male 333 39 44Female 418 49 55Prefer not to say 4 0 1Missing 104 12

Total 859 100 100Registered 685 80 80Not registered 167 19 20Missing 7 1

Total 859 100 100

N Per centEmployed Part-time 118 16Employed Full-time 224 30Unemployed seeking work 208 28Unemployed not seeking work 13 2Volunteer 69 9Self employed 31 4At School 102 14At College 92 12At University 34 5Learning / Training Provider 19 3Prefer not to say 11 1Other 36 5

Total Non-registered users Registered users Survey Survey Survey My World of Work

N Per cent

Valid per cent

N Per cent

Valid per cent

N Per cent

Valid per cent

N Per cent

Valid per cent

12 - 15 years 0 0 0 0 0 0 0 0 0 38465 15 1516 - 19 years 282 33 37 34 20 26 248 36 40 110551 43 4420 - 24 years 72 8 10 20 12 16 52 8 8 29147 11 1125 - 49 years 287 33 38 59 35 46 228 33 36 55360 21 22Over 50 years 106 12 14 13 8 10 93 14 15 11994 5 5Prefer not to say / unknown14 8 1 1 3 2 2 5 1 1 8018 3 3

Missing 104 12 38 23 59 9 4196 2 Total 859 100 100 167 100 100 685 100 100 257731 100 100

14 Automatic / invalid dates of birth for some registered users of My World of Work result in an ‘unknown’ age profile for these users. Prefer not to say / unknown and Missing categories were excluded when weighting the data.


Annex B - Weighted vs Non-weighted results15


W NW Diff. W NW Diff.EFFECTIVENESSI like the option of a web based careers information service 90% 89% 0% 47% 45% 3%I understand the services that My World of Work offers 92% 92% 1% 58% 55% 3%I would recommend My World of Work to others 72% 70% 2% 41% 37% 3%I am satisfied with the service offered by My World of Work 88% 86% 2% 50% 46% 4%My World of Work has helped me to take the next steps 89% 88% 1% 59% 56% 3%


W NW Diff. W NW Diff.Average rating across features 90% 87% 3% 46% 42% 4%Average rating across tools 94% 93% 1% 57% 53% 4%Average rating across formats 94% 93% 1% 51% 48% 3%


W NW Diff. W NW Diff.USABILITYThe language used is clear and simple 94% 92% 1% 68% 62% 5%My World of Work is easy to use 88% 86% 2% 58% 54% 3%The homepage leads me to the information I need 81% 79% 2% 49% 46% 4%I can find the information I need quickly 79% 77% 3% 41% 38% 3%It is obvious where to find the information I need 78% 76% 3% 41% 38% 3%USEFULNESSThe information is easy to understand 84% 82% 2% 53% 49% 4%My World of Work has useful information 91% 90% 1% 58% 54% 3%My World of Work provides accurate information 89% 88% 1% 59% 56% 3%The information is up to date 88% 87% 2% 55% 52% 3%I like the way content is presented 85% 83% 1% 54% 50% 4%

15 NW = Non-weighted results; W = Weighted results; Diff. = Difference between groups (W-NW)


Annex C - Frequency of use analysis

weekly monthly every few months

only used it once

can’t remember/ don’t know

USABILITY The language used is clear and simple 93% 95% 93% 88% 79%My World of Work is easy to use 90% 92% 85% 75% 72%The homepage leads me to the information I need 85% 82% 81% 62% 63%I can find the information I need quickly 82% 83% 77% 63% 65%It is obvious where to find the information I need 81% 80% 74% 62% 69%USEFULNESSThe information is easy to understand 93% 91% 93% 84% 69%My World of Work has useful information 93% 91% 91% 75% 69%My World of Work provides accurate information 91% 90% 88% 74% 74%The information is up to date 90% 91% 82% 68% 72%I like the way content is presented 90% 86% 81% 67% 69%


only used it once


Average rating across features 89% 90% 89% 81% 83%Average rating across tools 95% 93% 95% 87% 88%Average rating across formats 94% 94% 95% 90% 91%


only used it once


EFFECTIVENESSI like the option of a web based careers information service 97% 93% 90% 84% 86%

I understand the services that My World of Work offers 95% 95% 90% 74% 75%

I would recommend My World of Work to others 98% 94% 87% 70% 83%

I am satisfied with the service offered by My World of Work 95% 90% 86% 72% 71%

My World of Work has helped me to take the next steps 81% 76% 71% 48% 52%

Skills Development Scotland

Alhambra House, 45 Waterloo Street, Glasgow, G2 6HST 0141 285 6000 F 0141 285 6001 E [email protected]

my world of work user survey · my world of work user survey 7 users were asked to identify the...

Documents