monitoring the impact of your strategies

A centre of expertise in digital information management

www.ukoln.ac.uk

Using the Social Web to Maximise Access to your Resources:

Monitoring the ImpactBrian KellyUKOLNUniversity of BathBath, UK

UKOLN is supported by:This work is licensed under a Attribution-NonCommercial-ShareAlike 2.0 licence (but note caveat)

Acceptable Use PolicyRecording of this talk, taking photos, discussing the content using email, instant messaging, blogs, SMS, etc. is permitted providing distractions to others is minimised.

Acceptable Use PolicyRecording of this talk, taking photos, discussing the content using email, instant messaging, blogs, SMS, etc. is permitted providing distractions to others is minimised.

Resources bookmarked using ‘scaseo' tag Resources bookmarked using ‘scaseo' tag

http://www.ukoln.ac.uk/web-focus/events/workshops/sca-seo-20090629/http://www.ukoln.ac.uk/web-focus/events/workshops/sca-seo-20090629/

Email:b.kelly@ukoln.ac.uk

Twitter:http://twitter.com/briankelly/

Blog:http://ukwebfocus.wordpress.com/

A centre of expertise in digital information management

www.ukoln.ac.uk

2

Contents

• Why Monitor and Evaluate?• Automated Measures• Qualitative Measures• The Flaws in Metrics• Questions and Conclusions

A centre of expertise in digital information management

www.ukoln.ac.uk

3

Why Monitor and Evaluate?

Why should you monitor?• To find out what they’re saying• To inform what you are doing today• To help in planning for new developments

Why should you evaluate?• To be able to identify trends• To be able to justify the ROI• To provide evidence to overcome sceptics

and doubters (internally and externally)

A centre of expertise in digital information management

www.ukoln.ac.uk

4

Institutional Dashboard - iSoton

The iSoton Web 2.0 dashboard

A centre of expertise in digital information management

www.ukoln.ac.uk

5

Institutional Dashboard - IMA

The dashboard for the Indianapolis Museum of Art (IMA)

A centre of expertise in digital information management

www.ukoln.ac.uk

6

Institutional Dashboard - IMA

The dashboard for the Indianapolis Museum of Art (IMA)

A centre of expertise in digital information management

www.ukoln.ac.uk

7

Build Your Own Dashboard

Blog post on “An information dashboard for your library service points (I) - Using email, RSS and FriendFeed”

Aaron Tay, Musings about librarianship blog

A centre of expertise in digital information management

www.ukoln.ac.uk

8

My Dashboard: Addict-o-Matic

A centre of expertise in digital information management

www.ukoln.ac.uk

9

My Dashboard: PeopleBrowsr

The PeopleBrowsr service

A centre of expertise in digital information management

www.ukoln.ac.uk

10

My Dashboard: Tweetdeck

An example of using Tweetdeck

A centre of expertise in digital information management

www.ukoln.ac.uk

11

My Dashboard: Email!

Could be used by people who wish to use email rather than new tools

TwilertEmail delivery of tweets matching a search string

I’ve an interest in rapid response to things said about my work

A centre of expertise in digital information management

www.ukoln.ac.uk

12

Blog Comments & Trackbacks

Post on Facebook Vanity URLs:

• Published on Sat 13 Jun 09

• Cited Techcrunch article on how to do this

Impact:• Referrer link on

TechCrunch • Drive traffic

back

A centre of expertise in digital information management

www.ukoln.ac.uk

13

Blog Statistics (Clustr.com)

Evidence of global impact?Evidence of global impact?

A centre of expertise in digital information management

www.ukoln.ac.uk

14

Administrator’s View

Why the peaks?• PDF tool• Fb post

(9 Nov 2007)• Multiple reasons

(IWMW, Fb posts, …)

Some idle thoughts:• Average of 4 comments / post• If 1 minute spend reading, this

is equivalent to 120 days. How does this compare to my writing effort (20 mins = 8 days writing)

A centre of expertise in digital information management

www.ukoln.ac.uk

15

Individual Posts

Reasons for popularity of posts:

1 Interest in Facebook

Timeliness of posts (Fb pages just launched)

Promotion on mailing lists

2 Timely post on new service

3 “Topless Swedish model”

4 Areas of my interest

1

1

1

2

1

3

3

A centre of expertise in digital information management

www.ukoln.ac.uk

16

Statistics For Individual PostsSteady stream of traffic for some posts e.g. on Facebook, “topless model”, …

Other posts are mostly read in days after publication (& may have additional peaks)

But what of implications of RSS statistics, email delivery, …?

But what of implications of RSS statistics, email delivery, …?

A centre of expertise in digital information management

www.ukoln.ac.uk

Distributed Blog InterfaceGet your blog listed in blog directories:

• New user communities

• Build on their marketing

But:• How do the

stats work?

17

Sunday

187

315

On Sunday 13 June, 353 views of Fb post on MyBlogLog and 187 on UK Web Focus

A centre of expertise in digital information management

www.ukoln.ac.uk

Google Reader

Google Reader (and other popular RSS readers) allow full item to be read

Implications for statistics?

A centre of expertise in digital information management

www.ukoln.ac.uk

Email Subscribers

Some users may prefer to have blog posts delivered via email

Note you’ll not see them via blog Web statistics

A centre of expertise in digital information management

www.ukoln.ac.uk

Technorati Ranking

Technorati provide details for:

• Blog authority (nos. of blogs which link to yours in 6 month period)

• Blog rankingBut service seems flakyWas useful in spotting trends and comparing with one’s peers

A centre of expertise in digital information management

www.ukoln.ac.uk

Lies, Dammed Lies & Blog Statistics

Blog statistics flawed?

Still need evidence?

How about:• A survey• Evidence of awards• Analysis of comments• …

A centre of expertise in digital information management

www.ukoln.ac.uk

22

Recording Evidence

What I do?• Monitor incoming links, comments, etc. for

evidence of impact • Bookmark online resources on del.icio.us • Make use of evaluation forms• Record relevant email messages• Record information of UKOLN’s Impact

database

A centre of expertise in digital information management

www.ukoln.ac.uk

23

Questions