federated search evaluation & implementation. outline drivers methodology outcome

22
Federated Search evaluation & implementation

Upload: kyle-spencer

Post on 28-Mar-2015

223 views

Category:

Documents


4 download

TRANSCRIPT

Page 1: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Federated Search

evaluation & implementation

Page 2: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Outline

• Drivers• Methodology• Outcome

Page 3: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Drivers

• Customer pressure• Expiry of TD-Net

contract• Staff pressure• Peer pressure• Frustration with

bidding process

Page 4: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Put another way …

The average library decision about implementing new technologies takes longer than the average life cycle for new technologies.

K. G. Schneider. http://freerangelibrarian.com/2006/06/the_user_is_not_broken_a_meme.php

Page 5: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Methodology

Page 6: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Evidence gathering

• Literature search

• What do our users want

• Students / Researchers / Academic staff

• Library staff / Trainers

• Best of breed

Page 7: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

What we asked

“in an ideal world, how would you find information for your studies?”

Page 8: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Who we asked

• Research focus group

• Postgraduate focus group

• Academic staff focus group

• Informal interviews with students

Page 9: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

What we gave them …

Page 10: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

They said …

We want

Page 11: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

• Search individual databases & groups

• Simple & advanced search options

• Clear easy-to-use interface

• De-duplication

• Filtering of results

• Rank by relevancy

• Refworks compatible

• Searchable by journal title

• Spellchecker and/or synonyms

Page 12: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Shortlist

• 360 Search

• WebFeat

• MetaLib

• TDNet

Page 13: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Evaluation

• Trial

• User testing on campus

• User testing off campus

• Feedback / Web Monkey

• Amazon voucher

Page 14: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Overall rankings

1st 2nd 3rd 4th

WebFeat 28 21 17 15

Page 15: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

WebFeat responses

Yes No

Was it easy to use 71 9

Did you find the interface clear & simple

71 9

Could you search how you wanted to 64 15

Did it give a fast enough response 66 14

Did it produce relevant results 66 14

Was it useful 66 14

Did you find full text articles 63 17

Did you have any problems 13 67

Page 16: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

What users said …

“WebFeat was my definite favourite. It was excellent. ... please, please get this one.“

“I loved WebFeat”

“WebFeat was by far the best …”

“… so user friendly …”

“… really easy to use …”

Page 17: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Decision time

• User feedback

• Costs

Page 18: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Key features 1• Users choose what they want to search

• Quick Search boxes

• Topic Clustering

• Spell check function - just like Google

• Related terms

• Export to RefWorks

Page 19: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Key features 2

• Find it! Proxy – single sign on (sort of)

• Users can link directly to the native database from Find it! if you prefer.

• True native results - presents full text results within their native interfaces. All native functions are fully functional.

Page 20: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Questions?

Page 22: Federated Search evaluation & implementation. Outline Drivers Methodology Outcome

Further information

• Malcolm [email protected]