ICML 2009: Great Hall 2 Session 11

Theme: Performance and Quality Measures

Time: 14.15-15.30
Date: Wednesday 2nd September 2009
Chair: Andrew Booth

Evidence for change: library needs assessment at the Regina Qu’Appelle Health Region
Ms Susan E Powelson, Univeristy of Calgary, Canada

Susan Powelson, MLS, AHIP, is the Director of the University of Calgary Health Sciences Library. From 1998- July 2008 she was the Library Director for the Regina Qu'Appelle Health Region in Saskatchewan and co-chair (2002-2008) of the Saskatchewan Health Information Resources Partnership. In 2004, Susan received a Saskatchewan Healthcare Excellence Award for innovative service and in 2006 she was named Canadian Hospital Librarian of the Year. Susan chaired the CHLA/ABSC Taskforce to revise the Standards for Library and Information Services in Canadian Healthcare Facilities 2006. She is currently the past-president of the Canadian Health Libraries Association (CHLA/ABSC) and chair of the CHLA/ABSC 2011 conference.

Abstract:
Objectives: The Regina Qu’Appelle Health Region (RQHR) Health Sciences Library provides library services for physicians, staff, and students and needed to better understand who the users are, what their information needs are, and how the library can best meet those needs. The main purposes of the study were to determine, among RQHR staff and physicians:

• the level of awareness of library services,
• the use of library services, particularly print and electronic
• the reasons why information is needed.

Additional purposes of the study were to determine the use of the electronic resources, and the impact, if any, of being able to access information on patient care and program planning decisions

Design & Methods: A survey of was sent to all RQHR physicians and medical residents (n=564), and a random sample of RQHR health practitioners identified as information users (n=1200).

Results & Conclusions: The response rate among physicians and staff was 47%. Despite significant promotional activities some staff remain unaware of the library and library services. Additional work needs to be done to identify the pockets and enhance library promotion. Staff and physicians are continuing to use print departmental collections, and lack of computers on the units is impeding complete adoption of electronic resources. Consequently, easy offsite access is a critical issue that needs to be resolved. Surprisingly, departmental print collections continue to be important for responding to immediate information needs, which are predominantly for evidence to support patient care decisions.

Tell us what works for you: medical students respond to an information use survey
Kaye Lasserre, University of Queensland Library, Australia

Kaye Lasserre has worked in a range of health and academic libraries over the past twelve years. Currently she is Liaison Librarian with the Rural Clinical School in Toowoomba, a regional city in south west Queensland, providing University of Queensland Library services to support medical students and their teachers. This is part of the Australian Government’s strategy to increase the medical workforce in rural areas. Kaye’s interests include the use of information by medical students and ways of achieving optimal use by employing innovative delivery methods.

Abstract:
Aim: Knowledge of how students work with information is important for the Library in its efforts to enhance the student experience within its mission of enriching world-class scholarship at the University of Queensland. The objective of this research is to investigate how medical students use information for their studies; which library resources they access and find most useful, which formats they prefer, and how they use and value the library and its services. Content and delivery of information skills instruction are also part of the investigation.

Methodology: An online survey was designed with questions relating to the use of both electronic and print resources, and real and virtual library spaces. Once ethics approval had been obtained the survey was uploaded onto the University Library website with a link to the core MBBS (Bachelor of Medicine Bachelor of Surgery) information resources website. Students were emailed and asked to complete the survey. Focus groups are planned to build on the survey results and elicit more in-depth information from students.

Results and Discussion: Preliminary results indicate that students prefer print over electronic; they value accessing resources on a one-stop basis; and flexible delivery with resources available ‘on-demand’. The implications of this for future selection of resources, service provision and development of instruction will be discussed. The findings will be used to inform critical decisions in these areas as well as the design of Library spaces.

Metrics, Measures and Meanings: Evaluating the CareSearch website
J J Tieman, Flinders University, Australia

Jennifer Tieman is Director of the Australian Palliative Care Knowledge Network project. This project is developing web based resources supporting the palliative care community within Australia, specifically the CareSearch website. The project is based at Flinders University. She has been involved in a series of systematic reviews relating to palliative care and primary care and has contributed to the development of guidelines for the provision of palliative care in residential aged care and for the aged in the community. She has also conducted research in eHealth literacy as well as bibliometric analyses of the literature and evidence base for palliative care.

Abstract:
Background: Evaluation is an important part of managing projects particularly when developing online resources. CareSearch palliative care knowledge network is an online resource consolidating evidence and quality information for palliative care health professionals and patients and their families.

Objective: To develop and implement an evaluation framework to assess use and usefulness of the CareSearch website (www.caresearch.com.au)

Method: A formative and summative evaluation framework comprising four focus areas was developed:

• Access: The resource is built in such a way as to enable access by the intended users
• Use: The resource is used
• Usefulness: The resource makes a difference
• Process: The project is well managed.

A series of investigations were undertaken to assess the effectiveness of the project and the online resource in each of these areas. Evaluation was a planned and funded part of the project. Findings: Usability testing led to iterative improvements in the graphic design and site architecture. Feedback surveys helped to identify potential users who were unaware of the site and determine levels of satisfaction of existing users. Site metrics established patterns of use and areas of interest. Correspondence analysis and resource requests provided measures of quality and use. An intervention study is planned to show whether online delivery of information results in changes to clinical practice.

Conclusion: Evaluation plays a critical role in project and service management not only by ensuring outcome accountability but by engaging the field and enhancing end-user benefits.

Networking an evaluation of clinical literature searches
Joy F Wearne, University of Otago, Wellington, New Zealand

Joy Wearne is the Head of Reference Services at the Wellington Medical Library, School of Medicine and Health Sciences, University of Otago, Wellington

Abstract:
Medical librarians are generally considered to be expert searchers of biomedical databases, and most articles regarding search techniques focus on the integration of library-based information literacy courses into undergraduate and postgraduate curricula. However, articles examining the quality of searches carried out by librarians themselves suggest considerable variability in search styles and retrieval rates. A comparative study by McKibbon … et al (1990) examined the quality of Medline searches conducted by physicians, physician trainees and librarians. Although some of the librarians taking part in the study were found to have the highest retrieval of relevant citations (62%), the paper noted large differences in searching style among the librarians taking part. This was reflected in the success rates within this group.

This paper reports the results of a collaborative project conducted between three University of Otago medical libraries. The aim was to develop systems for evaluating the quality of literature searches conducted for library clients. The medical libraries taking part in the project are based in three centres in New Zealand: Dunedin, Christchurch and Wellington. To facilitate collaboration web-based technologies, two of which are social networking tools, were road-tested to determine their suitability for skills development. Comparisons of the suitability of each of these for enhancing collaboration and communication between staff in different libraries are discussed.

References: McKibbon, K. A., Haynes, R. B., Walker Dilks, et al. (1990). How good are clinical MEDLINE searches? A comparative study of clinical end-user and librarian searches. Computers and Biomedical Research, 23(6), 583-593.