A Systematic Review of Research on Live Chat Service
DOI:
https://doi.org/10.5860/rusq.51n2.172Abstract
The purpose of this study was to synthesize the research literature that has investigated library-based chat reference service. We define library-based chat reference as a synchronous, computer-based question answering service where users of the service ask question(s) which are answered by library employees or contracted agents. Following the methods for conducting a systematic review, we developed inclusion criteria for our data set and collected data from research on chat service dating from 1995 to January 2010. We limited our data to empirical research using established qualitative or quantitative methods. The final data set included 59 documents. We used White's (2001) digital reference service framework to guide our data analysis and unitized the data to the level of the research question(s) asked in each of the studies, resulting in 146 research questions. We focused the bulk of our analysis on the six categories of the framework where the research emphasis was strongest: parameters of the service; clients; parameters of the service; questions; question-answering process; response guidelines; staffing and training; and mission, objectives, statement of purpose.
Our aim is to analyze the literature on chat service from a broad perspective to uncover larger themes and streams of knowledge. We believe that this perspective is relevant to those who are currently engaged in chat service in some capacity—academics, librarians, managers, and IT developers. Our research presents the collective knowledge in this area and provides groundwork for researchers as they explore new questions related to chat service. It unifies for practitioners a collection of findings about chat service to enhance and improve their practice. The results suggest areas of opportunity for managers who wish to further develop chat as a library service, and the results synthesize current understandings about chat service which may be useful for IT developers to extend and innovate chat technology in libraries.
References
David R. Lankes, Melissa Gross, Charles McClure, '“Cost, Statistics, Measures, and Standards for Digital Reference Services: A Preliminary View,”' Library Trends 51 3 (2003): 401-13nAlessia Zanin-Yost, '“Digital Reference: What the Past Has Taught Us and What the Future Will Hold,”' Library Philosophy & Practice 7 1 (2004):nKaren Westwood, '“Lights! Camera! Action!”' American Libraries 27 1 (1997): 43-45nBernie Sloan, '“Twenty Years of Virtual Reference,”' Internet Reference Services Quarterly 11 2 (2006): 91-95nMarianne Foley, '“Instant Messaging Reference in an Academic Library: A Case Study,”' College & Research Libraries 634 1 (2002): 36-45nTai A. Phan, Academic Libraries: 2008 (Washington, D.C.: National Center for Education Statistics, Institute of Education Sciences 2009)n The State of America's Libraries 2010 () (accessed July 2, 2011).nStephen Francoeur, '“An Analytical Survey of Chat Reference Services,”' Reference Services Review 29 3 (2001): 189-203nMarie L. Radford, Lorri Mon, Marie L. Radford Ed., Pamela Snelson Ed., '“Reference Service in Face-to-Face and Virtual Environments,”' Academic Library Research: Perspectives and Current Trends (Chicago: Association of College and Research Libraries 2008): 1-47nAnn K. McKibbon, '“Systematic Reviews and Librarians,”' Library Trends 55 1 (2006): 203nMatthew L. Saxton, '“Meta-Analysis in Library and Information Science: Method, History, and Recommendations for Reporting Research,”' Library Trends 55 1 (2006): 158-70nAlison Brettle, '“Systematic Reviews and Evidence Based Library and Information Practice,”' Evidence Based Library and Information Practice (: 2009): 35-40nKalyani Ankem, '“Evaluation of Method in Systematic Reviews and Meta-Analyses Published in LIS,”' Library & Information Research 32 101 (2008): 91-104nChern Li Liew, '“Digital Library Research 1997–2007: Organisational and People Issues,”' Journal of Documentation (: 2008): 245-66nMcKibbon, '“Systematic Reviews and Librarians,”' (): 205nLili Luo, '“Chat Reference Evaluation: A Framework of Perspectives and Measures,”' Reference Services Review 36 1 (2008): 71-85nJeffrey Pomerantz, '“A Conceptual Framework and Open Research Questions for Chat-Based Reference Service,”' Journal of the American Society for Information Science & Technology 56 12 (2005): 1288-302nR. David Lankes, Melissa Gross, Charles R. McClure, '“Cost, Statistics, Measures, and Standards for Digital Reference Services: A Preliminary View,”' Library Trends 51 3 (2003): 401-13nMarilyn D. White, '“Digital Reference Services: Framework for Analysis and Evaluation,”' Library &Information Science Research 23 (2001): 211-31nDavid Ward, M. Kathleen Kern, '“Combining IM and Vendor-Based Chat: A Report from the Frontlines of an Integrated Service,”' portal: Libraries & the Academy (: 2006): 417-29nJoel Cummings, Lara Cummings, Linda Frederiksen, '“User Preferences in Reference Services: Virtual Reference and Academic Libraries,”' portal: Libraries and the Academy (: 2007): 81-96nCummings, '“User Preferences in Reference Services,”' (): 88nLee, '“Reference Services for Students Studying By Distance,”' (): 14nConnaway, '“Engaging Net Gen Students in Virtual Reference,”' (): 13nIbid., 14.nIbid.nSharon Naylor, Bruce Stoffel, Sharon Van Der Laan, '“Why Isn't Our Chat Reference Used More? Finding of Focus Group Discussions with Undergraduate Students,”' Reference & User Services Quarterly 47 4 (2008): 342-54nIbid., 348nNahyun Kwon, '“User Satisfaction with Referrals at a Collaborative Virtual Reference Service,”' Information Research 11 2 (2006): n.p.nLee, '“Reference Services for Students Studying By Distance,”' (): 11nJoanne B. Smyth, James C. MacKenzie, '“Comparing Virtual Reference Exit Survey Results and Transcript Analysis: A Model for Service Evaluation,”' Public Services Quarterly (: 2006): 85-105nJ.B. Hill, Cherie Madarash-Hill, Alison Allred, '“Outsourcing Digital Reference: The User Perspective,”' Reference Librarian 47 2 (2007): 57-74nNahyun Kwon, Vicki L. Gregory, '“The Effects of Librarians’ Behavioral Performance on User Satisfaction in Chat Reference Services,”' Reference & User Services Quarterly 47 2 (2007): 137-48nJack M. Maness, '“A Linquistic Analysis of Chat Reference Conversations with 18–24 Year-Old College Students,”' Journal of Academic Librarianship 34 1 (2008): 31-38nPomerantz, Luo, '“Motivations and Uses,”' (): 360nLee, '“Reference Services for Students Studying By Distance,”' (): 11nNilsen, Sheldrick Ross, '“Evaluating Virtual Reference,”' (): 63nKwon, '“User Satisfaction.”' ():nSmyth, MacKenzie, '“Comparing Virtual,”' (): 94nHill, '“Outsourcing Digital Reference,”' (): 67-68nKwon, Gregory, '“The Effects of Librarians’ Behavioral Performance,”' (): 144-45nManess, '“A Linquistic Analysis,”' (): 36nThe number in parentheses refers to the number of studies in which this category was listed as either the first or second highest percentage category of questions.nDeborah L. Meert, Lisa M. Given, '“Measuring Quality in Chat Reference Consortia: A Comparative Analysis of Responses to Users’ Queries,”' College & Research Libraries 70 1 (2009): 71-84nKwon, '“User Satisfaction.”' ():nNora Wikoff, '“Reference Transaction Handoffs: Factors Affecting the Transition from Chat to E-mail,”' Reference & User Services Quarterly 47 3 (2008): 230-41nKwon, '“User Satisfaction.”' ():nIan J. Lee, '“Do Virtual Reference Librarians Dream of Digital Reference Questions? A Qualitative and Quantitative Analysis of Email and Chat Reference,”' Australian Academic & Research Libraries 35 2 (2004): 95-110nChristina M. Desai, '“Instant Messaging Reference: How Does It Compare?”' The Electronic Library 21 1 (2003): 21-30nMarie L. Radford, '“Encountering Virtual Users: A Qualitative Investigation of Interpersonal Communication in Chat Reference,”' Journal of the American Society for Information Science & Technology 57 8 (2006): 1046-59nVirginia A. Walter, Cindy Mediavilla, '“Teens Are from Neptune, Librarians Are from Pluto: An Analysis of Online Reference Transactions,”' Library Trends 54 2 (2005): 209-27nManess, '“A Linquistic Analysis,”' (): 34nWalter, Mediavilla, '“Teens Are from Neptune,”' (): 221nManess, '“A Linquistic Analysis,”' (): 36nWestbrook, '“Chat Reference,”' (): 647-48nLorri M. Mon, '“User Perceptions of Digital Reference Services”' () (unpublished dissertation, Univ. of Washington, 2006);nTerrence W. Epperson, Alan Zemel, '“Reports, Requests, and Recipient Design: The Management of Patron Queries in Online Reference Chats,”' Journal of the American Society for Information Science & Technology 59 14 (2008): 2268-83nWestbrook, '“Chat Reference,”' (): 638-58nRadford, '“Encountering Virtual Users,”' (): 1046-59nEpperson, Zemel, '“Reports, Requests, and Recipient Design,”' (): 2268-83nMarilyn D. White, Eileen G. Abels, Neal Kaske, '“Evaluation of Chat Reference Service Quality,”' D-Lib Magazine 9 2 (2003):nJeffrey Pomerantz, Lili Luo, Charles R. McClure, '“Peer Review of Chat Reference Transcripts: Approaches and Strategies,”' Library & Information Science Research 28 (2006): 24-48nRadford, '“Encountering Virtual Users,”' (): 1055nStephanie J. Graves, Christina M. Desai, '“Instruction Via Chat Reference: Does Co-Browse Help?”' Reference Services Review (: 2006): 340-57nDavid Ward, '“Measuring the Completeness of Reference Transactions in Online Chats: Results of an Unobtrusive Study,”' Reference & User Services Quarterly 44 1 (2004): 46-58nCharlotte E. Ford, '“An Exploratory Study of the Differences between Face-to-Face and Computer-Mediated Reference Transactions”' (Bloomington: Indiana Univ. 2002)nDesai, Graves, '“Instruction Via Instant Messaging Reference?”' (): 179nChristina M. Desai, Stephanie J. Graves, '“Cyberspace or Face-to-Face: The Teachable Moment and Changing Reference Mediums,”' Reference & User Services Quarterly 47 3 (2008):nMoyo, '“Virtual Reference Services and Instruction,”' (): 225nDesai, Graves, '“Cyberspace or Face-to-Face,”' (): 250nDesai, Graves, '“Cyberspace or Face-to-Face,”' (): 249nMoyo, '“Virtual Reference Services and Instruction,”' ()225nDesai, Graves, '“Cyberspace or Face-to-Face,”' (): 247nIbid.nIbid.nDesai, Graves, '“Instruction Via Instant Messaging Reference,”' (): 186nGraves, Desai, '“Instruction Via Chat Reference,”' (): 352nDesai, Graves, '“Cyberspace or Face-to-Face,”' (): 252nKatherine D. Casebier, '“The University of Texas at Arlington's Virtual Reference Service: An Evaluation by the Reference Staff,”' Public Services Quarterly (: 2006): 127-42nCelia Huston, '“Reference Librarians’ Perceptions of Chat Reference: An Exploration of the Factors Effecting Implementation”' (Minneapolis: Capella Univ. 2009)nSarah K. Steiner, Casey M. Long, '“What Are We Afraid Of? A Survey of Librarian Opinions and Misconceptions Regarding Instant Messenger,”' Reference Librarian 47 1 (2007): 31-50nWard, Kern, '“Combining IM and Vendor-Based Chat,”' (): 424nEylem Ozkaramanli, '“Librarians’ Perceptions of Quality Digital Reference Services by Means of Critical Incidents”' (Pittsburgh: Univ. of Pittsburgh 2005)nIbid., 51.nThe number in parentheses indicates the number of respondents who listed each communication difficultynLili Luo, '“Chat Reference Competencies: Identification from a Literature Review and Librarian Interviews' Reference Services Review 35 2 (2007): 195-209n 'The URLs to the RUSA guidelines cited in the Walter and Mediavilla study, the van Duinkerken, Stephens, and MacDonald, and the Harmeyer study are no longer active links' () The current RUSA guidelines can be found here: nWalter, Mediavilla, '“Teens Are from Neptune,”' (): 216nWyoma van Duinkerken, Jane Stephens, Karen I. MacDonald, '“The Chat Reference Interview: Seeking Evidence Based on Rusa's Guidelines,”' New Library World 110 3/4 (2009): 107-21nDave Harmeyer, '“Online Virtual Chat Library Reference Service: A Quantitative and Qualitative Analysis”' (Malibu, Calif.: Pepperdine Univ. 2007) n.pnIbidnKwon, Gregory, '“The Effects of Librarians’ Behavioral,”' (): 145nVan Duinkerken, '“The Chat Reference Interview,”' (): 117nCummings, '“User Preferences in Reference Services,”' (): 88nNaylor, '“Why Isn't Our Chat Reference Used More?”' (): 349nCummings, '“User Preferences in Reference Services,”' (): 88nNaylor, '“Why Isn't Our Chat Reference Used More?”' (): 349nConnaway, '“Sense-Making and Synchronicity,”' (): 128nCheryl R. Dee, '“Digital Reference Service: Trends in Academic Health Science Libraries,”' Medical Reference Services Quarterly 24 1 (2005): 19-27nWard, Kern, '“Combining IM and Vendor-Based Chat,”' (): 422nHuston, '“Reference Librarians’ Perceptions of Chat Reference,”' (): 65,68.nDee, '“Digital Reference Service,”' (): 23nNeither study named the libraries that discontinued their services and so it is possible there is overlap in those numbers.nMarie L. Radford, M. Kathleen Kern, '“A Multiple-Case Study Investigation of the Discontinuation of Nine Chat Reference Services,”' Library & Information Science Research 28 (2006): 521-47nHuston, '“Reference Librarians’ Perceptions of Chat Reference,”' (): 98-99nPomerantz, Luo, '“Motivations and Uses,”' (): 361nSmyth, MacKenzie, '“Comparing Virtual Reference Exit Survey Results and Transcript Analysis,”' (): 98nDurrance, C. Joan, '“Reference Success: Does the 55 Percent Rule Tell the Whole Story?”' Library Journal 114 7 (1989): 31-36nPomerantz, Luo, '“Motivations and Uses,”' (): 360nSmyth, MacKenzie, '“Comparing Virtual Reference Exit Survey Results and Transcript Analysis,”' (): 85-105nAmy VanScoy, Megan Oakleaf, '“Effective Instruction in the Virtual Reference Environment,”' Teaching with Technology: An Academic Librarian's Guide n () KnowitNow24x7, Texting to KnowitNow24x7, n () QuestionPoint, QuestionPoint Cooperative Virtual Reference, nEpperson, Zemel, '“Reports, Requests, and Recipient Design,”' (): 2268-83n
