Use of the Checklist Method for Content Evaluation of Full-text Databases
DOI:
https://doi.org/10.5860/lrts.52n1.4Abstract
Following a detailed (but not comprehensive) review of the use of citation data as checklists for library collection evaluation, the use of this technique for evaluating database content is explained. This paper reports an investigation of the full-text and indexing and abstracting coverage of Library Literature & Information Science Full Text and EBSCOhost Academic Search Premier, based on checking citations to journal articles in the 2004 volumes of Library Resources & Technical Services and Collection Building. Analysis of these citations shows they were predominately to English-language library and information science journals published in the United States, with the majority dating from 2000 to 2004. Library Literature & Information Science Full Text contained 21.1 percent of the citations in full-text format, while the corresponding figure for Academic Search Premier was 16.1 percent. The database coverage also is analyzed by publication date, country of origin, and Library of Congress classification number of cited items. Some limitations to the study are acknowledged, while issues for future research are outlined.
References
Barbara Lockett, Guide to the Evaluation of Library Collections (Chicago: ALA 1989): 5-nIbid., 6; Anne H. Lundin, “List-Checking in Collection Development: An Imprecise Art,”
Collection Management
, no. 3/4 (1989): 103–12; Thomas E. Nisonger, “A Test of Two Citation Checking Techniques for Evaluating Political Science Collections in University Libraries,”
Library Resources & Technical Services
, no. 2 (Apr./June 1983): 163–76nPaul H. Mosher, Wesley Simonton Ed., '“Quality and Library Collections: New Directions in Research and Practice in Collection Evaluation,”' Advances in Librarianship (Orlando, Fla.: Academic Pr. 1984): 211-38nC. C. Jewett, '“Report of the Assistant Secretary Relative to the Library, Presented December 13, 1848,”' Third Annual Report of the Board of Regents of the Smithsonian Institution to the Senate and House of Representatives (Washington, D.C.: Tippin and Streeper 1849): 39-47nPaul H. Mosher, '“Collection Evaluation in Research Libraries: The Search for Quality, Consistency, and System in Collection Development,”' Library Resources & Technical Services 23 no. 1 (Winter 1979): 16-32 The original report, M. Llewellyn Raney,
The University Libraries
(Chicago: Univ. of Chicago Pr., 1933), was unavailable to the author of this articlenDouglas Waples, Harold D. Lasswell, National Libraries and Foreign Scholarship: Notes on Recent Selections in Social Science (Chicago: Univ. of Chicago Pr. 1936)nRobert Peerling Coale, '“Evaluation of a Research Library Collection: Latin-American Colonial History at the Newberry,”' Library Quarterly 35 no. 3 (July 1965): 173-84 William Webb, “Project CoEd: A University Library Collection Evaluation and Development Program,”
Library Resources & Technical Services
, no. 4 (Fall 1969): 457–62nRobert W. Burns, Evaluation of the Holdings in Science/Technology in the University of Idaho Library (Moscow, Idaho: Univ. of Idaho Library 1968) Christina E. Bolgiano and Mary Kathryn King, “Profiling a Periodicals Collection,”
College & Research Libraries
, no. 1 (Jan. 1978): 99–104; Richard D. Shiels and Martha S. Alt, “Library Materials on the History of Christianity at Ohio State University: An Assessment,”
Collection Management
, no. 2 (Summer 1985): 69–81; Cheryl Taranto and Anna H. Perrault, “An Evaluation of the Music Collection at Louisiana State University,”
LLA Bulletin
, no. 2 (Fall 1988): 89–92; Maria A. Porta and F. Wilfrid Lancaster, “Evaluation of a Scholarly Collection in a Specific Subject Area by Bibliographic Checking: A Comparison of Sources,”
Libri
, no. 2 (June 1988): 131–37; Kathleen Kehoe and Elida B. Stein, “Collection Assessment of Biotechnology Literature,”
Science & Technology Libraries
, no. 3 (Spring 1989): 47–55; Marina Snow, “Theatre Arts Collection Assessment,”
Collection Management
, no. 3/4 (1990): 69–89; Russell F. Dennison, “Quality Assessment of Collection Development Through Tiered Checklists: Can You Prove You Are a Good Collection Developer?”
Collection Building
, no. 1 (2000): 24–26; Brian Flaherty, “Assessing Legal Collections: Trying to Eke Out a Method from the Madness,”
Against the Grain
, no. 1 (Feb. 2002): 66–68, 70; Chris Matz, “Collecting Comic Books for an Academic Library,”
Collection Building
, no. 2 (2004): 131–37nJeffry Larson, '“The RLG Conspectus French Literature Collection Assessment Project,”' Collection Management 6 (Spring/Summer 1984): 97-114nLockett,
Guide to the Evaluation of Library CollectionsnIbid., 6nNisonger, “A Test of Two Citation Checking Techniques for Evaluating Political Science Collections in University Libraries.”nTerese Heidenwolf, '“Evaluating an Interdisciplinary Research Collection,”' Collection Management 18 no. 3/4 (1994): 34 William L. Emerson, “Adequacy of Engineering Resources for Doctoral Research in a University Library,”
College & Research Libraries
, no. 6 (Nov. 1957): 455–60, 504nJewett, “Report of the Assistant Secretary Relative to the Library, Presented December 13, 1848.”nNisonger, “A Test of Two Citation Checking Techniques for Evaluating Political Science Collections in University Libraries.”nHeidenwolf, “Evaluating an Interdisciplinary Research Collection,” 33–48nMaureen L. Gleason, James T. Deffenbaugh, '“Searching the Scriptures: A Citation Study in the Literature of Biblical Studies: Report and Commentary,”' Collection Management 6 no. 3/4 (Fall/Winter 1984): 107-17nJill V. Crawley-Low, '“Collection Analysis Techniques Used to Evaluate a Graduate-Level Toxicology Collection,”' Journal of the Medical Library Association 90 no. 3 (July 2002): 310-16nPorta and Lancaster, “Evaluation of a Scholarly Collection in a Specific Subject Area by Bibliographic Checking.”nJewett, “Report of the Assistant Secretary Relative to the Library, Presented December 13, 1848.”nKathy E. Gallagher, '“The Application of Selected Evaluative Measures to the Library’s Monographic Ophthalmology Collection,”' Bulletin of the Medical Library Association 69 no. 1 (Jan. 1981): 36-39 F.W. Newell,
Ophthalmology: Principles and Concepts
, 4th ed. (St. Louis: Mosby, 1978)nMaureen Martin Watson, '“The Association of Vision Science Librarians’ Citation Analysis of Duane’s
Clinical Ophthalmology
,”' Journal of the Medical Library Association 91 no. 1 (Jan. 2003): 83-85 Thomas David Duane, William Tasman, and Edward A. Jaeger,
Duane’s Clinical Ophthalmology
, rev. ed. (Philadelphia: Lippincott Williams and Wilkins, 1998)nRobert N. Bland, '“The College Textbook As a Tool for Collection Evaluation, Analysis, and Retrospective Collection Development,”' Library Acquisitions: Practice & Theory 4 no. 3/4 (1980): 193-97nIbid.; Roger Edward Stelk and F. Wilfrid Lancaster, “The Use of Textbooks in Evaluating the Collection of an Undergraduate Library,”
Library Acquisitions: Practice & Theory
, no. 2 (1990): 191–93nWilliam W. Currie, '“Evaluating the Collection of a Two-Year Branch Campus by Using Textbook Citations,”' Community & Junior College Libraries 6 no. 2 (1989): 75-79nEmerson, “Adequacy of Engineering Resources for Doctoral Research in a University Library.”nJean-Pierre V. M. Herubel, '“Simple Citation Analysis and the Purdue History Periodical Collection,”' Indiana Libraries 9 no. 2 (1990): 18-21 Jean-Pierre V.M. Herubel, “Philosophy Dissertation Bibliographies and Citations in Serials Evaluation,”
Serials Librarian
, no. 2/3 (1991): 65–73nMarion L. Buzzard, Doris E. New, '“An Investigation of Collection Support for Doctoral Research,”' College & Research Libraries 44 no. 6 (Nov. 1983): 469-75nCarol M. Moulden, Barton M. Lessin Ed., '“Evaluation of Library Collection Support for an Off-Campus Degree Program,”' The Off-Campus Library Services Conference Proceedings; Charleston, South Carolina, October 20– 21, 1988 (Mount Pleasant, Mich: Central Michigan Univ. 1989): 340-46nD. E. Lewis, '“A Comparison between Library Holdings and Citations,”' Library & Information Research News 11 no. 43 (Autumn 1988): 18-23nJames G. Neal, Barbara J. Smith, '“Library Support of Faculty Research at the Branch Campuses of a Multi-campus University,”' Journal of Academic Librarianship 9 no. 5 (Nov. 1983): 276-80nStephanie C. Haas, Kate Lee, '“Research Journal Usage by the Forestry Faculty at the University of Florida, Gainesville,”' Collection Building 11 no. 2 (1991): 23-25nManual D. Lopez, '“A Guide for Beginning Bibliographers,”' Library Resources & Technical Services 13 no. 4 (Fall 1969): 462-70nIbid., 469–70nIbidnIbid.; Thomas E. Nisonger, “An In-Depth Collection Evaluation at the University of Manitoba Library: A Test of the Lopez Method,”
Library Resources & Technical Services
, no. 4 (Fall 1980): 329–38nRuth Pagell, '“Searching Full-Text Periodicals: How Full Is Full?”' Database 10 no. 5 (Oct. 1987): 33-36nIbid.; Steve Black, “An Assessment of Social Sciences Coverage by Four Prominent Full-Text Online Aggregated Journal Packages,”
Library Collections, Acquisitions, & Technical Services
, no. 4 (Winter 1999): 411–19; Péter Jacsó, “Evaluating the Journal Base of Databases Using the Impact Factor of the ISI
Journal Citation Reports
,” in
National Online Meeting Proceedings 2000: Proceedings of the 21st National Online Meeting, New York, May 16– 18, 2000
, ed. Martha E. Williams, 169–72 (Medford, N.J.: Information Today, 2000)nJo Ann Carr, Amy Wolfe, Hugh A. Thompson Ed., '“Core Journal Titles in Full-Text Databases,”' Racing Toward Tomorrow: Proceedings of the Ninth National Conference of the Association of College and Research Libraries April 8– 11, 1999 (Chicago: ACRL 1999): 234-41nDavid J. Brier, Vickery Kaye Lebbin, '“Evaluating Title Coverage of Full-Text Periodical Databases,”' Journal of Academic Librarianship 25 no. 6 (Nov. 1999): 473-78 Bill Katz and Linda Sternberg Katz,
Magazines for Libraries
, 9th ed. (New York: Bowker, 1997)nBlack, “An Assessment of Social Sciences Coverage by Four Prominent Full-Text Online Aggregated Journal Packages.”nN. Jacobs, J. Woodfield, A. Morris, '“Using Local Citation Data to Relate the Use of Journal Articles by Academic Researchers to the Coverage of Full-Text Document Access Systems,”' Journal of Documentation 56 no. 5 (Sept. 2000): 563-81nAnna Grzeszkiewicz, A. Craig Hawbaker, '“Investigating a Full-Text Journal Database: A Case of Detection,”' Database 19 no. 6 (Dec. 1996): 59-62nDavid C. Tyler, Signe O. Boudreau, Susan M. Leach, '“The Communication Studies Researcher and the Communication Studies Indexes,”' Behavioral & Social Sciences Librarian 23 no. 2 (2005): 119-46nThomas Schaffer, '“Psychology Citations Revisited: Behavioral Research in the Age of Electronic Resources,”' Journal of Academic Librarianship 30 no. 5 (Sept. 2004): 354-60nH. W. Wilson, 'Library and Information Science Full Text' () (accessed Sept. 20, 2006)nIndiana University, Herman B Wells Library, “IUCAT” [online public access catalog], www.iucat.iu.edu/authenticate.cgi?status=startn '“Academic Search Premier,”' () (accessed Sept. 20, 2006)nIbidnn
Published
Issue
Section
License
Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-NonCommercial 4.0 International License (CC-BY-NC 4.0) that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after it has been accepted for publication. Sharing can lead to productive exchanges, as well as earlier and greater citation of published work.
