How Much Do Core Journals Change over a Decade?

Authors

  • Steve Black

DOI:

https://doi.org/10.5860/lrts.56n2.80

Abstract

This study replicates the method of identifying core journals in the field of communication disorders published in the January 2001 issue of Library Resources and Technical Services for the purpose of determining the degree to which the ranked list changed after ten years. Two measures are used to assess the reliability of rankings over time: Spearman's rho rank correlations among the citing journals and coefficients of variation among cited journals. Rank correlations of groups of journals can mask important changes in rank for individual titles, so characteristics of the journals with the greatest movements in rank over a decade are explored. Major findings are that the discipline's literature grew substantially over the decade, and the core journals remained stable over ten years (r s = 0.73). However, despite stability of core journals over time, some titles changed dramatically in rank. Coefficients of reliability calculated for this group of communication disorders journals suggests that approximately one-third of observed change in ranks is because of random variability in works cited.

References

Steve Black, '“Using Citation Analysis to Pursue a Core Collection of Journals for Communication Disorders,”' Library Resources & Technical Services 45 no. 1 (2001): 3-9nInna Shpilko, '“An Overview of the Journal Literature on Communication Disorders,”' Collection Building 22 no. 3 (2003): 102-19nThomas E. Nisonger, '“Journals in the Core Collection: Definition, Identification, and Applications,”' Serials Librarian 51 no. 3/4 (2007): 51-73nR. E. Rice, '“Journal-to-Journal Citation Data: Issues of Validity and Reliability,”' Scientometrics 15 no. 3 (1989): 257-82nDean F. Sittig, '“Identifying a Core Set of Medical Informatics Serials: An Analysis Using the Medline Database,”' Bulletin of the Medical Library Association 84 no. 2 (1996): 200-204nEugene Garfield, '“Citation Analysis as a Tool in Journal Evaluation,”' Science 178 (1972): 471-79nThomson Reuters, '“The Thomson Reuters Impact Factor,”' () (accessed Dec. 14, 2011).nB. R. Martin, '“The Use of Multiple Indicators in the Assessment of Basic Research,”' Scientometrics 36 no. 3 (1996): 343-62nDaniela Rosenstreich, Ben Wooliscroft, '“Measuring the Impact of Accounting Journals using Google Scholar and the G-Index,”' British Accounting Review 41 (2009): 227-39nJohn Hudson, '“Be Known by the Company You Keep: Citations—Quality or Chance?”' Scientometrics 71 no.2 (2007): 231-38nRobert K. Merton, The Sociology of Science: Theoretical and Empirical Investigations (Chicago: University of Chicago Press 1973)nPer O. Seglen, '“Why the Impact Factor of Journals Should Not be Used for Evaluating Research,”' British Medical Journal 314 no. 7079 (1997): 498-502nMichael H. MacRoberts, Barbara R. MacRoberts, '“Problems of Citation Analysis: A Critical Review,”' Journal of the American Society for Information Science 40 no. 5 (1989): 342-49nStephen C. Hubbard, Marie E. McVeigh, '“Casting a Wide Net: The Journal Impact Factor Numerator,”' Learned Publishing 24 no. 2 (2011): 133-37nBob Perdue, Chris Piotrowski, '“Citation Searching: A New Feature in PsycINFO,”' Perceptual & Motor Skills 96 (2003): 1237-38nKatherine W. McCain, '“Core Journal Networks and Cocitation Maps: New Bibliometric Tools for Serials Management,”' Library Quarterly 61 no. 3 (1991): 311-36nJeffery D. Kushkowski, Kristin H Gerhard, Cynthia Dobson, '“A Method for Building Core Journal Lists in Interdisciplinary Subject Areas,”' Journal of Documentation 54 no. 4 (1998): 477-88nThura Mack, '“A Model Methodology for Selecting Women's Studies Core Journals,”' Library & Information Science Research 13 (1991): 131-45nDean F. Sittig, '“Identifying a Core Set of Medical Informatics Serials: An Analysis Using the Medline Database,”' Bulletin of the Medical Library Association 84 no. 2 (1996): 200-204nDavid A. Goss, '“Citation Patterns in the Optometric and Ophthalmologic Clinical Binocular Vision Literature,”' Optometry & Vision Science 83 no. 12 (2006): 895-902nChristina C. Wray, '“The Journey Starts Here: Finding Special Education Research in Subscription Databases,”' Reference Librarian 52 (2011): 231-43nLinda G. Slater, '“Mapping the Literature of Speech-Language Pathology,”' Bulletin of the Medical Library Association 85 no. 3 (1997): 297-302nAnne-Wil Harzing, Ron van der Wal, '“A Google Scholar H-Index for Journals: A Better Metric to Measure Journal Impact in Economics and Business?”' (): (paper submitted to the 2008 Academy of Management Annual Meeting August 8–13, 2008, Anaheim, California).nS. C. Bradford, '“Sources of Information on Specific Subjects,”' Engineering 137 (1934): 85-86nP. Nieuwenhuysen, R. Rousseau, '“A Quick and Easy Method to Estimate the Random Effect on Citation Measures,”' Scientometrics 13 no. 1/2 (1988): 45-52nMaurice B. Line, '“Use of Citation Data for Periodicals Control in Libraries: A Response to Broadus,”' College & Research Libraries 46 no. 1 (1985): 36nMaurice B. Line, '“Changes in Rank Lists of Serials Over Time: Interlending versus Citation Data,”' College & Research Libraries 46 no. 1 (1985): 77-79nRobert N. Broadus, '“A Proposed Method for Eliminating Titles from Periodical Subscription Lists,”' College & Research Libraries 46 no. 1 (1985): 30-35nIbid.nJohn Laurence Kelland, Arthur P. Young, '“Citation as a Form of Library Use,”' Collection Management 19 no. 1/2 (1994): 81-100nMurray J. White, K. Geoffrey White, '“Citation Analysis of Psychology Journals,”' American Psychologist 32 no. 5 (1977): 3015nRick Ralston, Carole Gall, Frances A. Brahmi, '“Do Local Citation Patterns Support Use of the Impact Factor for Collection Development?”' Journal of the Medical Library Association 96 no. 4 (2008): 374-78nJanice Kreider, '“The Correlation of Local Citation Data with Citation Data from Journal Citation Reports,”' Library Resources & Technical Services 43 no. 2 (1999): 67-77nStephen J. Bensman, '“Probability Distributions in Library and Information Science: A Historical and Practitioner Viewpoint,”' Journal of the American Society for Information Science & Technology 51 no. 9 (2000): 816-33nS. C. Bradford, '“Sources of Information on Specific Subjects.”' ():nSidney Siegel, '“Nonparametric Statistics,”' American Statistician 11 no. 3 (1957): 13-19nMaurice Kendall, Jean Gibbons, Rank Correlation Methods (New York: Oxford Univ. Pr. 1990)nMerriam-Webster, '“Reliability,”' () (accessed Dec. 21, 2011).nLinda G. Slater, '“Mapping the Literature of Speech-Language Pathology.”' ():n'“Using Citation Analysis to Pursue a Core Collection of Journals for Communication Disorders,”' (): 6nMurray R. Spiegel, Schaum's Outline of Theory and Problems of Statistics (New York: Schaum 1961): 73-n'“Using Citation Analysis.”' ():n'“Mapping the Literature of Speech-Language Pathology.”' ():n'“Use of Citation Data.”' ():nSee Gordon, v. Breach, () American Institute of Physics and American Physical Society, nGordon, v. Breach, () American Institute of Physics and American Physical Society, 973 F. Supp. 414 (U.S. District Court for Southern New York), Aug. 26, 1997, n'“Mapping the Literature of Speech-Language Path-ology.”' ():n

Downloads

Published

2012-03-26

Issue

Section

Articles