Jump to content

Scientometrics

From Wikipedia, the free encyclopedia
For the journal, seeScientometrics (journal).

Scientometricsis a subfield ofinformetricsthat studies quantitative aspects ofscholarly literature.Major research issues include the measurement of the impact of research papers and academic journals, the understanding of scientific citations, and the use of such measurements in policy and management contexts.[1]In practice there is a significant overlap between scientometrics and other scientific fields such asinformation systems,information science,science of science policy,sociology of science,andmetascience.Critics have argued that overreliance on scientometrics has created a system ofperverse incentives,producing apublish or perishenvironment that leads to low-quality research.

Historical development[edit]

[2][3][4][5] Modern scientometrics is mostly based on the work ofDerek J. de Solla PriceandEugene Garfield.The latter created theScience Citation Index[1]and founded theInstitute for Scientific Informationwhich is heavily used for scientometric analysis. A dedicated academic journal,Scientometrics,was established in 1978. The industrialization of science increased the number of publications and research outcomes and the rise of the computers allowed effective analysis of this data.[6]While the sociology of science focused on the behavior of scientists, scientometrics focused on the analysis ofpublications.[1]Accordingly, scientometrics is also referred to as the scientific and empirical study of science and its outcomes.[7][8]

TheInternational Society for Scientometrics and Informetricsfounded in 1993 is an association of professionals in the field.[9]

Later, around the turn of the century, evaluation and ranking of scientists and institutions came more into the spotlights. Based on bibliometric analysis of scientific publications and citations, theAcademic Ranking of World Universities( "Shanghai ranking" ) was first published in 2004 by theShanghai Jiao Tong University.Impact factorsbecame an important tool to choose between different journals. Rankings such as the Academic Ranking of World Universities and theTimes Higher Education World University Rankings(THE-ranking) became an indicator for the status of universities. Theh-indexbecame an important indicator of the productivity and impact of the work of a scientist. However, alternativeauthor-level metricshave been proposed.[10][11]

Around the same time, the interest of governments in evaluating research for the purpose of assessing the impact of science funding increased. As the investments in scientific research were included as part of the U.S.American Recovery and Reinvestment Act of 2009(ARRA), a major economic stimulus package, programs likeSTAR METRICSwere set up to assess if the positive impact on the economy would actually occur.[12]

Methods and findings[edit]

Methods of research include qualitative, quantitative and computational approaches. The main focus of studies have been on institutional productivity comparisons, institutional research rankings, journal rankings[7][8][13]establishing faculty productivity and tenure standards,[14]assessing the influence of top scholarly articles,[15]and developing profiles of top authors and institutions in terms of research performance.[16]

One significant finding in the field is a principle of cost escalation to the effect that achieving further findings at a given level of importance grow exponentially more costly in the expenditure of effort and resources. However, new algorithmic methods in search,machine learninganddata miningare showing that is not the case for many information retrieval and extraction-based problems.[citation needed]

More recent methods rely onopen sourceandopen datato ensure transparency and reproducibility in line with modernopen sciencerequirements. For instance, theUnpaywallindex and attendant research onopen accesstrends is based on data retrieved fromOAI-PMHendpoints of thousands ofopen archivesprovided by libraries and institutions worldwide.[17]

Recommendations to avoid common errors in scientometrics include: select topics with sufficient data; use data mining and web scraping, combine methods, and eliminate "false positives".[18][19]It is also necessary to understand the limits of search engines (e.g. Web of Science, Scopus and Google Scholar) which fail to index thousands of studies in small journals and underdeveloped countries.[20]

Common scientometric indexes[edit]

Indexes may be classified asarticle-level metrics,author-level metrics,andjournal-level metricsdepending on which feature they evaluate.

Impact factor[edit]

Main article:Impact factor

The impact factor (IF) or journal impact factor (JIF) of anacademic journalis a measure reflecting the yearly average number ofcitationsto recent articles published in that journal. It is frequently used as aproxyfor the relative importance of a journal within its field; journals with higher impact factors are often deemed to be more important than those with lower ones. The impact factor was devised byEugene Garfield,the founder of theInstitute for Scientific Information(ISI).

Science Citation Index[edit]

Main article:Science Citation Index

The Science Citation Index (SCI) is acitation indexoriginally produced by theInstitute for Scientific Information(ISI) and created byEugene Garfield.It was officially launched in 1964. It is now owned byClarivate Analytics(previously the Intellectual Property and Science business ofThomson Reuters).[21][22][23][24]The larger version (Science Citation Index Expanded) covers more than 8,500 notable and significantjournals,across 150 disciplines, from 1900 to the present. These are alternatively described as the world's leading journals ofscienceandtechnology,because of a rigorous selection process.[25][26][27]

Acknowledgment index[edit]

Main article:Acknowledgment index

An acknowledgment index (British acknowledgement index)[28]is a method forindexingand analyzing acknowledgments in thescientific literatureand, thus, quantifies the impact ofacknowledgments.Typically, a scholarly article has a section in which the authors acknowledge entities such as funding, technical staff, colleagues, etc. that have contributed materials or knowledge or have influenced or inspired their work. Like acitation index,it measures influences on scientific work, but in a different sense; it measures institutional and economic influences as well as informal influences of individual people, ideas, and artifacts. Unlike the impact factor, it does not produce a single overall metric, but analyzes the components separately. However, the total number of acknowledgments to an acknowledged entity can be measured and so can the number of citations to the papers in which the acknowledgment appears. The ratio of this total number of citations to the total number of papers in which the acknowledge entity appears can be construed as the impact of that acknowledged entity.[29][30]

Altmetrics[edit]

Main article:Altmetrics

In scholarly and scientific publishing, altmetrics are nontraditionalbibliometrics[31]proposed as an alternative[32]or complement[33]to more traditionalcitation impactmetrics, such asimpact factorandh-index.[34]The term altmetrics was proposed in 2010,[35]as a generalization ofarticle level metrics,[36]and has its roots in the #altmetricshashtag.Although altmetrics are often thought of as metrics about articles, they can be applied to people, journals, books, data sets, presentations, videos, source code repositories, web pages, etc. Altmetrics use public APIs across platforms to gather data with open scripts and algorithms. Altmetrics did not originally covercitationcounts,[37]but calculate scholar impact based on diverse online research output, such as social media, online news media, online reference managers and so on.[38][39]It demonstrates both the impact and the detailed composition of the impact.[35]Altmetrics could be applied to research filter,[35]promotion and tenure dossiers, grant applications[40][41]and for ranking newly published articles inacademic search engines.[42]

Criticisms[edit]

Critics have argued that overreliance on scientometrics has created apublish or perishenvironment withperverse incentivesthat lead to low-quality research.[43][44]

In popular culture[edit]

The main character inMichael Frayn’s novelSkiosis a Professor of Scientometrics.

See also[edit]

Journals[edit]

References and footnotes[edit]

  1. ^abcLeydesdorff, L.and Milojevic, S., "Scientometrics"arXiv:1208.4566(2013), forthcoming in: Lynch, M. (editor),International Encyclopedia of Social and Behavioral Sciencessubsection 85030. (2015)
  2. ^Nalimov, Vasily Vasilyevich; Mulchenko, B. M. (1969). ""Scientometrics." Studies of science as a process of information ".Science.Moscow, Russia.
  3. ^Garfield, Eugene (2009)."From the science of science to Scientometrics visualizing the history of science with HistCite software"(PDF).Journal of Informetrics.3(3): 173–179.doi:10.1016/j.joi.2009.03.009.ISSN1751-1577.Retrieved15 May2021.
  4. ^Валеев, Д. Х.; Голубцов, В. Г. (2018).Юридическая Наукометрия И Цивилистические Исследования.Методологические Проблемы Цивилистических Исследований(in Russian): 45–57.Retrieved15 May2021.
  5. ^Борисов, М. В.; Майсуразде, А. И. (2014).Восстановление связей в научном рубрикаторе на основе кластеризации гетерогенной сети(PDF)(Thesis). Московский государственный университет имени М. В. Ломоносова.Retrieved15 May2021.
  6. ^De Solla Price, D.,editorial statement.ScientometricsVolume 1, Issue 1 (1978)
  7. ^abLowry, Paul Benjamin; Romans, Denton; Curtis, Aaron (2004)."Global journal prestige and supporting disciplines: A scientometric study of information systems journals".Journal of the Association for Information Systems.5(2): 29–80.doi:10.17705/1jais.00045.SSRN666145.
  8. ^abLowry, Paul Benjamin; Moody, Gregory D.; Gaskin, James; Galletta, Dennis F.; Humpherys, Sean; Barlow, Jordan B.; and Wilson, David W. (2013). "Evaluating journal quality and the Association for Information Systems (AIS) Senior Scholars' journal basket via bibliometric measures: Do expert journal assessments add value?,"MIS Quarterly (MISQ), vol. 37(4), 993–1012. Also, see a YouTube video narrative of this paper at:https://www.youtube.com/watch?v=LZQIDkA-ke0.
  9. ^"About".International Society for Scientometrics and Informetrics.Retrieved2021-01-18.
  10. ^Belikov, A.V.; Belikov, V.V. (2015)."A citation-based, author- and age-normalized, logarithmic index for evaluation of individual researchers independently of publication counts".F1000Research.4:884.doi:10.12688/f1000research.7070.1.PMC4654436.
  11. ^Kinouchi, O. (2018). "A simple centrality index for scientific social recognition".Physica A: Statistical Mechanics and Its Applications.491:632–640.arXiv:1609.05273.Bibcode:2018PhyA..491..632K.doi:10.1016/j.physa.2017.08.072.S2CID22795899.
  12. ^Lane, J (2009). "Assessing the Impact of Science Funding".Science.324(5932): 1273–1275.doi:10.1126/science.1175335.PMID19498153.S2CID206520769.
  13. ^Lowry, Paul Benjamin; Humphreys, Sean; Malwitz, Jason; Nix, Joshua C (2007). "A scientometric study of the perceived quality of business and technical communication journals".IEEE Transactions on Professional Communication.50(4): 352–378.doi:10.1109/TPC.2007.908733.S2CID40366182.SSRN1021608.Recipient of the Rudolph Joenk Award for Best Paper Published in IEEE Transactions on Professional Communication in 2007.
  14. ^Dean, Douglas L; Lowry, Paul Benjamin; Humpherys, Sean (2011). "Profiling the research productivity of tenured information systems faculty at U.S. institutions".MIS Quarterly.35(1): 1–15.doi:10.2307/23043486.JSTOR23043486.SSRN1562263.
  15. ^Karuga, Gilbert G.; Lowry, Paul Benjamin; Richardson, Vernon J. (2007)."Assessing the impact of premier information systems research over time".Communications of the Association for Information Systems.19(7): 115–131.doi:10.17705/1CAIS.01907.SSRN976891.
  16. ^Lowry, Paul Benjamin; Karuga, Gilbert G.; Richardson, Vernon J. (2007)."Assessing leading institutions, faculty, and articles in premier information systems research journals".Communications of the Association for Information Systems.20(16): 142–203.doi:10.17705/1CAIS.02016.SSRN1021603.
  17. ^Piwowar, Heather; Priem, Jason; Orr, Richard (2019-10-09). "The Future of OA: A large-scale analysis projecting Open Access publication and readership".bioRxiv10.1101/795310.
  18. ^Jiawei, H., Kamber, M., Han, J., Kamber, M., Pei, J. 2012. Data Mining: Concepts and Techniques. Morgan Kaufmann, Wlatham, EE.UU.
  19. ^Quintero, Erika; Saavedra, Dalys; Murillo, Danny (2018)."Extracción de datos de perfiles en Google Scholar utilizando un algoritmo en el lenguaje R para hacer minería de datos".I+D Tecnológico.14:94–104.doi:10.33412/idt.v14.1.1807.S2CID165340425.
  20. ^Añino Ramos, Yostin Jesús; Monge Najera, Julian; Murillo-Gonzalez, Danny; Michán-Aguirre, Layla (2021)."Cómo aplicar la cienciometría a la investigación ecológica".Ecosistemas.30(2): 1–4.doi:10.7818/ECOS.2256.S2CID238733389.
  21. ^ Garfield, E. (1955). "Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas".Science.122(3159): 108–111.Bibcode:1955Sci...122..108G.doi:10.1126/science.122.3159.108.PMID14385826.
  22. ^ Garfield, Eugene (2011)."The evolution of the Science Citation Index"(PDF).International Microbiology.10(1): 65–69.doi:10.2436/20.1501.01.10.PMID17407063.
  23. ^ Garfield, Eugene (1963)."Science Citation Index"(PDF).University of Pennsylvania Garfield Library.pp. v–xvi.Retrieved2013-05-27.
  24. ^ "History of Citation Indexing".Clarivate Analytics.November 2010.Retrieved2010-11-04.
  25. ^ "Science Citation Index Expanded".Retrieved2017-01-17.
  26. ^ Ma, Jiupeng; Fu, Hui-Zhen; Ho, Yuh-Shan (December 2012). "The Top-cited Wetland Articles in Science Citation Index Expanded: characteristics and hotspots".Environmental Earth Sciences.70(3): 1039.Bibcode:2009EnGeo..56.1247D.doi:10.1007/s12665-012-2193-y.S2CID18502338.
  27. ^ Ho, Yuh-Shan (2012)."The top-cited research works in the Science Citation Index Expanded"(PDF).Scientometrics.94(3): 1297.doi:10.1007/s11192-012-0837-z.S2CID1301373.
  28. ^"Acknowledgement vs. Acknowledgment".22 September 2012.
  29. ^Councill, Isaac G.;Giles, C. Lee;Han, Hui; Manavoglu, Eren (2005). "Automatic acknowledgement indexing: expanding the semantics of contribution in the CiteSeer digital library".Proceedings of the 3rd international conference on Knowledge capture.K-CAP '05. pp. 19–26.CiteSeerX10.1.1.59.1661.doi:10.1145/1088622.1088627.ISBN1-59593-163-5.
  30. ^Giles, C. L.;Councill, I. G. (December 15, 2004)."Who gets acknowledged: Measuring scientific contributions through automatic acknowledgment indexing"(PDF).Proc. Natl. Acad. Sci. U.S.A.101(51): 17599–17604.Bibcode:2004PNAS..10117599G.doi:10.1073/pnas.0407743101.PMC539757.PMID15601767.
  31. ^"PLOS Collections".Public Library of Science (PLOS).3 November 2021.Altmetrics is the study and use of nontraditional scholarly impact measures that are based on activity in web-based environments
  32. ^"The" alt "does indeed stand for" alternative "" Jason Priem, leading author in theAltmetrics Manifestocomment 592
  33. ^Haustein, Stefanie; Peters, Isabella;Sugimoto, Cassidy R.;Thelwall, Mike; Larivière, Vincent (2014-04-01). "Tweeting biomedicine: An analysis of tweets and citations in the biomedical literature".Journal of the Association for Information Science and Technology.65(4): 656–669.arXiv:1308.1838.doi:10.1002/asi.23101.ISSN2330-1643.S2CID11113356.
  34. ^Chavda, Janica; Patel, Anika (30 December 2015)."Measuring research impact: bibliometrics, social media, altmetrics, and the BJGP".British Journal of General Practice.66(642): e59–e61.doi:10.3399/bjgp16X683353.PMC4684037.PMID26719483.
  35. ^abcPriem, Jason; Taraborelli, Dario; Groth, Paul; Neylon, Cameron (September 28, 2011)."Altmetrics: A manifesto (v 1.01)".Altmetrics.
  36. ^Binfield, Peter (9 November 2009)."Article-Level Metrics at PLoS - what are they, and why should you care?"(Video).University of California, Berkeley.Archivedfrom the original on 2021-12-12.
  37. ^Bartling, Sönke; Friesike, Sascha (2014).Opening Science: The Evolving Guide on How the Internet Is Changing Research, Collaboration and Scholarly Publishing.Cham: Springer International Publishing. p.181.doi:10.1007/978-3-319-00026-8.ISBN978-3-31-900026-8.OCLC906269135.Altmetrics and article-level metrics are sometimes used interchangeably, but there are important differences: article-level metrics also include citations and usage data;...
  38. ^Mcfedries, Paul (August 2012). "Measuring the impact of altmetrics [Technically Speaking]".IEEE Spectrum.49(8): 28.doi:10.1109/MSPEC.2012.6247557.ISSN0018-9235.
  39. ^Galligan, Finbar; Dyas-Correia, Sharon (March 2013). "Altmetrics: Rethinking the Way We Measure".Serials Review.39(1): 56–61.doi:10.1016/j.serrev.2013.01.003.
  40. ^Moher, David; Naudet, Florian; Cristea, Ioana A.; Miedema, Frank; Ioannidis, John P. A.; Goodman, Steven N. (2018-03-29)."Assessing scientists for hiring, promotion, and tenure".PLOS Biology.16(3): e2004089.doi:10.1371/journal.pbio.2004089.ISSN1545-7885.PMC5892914.PMID29596415.
  41. ^Nariani, Rajiv (2017-03-24). "Supplementing Traditional Ways of Measuring Scholarly Impact: The Altmetrics Way".ACRL 2017 Conference Proceedings.hdl:10315/33652.
  42. ^Mehrazar, Maryam; Kling, Christoph Carl; Lemke, Steffen; Mazarakis, Athanasios; Peters, Isabella (2018-04-08). "Can We Count on Social Media Metrics? First Insights into the Active Scholarly Use of Social Media".Proceedings of the 10th ACM Conference on Web Science.p. 215.arXiv:1804.02751.doi:10.1145/3201064.3201101.ISBN978-1-4503-5563-6.
  43. ^Roche, Christopher (2022-08-31)."The research conduct spectrum for surgeons: your career in their rule bending hands?".Bull Roy Coll Surg Engl.104(6): 274–277.doi:10.1308/rcsbull.2022.112.
  44. ^Weingart, Peter (2005-01-01). "Impact of bibliometrics upon the science system: Inadvertent consequences?".Scientometrics.62(1): 117–131.doi:10.1007/s11192-005-0007-7.ISSN0138-9130.S2CID12359334.

External links[edit]

Retrieved from "https://en.wikipedia.org/w/index.php?title=Scientometrics&oldid=1223441922"