TY  - JOUR
U1  - Wissenschaftlicher Artikel
A1  - Breuer, Timo
A1  - Schaer, Philipp
A1  - Tunger, Dirk
T1  - Relevance Assessments, Bibliometrics, and Altmetrics: A Quantitative Study on PubMed and arXiv
JF  - Scientometrics
N2  - Relevance is a key element for analyzing bibliometrics and information retrieval (IR). In both domains, relevance decisions are discussed theoretically and sometimes evaluated in empirical studies. IR research is often based on test collections for which explicit relevance judgments are made, while bibliometrics is based on implicit relevance signals like citations or other non-traditional quantifiers like altmetrics. While both types of relevance decisions share common concepts, it has not been empirically investigated how they relate to each other on a larger scale. In this work, we compile a new dataset that aligns IR relevance judgments with traditional bibliometric relevance signals (and altmetrics) for life sciences and physics publications. The dataset covers PubMed and arXiv articles, for which relevance judgments are taken from TREC Precision Medicine and iSearch, respectively. It is augmented with bibliometric data from the Web of Science and Altmetrics. Based on the reviewed literature, we outline a mental framework supporting the answers to our research questions. Our empirical analysis shows that bibliometric ( implicit ) and IR ( explicit ) relevance signals are correlated. Likewise, there is a high correlation between biblio- and altmetrics, especially for documents with explicit positive relevance judgments. Furthermore, our cross-domain analysis demonstrates the presence of these relations in both research fields.
KW  - Relevance Assessments
KW  - Polyrepresentation
KW  - Altmetrics
KW  - Relevance Theory
KW  - Information Retrieval
KW  - Test Collections
Y1  - 2022
UN  - https://nbn-resolving.org/urn:nbn:de:hbz:832-epub4-27710
SN  - 0138-9130
SS  - 0138-9130
SN  - 1588-2861
SS  - 1588-2861
U6  - https://doi.org/10.1007/s11192-022-04319-4
DO  - https://doi.org/10.1007/s11192-022-04319-4
VL  - 127
IS  - 5
SP  - 2455
EP  - 2478
S1  - 24
PB  - Springer International Publishing
ER  -