Proceedings chapter
OA Policy
English

DS4DH at TREC Health Misinformation 2021: Multi-Dimensional Ranking Models with Transfer Learning and Rank Fusion

Presented atGaithersburg, Maryland, November 15-19, 2021
PublisherWashington, USA : National Institute of Standards and Technology (NIST)
Collection
  • NIST Special Publication:; NIST SP 500-335
Publication date2022-02-14
Abstract

This paper describes the work of the Data Science for Digital Health (DS4DH) group at the TREC Health Misinformation Track 2021. The TREC Health Misinformation track focused on the development of retrieval methods that provide relevant, correct and credible information for health related searches on the Web. In our methodology, we used a two-step ranking approach that includes i) a standard retrieval phase, based on BM25 model, and ii) a re-ranking phase, with a pipeline of models focused on the usefulness, supportiveness and credibility dimensions of the retrieved documents. To estimate the usefulness, we classified the initial rank list using pre-trained language models based on the transformers architecture fine-tuned on the MS MARCO corpus. To assess the supportiveness, we utilized BERT-based models fine-tuned on scientific and Wikipedia corpora. Finally, to evaluate the credibility of the documents, we employed a random forest model trained on the Microsoft Credibility dataset combined with a list of credible sites. The resulting ranked lists were then combined using the Reciprocal Rank Fusion algorithm to obtain the final list of useful, supporting and credible documents. Our approach achieved competitive results, being top-2 in the compatibility measurement for the automatic runs. Our findings suggest that integrating automatic ranking models created for each information quality dimension with transfer learning can increase the effectiveness of health-related information retrieval.

Citation (ISO format)
ZHANG, Boya et al. DS4DH at TREC Health Misinformation 2021: Multi-Dimensional Ranking Models with Transfer Learning and Rank Fusion. In: The Thirtieth REtrieval Conference Proceedings (TREC 2021). Gaithersburg, Maryland. Washington, USA : National Institute of Standards and Technology (NIST), 2022. (NIST Special Publication:) doi: 10.48550/arxiv.2202.06771
Main files (1)
Proceedings chapter (Published version)
accessLevelPublic
Identifiers
Additional URL for this publicationhttps://trec.nist.gov/pubs/trec30/trec2021.html
343views
241downloads

Technical informations

Creation13/04/2022 09:42:00
First validation13/04/2022 09:42:00
Update23/12/2025 15:22:55
Status update23/12/2025 15:22:55
Last indexation23/12/2025 15:23:56
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack