Scientific article
OA Policy
English

Improving average ranking precision in user searches for biomedical research datasets

Published inDatabase, vol. 2017, bax083
First online date2017-11-06
Abstract

Availability of research datasets is keystone for health and life science study reproducibility and scientific progress. Due to the heterogeneity and complexity of these data, a main challenge to be overcome by research data management systems is to provide users with the best answers for their search queries. In the context of the 2016 bioCADDIE Dataset Retrieval Challenge, we investigate a novel ranking pipeline to improve the search of datasets used in biomedical experiments. Our system comprises a query expansion model based on word embeddings, a similarity measure algorithm that takes into consideration the relevance of the query terms, and a dataset categorization method that boosts the rank of datasets matching query constraints. The system was evaluated using a corpus with 800k datasets and 21 annotated user queries, and provided competitive results when compared to the other challenge participants. In the official run, it achieved the highest infAP, being +22.3% higher than the median infAP of the participant's best submissions. Overall, it is ranked at top 2 if an aggregated metric using the best official measures per participant is considered. The query expansion method showed positive impact on the system's performance increasing our baseline up to +5.0% and +3.4% for the infAP and infNDCG metrics, respectively. The similarity measure algorithm showed robust performance in different training conditions, with small performance variations compared to the Divergence from Randomness framework. Finally, the result categorization did not have significant impact on the system's performance. We believe that our solution could be used to enhance biomedical dataset management systems. The use of data driven expansion methods, such as those based on word embeddings, could be an alternative to the complexity of biomedical terminologies. Nevertheless, due to the limited size of the assessment set, further experiments need to be performed to draw conclusive results.

Keywords
  • Biomedical Research
  • Data Curation
  • Databases, Factual
  • Information Storage and Retrieval
Affiliation entities Not a UNIGE publication
Citation (ISO format)
TEODORO, Douglas et al. Improving average ranking precision in user searches for biomedical research datasets. In: Database, 2017, vol. 2017, p. bax083. doi: 10.1093/database/bax083
Main files (1)
Article (Published version)
Secondary files (3)
Identifiers
Journal ISSN1758-0463
148views
65downloads

Technical informations

Creation13/10/2021 12:31:00
First validation13/10/2021 12:31:00
Update time16/03/2023 02:21:01
Status update16/03/2023 02:20:59
Last indexation01/11/2024 00:28:08
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack