en
Scientific article
Open access
English

Improving average ranking precision in user searches for biomedical research datasets

Published inDatabase, vol. 2017, bax083
First online date2017-11-06
Abstract

Availability of research datasets is keystone for health and life science study reproducibility and scientific progress. Due to the heterogeneity and complexity of these data, a main challenge to be overcome by research data management systems is to provide users with the best answers for their search queries. In the context of the 2016 bioCADDIE Dataset Retrieval Challenge, we investigate a novel ranking pipeline to improve the search of datasets used in biomedical experiments. Our system comprises a query expansion model based on word embeddings, a similarity measure algorithm that takes into consideration the relevance of the query terms, and a dataset categorization method that boosts the rank of datasets matching query constraints. The system was evaluated using a corpus with 800k datasets and 21 annotated user queries, and provided competitive results when compared to the other challenge participants. In the official run, it achieved the highest infAP, being +22.3% higher than the median infAP of the participant's best submissions. Overall, it is ranked at top 2 if an aggregated metric using the best official measures per participant is considered. The query expansion method showed positive impact on the system's performance increasing our baseline up to +5.0% and +3.4% for the infAP and infNDCG metrics, respectively. The similarity measure algorithm showed robust performance in different training conditions, with small performance variations compared to the Divergence from Randomness framework. Finally, the result categorization did not have significant impact on the system's performance. We believe that our solution could be used to enhance biomedical dataset management systems. The use of data driven expansion methods, such as those based on word embeddings, could be an alternative to the complexity of biomedical terminologies. Nevertheless, due to the limited size of the assessment set, further experiments need to be performed to draw conclusive results.

eng
Keywords
  • Biomedical Research
  • Data Curation
  • Databases, Factual
  • Information Storage and Retrieval
Affiliation Not a UNIGE publication
Citation (ISO format)
TEODORO, Douglas et al. Improving average ranking precision in user searches for biomedical research datasets. In: Database, 2017, vol. 2017, p. bax083. doi: 10.1093/database/bax083
Main files (1)
Article (Published version)
Secondary files (3)
Identifiers
ISSN of the journal1758-0463
107views
42downloads

Technical informations

Creation10/13/2021 12:31:00 PM
First validation10/13/2021 12:31:00 PM
Update time03/16/2023 2:21:01 AM
Status update03/16/2023 2:20:59 AM
Last indexation01/29/2024 11:16:42 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack