en
Proceedings chapter
Open access
English

BiTeM at WNUT 2020 Shared Task-1: Named Entity Recognition over Wet Lab Protocols using an Ensemble of Contextual Language Models

PublisherAssociation for Computational Linguistics
Collection
  • Conference on Empirical Methods in Natural Language Processing (and forerunners) (EMNLP); 2020
  • Workshop on Noisy User-generated Text (WNUT); 2020
First online date2020-11-19
Abstract

Recent improvements in machine-reading technologies attracted much attention to automation problems and their possibilities. In this context, WNUT 2020 introduces a Name Entity Recognition (NER) task based on wet laboratory procedures. In this paper, we present a 3-step method based on deep neural language models that reported the best overall exact match F1-score (77.99%) of the competition. By fine-tuning 10 times, 10 different pretrained language models, this work shows the advantage of having more models in an ensemble based on a majority of votes strategy. On top of that, having 100 different models allowed us to analyse the combinations of ensemble that demonstrated the impact of having multiple pretrained models versus fine-tuning a pretrained model multiple times.

eng
Citation (ISO format)
KNAFOU, Julien David Marc et al. BiTeM at WNUT 2020 Shared Task-1: Named Entity Recognition over Wet Lab Protocols using an Ensemble of Contextual Language Models. In: Proceedings of the 2020 EMNLP Workshop W-NUT: The Sixth Workshop on Noisy User-generated Text. [s.l.] : Association for Computational Linguistics, 2020. p. 305–313. (Conference on Empirical Methods in Natural Language Processing (and forerunners) (EMNLP)) doi: 10.18653/v1/2020.wnut-1.40
Main files (1)
Proceedings chapter (Published version)
Identifiers
206views
50downloads

Technical informations

Creation02/03/2022 10:31:00 AM
First validation02/03/2022 10:31:00 AM
Update time03/16/2023 2:52:02 AM
Status update03/16/2023 2:52:02 AM
Last indexation02/12/2024 1:37:45 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack