Proceedings chapter
OA Policy
English

An Extended Overview of the CLEF 2020 ChEMU Lab: Information Extraction of Chemical Reactions from Patents

Presented atThessaloniki, Greece, September 22-25, 2020
Published inCappellato L., Eickhoff C., Ferro N., Névéol A. (Ed.), Proceedings of CLEF (Conference and Labs of the Evaluation Forum) 2020 Working Notes
Collection
  • CEUR Workshop Proceedings; 2696
Publication date2020
Abstract

The discovery of new chemical compounds is perceived as a key driver of the chemistry industry and many other economic sectors. The information about the new discoveries are usually disclosed in scientific literature and in particular, in chemical patents, since patents are often the first venues where the new chemical compounds are publicized. Despite the significance of the information provided in chemical patents, extracting the information from patents is costly due to the large volume of existing patents and its drastic expansion rate. The Cheminformatics Elsevier Melbourne University (ChEMU) evaluation lab 2020, part of the Conference and Labs of the Evaluation Forum 2020 (CLEF2020), provides a platform to advance the state-of-the-arts in automatic information extraction systems over chemical patents. In particular, we focus on extracting synthesis process of new chemical compounds from chemical patents. Using the ChEMU corpus of 1500 “snippets” (text segments) sampled from 170 patent documents and annotated by chemical experts, we defined two key information extraction tasks. Task 1 targets at chemical named entity recognition, i.e., the identification of chemical compounds and their specific roles in chemical reactions. Task 2 targets at event extraction, i.e., the identification of reaction steps, relating the chemical compounds involved in a chemical reaction. In this paper, we provide an overview of our ChEMU2020 lab. Herein, we describe the resources created for the two tasks, the evaluation methodology adopted, and participants results. We also provide a brief summary of the methods employed by participants of this lab and the results obtained across 46 runs from 11 teams, finding that several submissions achieve substantially better results than the baseline methods prepared by the organizers.

Keywords
  • Named entity recognition
  • Event extraction
  • Information extraction
  • Chemical reactions
  • Patent text mining
Citation (ISO format)
HE, Jiayuan et al. An Extended Overview of the CLEF 2020 ChEMU Lab: Information Extraction of Chemical Reactions from Patents. In: Proceedings of CLEF (Conference and Labs of the Evaluation Forum) 2020 Working Notes. Cappellato L., Eickhoff C., Ferro N., Névéol A. (Ed.). Thessaloniki, Greece. [s.l.] : [s.n.], 2020. (CEUR Workshop Proceedings)
Main files (1)
Proceedings chapter (Published version)
Identifiers
  • PID : unige:159580
Additional URL for this publicationhttp://ceur-ws.org/Vol-2696/paper_254.pdf
324views
326downloads

Technical informations

Creation03/02/2022 11:04:00
First validation03/02/2022 11:04:00
Update time16/03/2023 02:52:17
Status update16/03/2023 02:52:14
Last indexation01/11/2024 01:09:27
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack