Proceedings chapter
Open access

The Evolution of an Evaluation Framework for a Text Mining System

Presented at Genoa (Italy), 24-26 May
Publication date2006

The Parmenides project developed a text mining application applied in three different domains exemplified by case studies for the three user partners in the project. During the lifetime of the project (and in parallel with the development of the system itself) an evaluation framework was developed by the authors in conjunction with the users, and was eventually applied to the system. The object of the exercise was two-fold: firstly to develop and perform a complete user-centered evaluation of the system to assess how well it answered the users' requirements and, secondly, to develop a general framework which could be applied in the context of other users' requirements and (with some modification) to similar systems. In this paper we describe not only the framework but the process of building and parameterising the quality model for each case study and, perhaps most interestingly, the way in which the quality model and users' requirements and expectations evolved over time.

Citation (ISO format)
UNDERWOOD, Nancy Louise, LISOWSKA, Agnès. The Evolution of an Evaluation Framework for a Text Mining System. In: Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC). Genoa (Italy). [s.l.] : [s.n.], 2006. p. 2486–2491.
Main files (1)
Proceedings chapter
  • PID : unige:3438

Technical informations

Creation10/02/2009 9:28:41 AM
First validation10/02/2009 9:28:41 AM
Update time03/14/2023 3:14:47 PM
Status update03/14/2023 3:14:47 PM
Last indexation02/12/2024 6:12:50 PM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack