• Home
  1. Home
  2. The Evolution of an Evaluation Framework for a Text Mining System
Proceedings chapter
OA Policy
English

The Evolution of an Evaluation Framework for a Text Mining System

Contributors

Underwood, Nancy Louise; Lisowska, Agnès

Presented at

Genoa (Italy), 24-26 May

Published in

Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC), p. 2486-2491

Publication date

2006

Abstract

The Parmenides project developed a text mining application applied in three different domains exemplified by case studies for the three user partners in the project. During the lifetime of the project (and in parallel with the development of the system itself) an evaluation framework was developed by the authors in conjunction with the users, and was eventually applied to the system. The object of the exercise was two-fold: firstly to develop and perform a complete user-centered evaluation of the system to assess how well it answered the users' requirements and, secondly, to develop a general framework which could be applied in the context of other users' requirements and (with some modification) to similar systems. In this paper we describe not only the framework but the process of building and parameterising the quality model for each case study and, perhaps most interestingly, the way in which the quality model and users' requirements and expectations evolved over time.

UNIGE affiliation entities

Citation (ISO format)

UNDERWOOD, Nancy Louise, LISOWSKA, Agnès. The Evolution of an Evaluation Framework for a Text Mining System. In: Proceedings of the Fifth International Conference on Language Resources and Evaluation (LREC). Genoa (Italy). [s.l.] : [s.n.], 2006. p. 2486–2491.

Main files (1)

Proceedings chapter

Identifiers

  • PID : unige:3438
573views
1290downloads

Technical informations

Creation

02/10/2009 09:28:41

First validation

02/10/2009 09:28:41

Update

14/03/2023 15:14:47

Status update

14/03/2023 15:14:47

Last indexation

29/10/2024 12:17:48
All rights reserved by Archive ouverte UNIGE and the University of Geneva
OpenAIRE Indexed & Validated