Scientific article
OA Policy
English

Information–Theoretic Multiclass Classification Based on Binary Classifiers

Published inJournal of Signal Processing Systems, vol. 65, no. 3, p. 413-430
Collection
  • Open Access - Licence nationale Springer 
Publication date2011
Abstract

In this paper, we consider the multiclass classification problem based on sets of independent binary classifiers. Each binary classifier represents the output of a quantized projection of training data onto a randomly generated orthonormal basis vector thus producing a binary label. The ensemble of all binary labels forms an analogue of a coding matrix. The properties of such kind of matrices and their impact on the maximum number of uniquely distinguishable classes are analyzed in this paper from an information-theoretic point of view. We also consider a concept of reliability for such kind of coding matrix generation that can be an alternative to other adaptive training techniques and investigate the impact on the bit error probability. We demonstrate that it is equivalent to the considered random coding matrix without any bit reliability information in terms of recognition rate.

Citation (ISO format)
VOLOSHYNOVSKYY, Svyatoslav et al. Information–Theoretic Multiclass Classification Based on Binary Classifiers. In: Journal of Signal Processing Systems, 2011, vol. 65, n° 3, p. 413–430. doi: 10.1007/s11265-010-0526-1
Main files (1)
Article (Published version)
accessLevelPublic
Identifiers
Journal ISSN1939-8018
482views
261downloads

Technical informations

Creation13/03/2019 14:48:00
First validation13/03/2019 14:48:00
Update time15/03/2023 15:59:48
Status update15/03/2023 15:59:47
Last indexation31/10/2024 12:57:11
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack