next up previous
Next: Linear reconstruction Up: No Title Previous: No Title

Introduction

Many important classification problems are polychotomies i.e., the data are organized into K classes with K > 2. The problem of finding an approximation of an unknown function F representing a polychotomy is much easier if it is first decomposed into a set of smaller subproblems called dichotomies, i.e., classification problems of two classes. Given a training set tex2html_wrap_inline519 of an unknown K-partition of tex2html_wrap_inline523, an algorithm learning this polychotomy by decomposition into L dichotomies produces an approximation of the following form:


eqnarray249
with tex2html_wrap_inline529, where tex2html_wrap_inline531 is a function selected in the set of hypotheses of the method to solve subproblem l, and tex2html_wrap_inline535tex2html_wrap_inline537tex2html_wrap_inline539 is a mapping associating to each set of L answers of the classifiers, a set of K confidences of membership to each class.

Two different types of decomposition/reconstruction schemes can be distinguished: a priori schemes are determined independently of the data, while a posteriori schemes depend on the training data. This work consists of a comparative study of different methods for a posteriori reconstruction.

The decomposition scheme can be specified by a decomposition matrix tex2html_wrap_inline557 such that tex2html_wrap_inline559 if class k is associated with z by tex2html_wrap_inline565, tex2html_wrap_inline567 if class k is ignored by tex2html_wrap_inline565.

The reconstruction basically consists in the function arg maxtex2html_wrap_inline573. The determination a posteriori of the mapping m is based on a dataset tex2html_wrap_inline581 distinct from the one used to select the tex2html_wrap_inline565 and distinct from the one use to test the system. In this framework, one can forget about the decomposition and consider the classification problem given by tex2html_wrap_inline585tex2html_wrap_inline587 to be solved by a model of the form arg maxtex2html_wrap_inline573. In what follows, the task tex2html_wrap_inline591 is represented by the two matrices tex2html_wrap_inline593 and tex2html_wrap_inline595, with tex2html_wrap_inline597tex2html_wrap_inline599, tex2html_wrap_inline601 and tex2html_wrap_inline603, tex2html_wrap_inline605 if and only if tex2html_wrap_inline607. Two different ways of doing this reconstruction are studied: linear and non-linear methods.


next up previous
Next: Linear reconstruction Up: No Title Previous: No Title

Eddy Mayoraz
Tue Mar 31 18:35:24 MET DST 1998