http://www.cnr.it/ontology/cnr/individuo/prodotto/ID91979

Evaluation measures for ordinal regression (Contributo in atti di convegno)

Type

Label

Evaluation measures for ordinal regression (Contributo in atti di convegno) (literal)

Anno

Alternative label

Baccianella S.; Esuli A.; Sebastiani F. (2009)
Evaluation measures for ordinal regression
in 9th IEEE International Conference on Intelligent Systems Design and Applications, Pisa, IT
(literal)

Http://www.cnr.it/ontology/cnr/pubblicazioni.owl#autori

Http://www.cnr.it/ontology/cnr/pubblicazioni.owl#note

In: ISDA'09 - 9th IEEE International Conference on Intelligent Systems Design and Applications (Pisa, IT, November 30 - December 2 2009). Proceedings, pp. 283 - 287. IEEE Press, 2009. (literal)

Http://www.cnr.it/ontology/cnr/pubblicazioni.owl#descrizioneSinteticaDelProdotto

ABSTRACT: Ordinal regression (OR -- also known as ordinal classification) has received increasing attention in recent times, due to its importance in IR applications such as learning to rank and product review rating. However, research has not paid attention to the fact that typical applications of OR often involve datasets that are highly imbalanced. An imbalanced dataset has the consequence that, when testing a system with an evaluation measure conceived for balanced datasets, a trivial system assigning all items to a single class (typically, the majority class) may even outperform genuinely engineered systems. Moreover, if this evaluation measure is used for parameter optimization, a parameter choice may result that makes the system behave very much like a trivial system. In order to avoid this, evaluation measures that can handle imbalance must be used. We propose a simple way to turn standard measures for OR into ones robust to imbalance. We also show that, once used on balanced d (literal)

Http://www.cnr.it/ontology/cnr/pubblicazioni.owl#affiliazioni