TY - GEN
T1 - Feature selection with rényi min-entropy
AU - Palamidessi, Catuscia
AU - Romanelli, Marco
N1 - Publisher Copyright:
© Springer Nature Switzerland AG 2018.
PY - 2018/1/1
Y1 - 2018/1/1
N2 - We consider the problem of feature selection, and we propose a new information-theoretic algorithm for ordering the features according to their relevance for classification. The novelty of our proposal consists in adopting Rényi min-entropy instead of the commonly used Shannon entropy. In particular, we adopt a notion of conditional min-entropy that has been recently proposed in the field of security and privacy, and which is strictly related to the Bayes error. We evaluate our method on two classifiers and three datasets, and we show that it compares favorably with the corresponding one based on Shannon entropy.
AB - We consider the problem of feature selection, and we propose a new information-theoretic algorithm for ordering the features according to their relevance for classification. The novelty of our proposal consists in adopting Rényi min-entropy instead of the commonly used Shannon entropy. In particular, we adopt a notion of conditional min-entropy that has been recently proposed in the field of security and privacy, and which is strictly related to the Bayes error. We evaluate our method on two classifiers and three datasets, and we show that it compares favorably with the corresponding one based on Shannon entropy.
UR - https://www.scopus.com/pages/publications/85053622535
U2 - 10.1007/978-3-319-99978-4_18
DO - 10.1007/978-3-319-99978-4_18
M3 - Conference contribution
AN - SCOPUS:85053622535
SN - 9783319999777
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 226
EP - 239
BT - Artificial Neural Networks in Pattern Recognition - 8th IAPR TC3 Workshop, ANNPR 2018, Proceedings
A2 - Pancioni, Luca
A2 - Trentin, Edmondo
A2 - Schwenker, Friedhelm
PB - Springer Verlag
T2 - 8th IAPR TC3 workshop on Artificial Neural Networks for Pattern Recognition, ANNPR 2018
Y2 - 19 September 2018 through 21 September 2018
ER -