How to find the best rated items on a likert scale and how many ratings are enough

Qing Liu, Debabrota Basu, Shruti Goel, Talel Abdessalem, Stéphane Bressan

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

The collection and exploitation of ratings from users are modern pillars of collaborative filtering. Likert scale is a psychometric quantifier of ratings popular among the electronic commerce sites. In this paper, we consider the tasks of collecting Likert scale ratings of items and of finding the n-k best-rated items, i.e., the n items that are most likely to be the top-k in a ranking constructed from these ratings. We devise an algorithm, Pundit, that computes the n-k best-rated items. Pundit uses the probability-generating function constructed from the Likert scale responses to avoid the combinatorial exploration of the possible outcomes and to compute the result efficiently. Selection of the best-rated items meets, in practice, the major obstacle of the scarcity of ratings. We propose an approach that learns from the available data how many ratings are enough to meet a prescribed error. We empirically validate with real datasets the effectiveness of our method to recommend the collection of additional ratings.

Original languageEnglish
Title of host publicationDatabase and Expert Systems Applications - 28th International Conference, DEXA 2017, Proceedings
EditorsErnesto Damiani, Amit Sheth, William I. Grosky, Abdelkader Hameurlain, Djamal Benslimane, Roland R. Wagner
PublisherSpringer Verlag
Pages351-359
Number of pages9
ISBN (Print)9783319644707
DOIs
Publication statusPublished - 1 Jan 2017
Externally publishedYes
Event28th International Conference on Database and Expert Systems Applications, DEXA 2017 - Lyon, France
Duration: 28 Aug 201731 Aug 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10439 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference28th International Conference on Database and Expert Systems Applications, DEXA 2017
Country/TerritoryFrance
CityLyon
Period28/08/1731/08/17

Fingerprint

Dive into the research topics of 'How to find the best rated items on a likert scale and how many ratings are enough'. Together they form a unique fingerprint.

Cite this