Reliability quality measures for recommender systems

Users want to know the reliability of the recommendations; they do not accept high predictions if there is no reliability evidence. Recommender systems should provide reliability values associated with the predictions. Research into reliability measures requires the existence of simple, plausible and universal reliability quality measures. Research into recommender system quality measures has focused on accuracy. Moreover, novelty, serendipity and diversity have been studied; nevertheless there is an important lack of research into reliability/confidence quality measures.This paper proposes a reliability quality prediction measure (RPI) and a reliability quality recommendation measure (RRI). Both quality measures are based on the hypothesis that the more suitable a reliability measure is, the better accuracy results it will provide when applied. These reliability quality measures show accuracy improvements when appropriated reliability values are associated with their predictions (i.e. high reliability values associated with correct predictions or low reliability values associated with incorrect predictions).The proposed reliability quality metrics will lead to the design of brand new recommender system reliability measures. These measures could be applied to different matrix factorization techniques and to content-based, context-aware and social recommendation approaches. The recommender system reliability measures designed could be tested, compared and improved using the proposed reliability quality metrics.

• Publication year

  2018

• Venue

  Information Sciences

• Publication date

  2018-05-01

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1016/j.ins.2018.02.030arXiv 2402.04457
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Improving top-K recommendation with truster and trustee relationship in user trust network

  2016cited by this paper
• Recommender Systems Handbook

  2015cited by this paper
• A model to represent users trust in recommender systems using ontologies and fuzzy linguistic modeling

  2015cited by this paper
• A reliability-based recommendation method to improve trust-aware recommender systems

  2015cited by this paper
• Hierarchical graph maps for visualization of collaborative recommender systems

  2014cited by this paper
• Neighbor Selection and Weighting in User-Based Collaborative Filtering: A Performance Prediction Approach

  2014cited by this paper
• Recommender systems survey

  2013cited by this paper
• Do Recommender Systems Manipulate Consumer Preferences? A Study of Anchoring Effects

  2013cited by this paper
• Trees for explaining recommendations made through collaborative filtering

  2013influential reference
• Estimating confidence of individual rating predictions in collaborative filtering recommender systems

  2013influential reference
• Incorporating reliability measurements into the predictions of a recommender system

  2013influential reference
• Evaluating recommender systems

  2012cited by this paper
• Evaluating Recommendation Systems

  2011influential reference
• OrdRec: an ordinal model for predicting personalized item rating distributions

  2011cited by this paper
• A new collaborative filtering metric that improves the behavior of recommender systems

  2010cited by this paper
• A collaborative filtering algorithm and evaluation metric that accurately model the user experience

  2004cited by this paper
• Evaluating collaborative filtering recommender systems

  2004influential reference
• Beyond Algorithms: An HCI Perspective on Recommender Systems

  2001cited by this paper
• Explaining collaborative filtering recommendations

  2000cited by this paper

• A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challenges

  2025cites this paper
• Smart Internet of Everything Model for Knowledge-Graph-Based Reliable Recommendation

  2025cites this paper
• A healthy and reliable rating profile expansion approach to address data sparsity in food recommendation systems

  2025cites this paper
• A reliability-enhanced deep ensemble learning framework for recommendation

  2025cites this paper
• Smart Imputation, Better Recommendations: Improving Traditional Point-of-Interest Recommendation through Data Augmentation

  2025cites this paper
• Alleviating Cold Start in the EOSC Recommendations: Extended Page Rank Algorithm

  2024cites this paper
• Navigating techniques in job recommender systems on internship profile matching: a systematic review

  2024cites this paper
• Enhancing POI recommendations on social media: a sequential approach incorporating LSTM and user feedback

  2024cites this paper
• Recommendation System Evaluation with Various Similarity Metrics

  2024cites this paper
• QoS prediction of cloud services by selective ensemble learning on prefilling‐based matrix factorizations

  2024cites this paper
• An empirical study on metamorphic testing for recommender systems

  2024cites this paper
• Neural Collaborative Filtering Classification Model to Obtain Prediction Reliabilities

  2024cites this paper
• Research Proposal: Using Computational Design to Enhance Emotion-Driven Recommendations in Multimedia Experiences

  2023cites this paper
• Interactions with AI Systems: Trust and Transparency

  2023cites this paper
• A sequential neural recommendation system exploiting BERT and LSTM on social media posts

  2023cites this paper
• Estimating and Evaluating the Uncertainty of Rating Predictions and Top-n Recommendations in Recommender Systems

  2023cites this paper
• Providing prediction reliability through deep neural networks for recommender systems

  2023cites this paper
• Dirichlet Matrix Factorization: A Reliable Classification-Based Recommender System

  2022cites this paper
• Towards the Detection of Fake News on Social Networks Contributing to the Improvement of Trust and Transparency in Recommendation Systems: Trends and Challenges

  2022cites this paper
• FusionDeepMF: A Dual Embedding based Deep Fusion Model for Recommendation

  2022cites this paper
• Restricted Bernoulli Matrix Factorization: Balancing the trade-off between prediction accuracy and coverage in classification based collaborative filtering

  2022cites this paper
• Healthy Food Recommendation Using a Time-Aware Community Detection Approach and Reliability Measurement

  2022cites this paper
• Alleviating data sparsity problem in time-aware recommender systems using a reliable rating profile enrichment approach

  2022cites this paper
• A reliable deep representation learning to improve trust-aware recommendation systems

  2022cites this paper
• The Footprint of Factorization Models and Their Applications in Collaborative Filtering

  2021cites this paper
• Solving distribution problems in content-based recommendation system with gaussian mixture model

  2021cites this paper
• How Artificial Intelligence Can Augment the Collection of Scientific Literature

  2020cites this paper
• Explicit feedback meet with implicit feedback in GPMF: a generalized probabilistic matrix factorization model for recommendation

  2020cites this paper
• Model-Based Collaborative Filtering for Recommender Systems: An Empirical Survey

  2020cites this paper
• Providing reliability in Recommender Systems through Bernoulli Matrix Factorization

  2020influential citation
• DeepFair: Deep Learning for Improving Fairness in Recommender Systems

  2020cites this paper
• Improvement of Co-training Based Recommender System with Machine Learning

  2020cites this paper
• MDER: Multi-Dimensional Event Recommendation in Social Media Context

  2020cites this paper
• Robust Content-Based Recommendation Distribution System with Gaussian Mixture Model

  2020cites this paper
• Reliability Estimating By Demographic Matrix in Item-based Recommender Systems

  2020cites this paper
• Boosting collaborative filtering with an ensemble of co-trained recommenders

  2019cites this paper
• A Novel Personalized Recommendation Model Based on User's Context

  2019cites this paper
• Robust Model-Based Reliability Approach to Tackle Shilling Attacks in Collaborative Filtering Recommender Systems

  2019cites this paper
• Using entropy for similarity measures in collaborative filtering

  2019cites this paper
• Learning peer recommendation using attention-driven CNN with interaction tripartite graph

  2019cites this paper
• A weighted recommendation algorithm based on multiview clustering of user

  2019cites this paper
• Collaborative Filtering Based on Gaussian Mixture Model and Improved Jaccard Similarity

  2019cites this paper
• A Collaborative Filtering Approach Based on Naïve Bayes Classifier

  2019cites this paper
• Contextual Hybrid Session-Based News Recommendation With Recurrent Neural Networks

  2019cites this paper
• Towards reliability in collaborative filtering recommender systems

  2018cites this paper
• Recommendation System for Smart LMS Using Machine Learning: A Literature Review

  2018cites this paper
• A recommender system based on implicit feedback for selective dissemination of ebooks

  2018cites this paper