Non-Negativity Constrained Missing Data Estimation for High-Dimensional and Sparse Matrices from Industrial Applications

Xin Luo, Mengchu Zhou, Shuai Li, Lun Hu, Mingsheng Shang

Research output: Contribution to journalArticle

Abstract

High-dimensional and sparse (HiDS) matrices are commonly seen in big-data-related industrial applications like recommender systems. Latent factor (LF) models have proven to be accurate and efficient in extracting hidden knowledge from them. However, they mostly fail to fulfill the non-negativity constraints that describe the non-negative nature of many industrial data. Moreover, existing models suffer from slow convergence rate. An alternating-direction-method of multipliers-based non-negative LF (AMNLF) model decomposes the task of non-negative LF analysis on an HiDS matrix into small subtasks, where each task is solved based on the latest solutions to the previously solved ones, thereby achieving fast convergence and high prediction accuracy for its missing data. This paper theoretically analyzes the characteristics of an AMNLF model, and presents detailed empirical studies regarding its performance on nine HiDS matrices from industrial applications currently in use. Therefore, its capability of addressing HiDS matrices is justified in both theory and practice.

Original languageEnglish (US)
Article number8654191
Pages (from-to)1844-1855
Number of pages12
JournalIEEE Transactions on Cybernetics
Volume50
Issue number5
DOIs
StatePublished - May 1 2020

All Science Journal Classification (ASJC) codes

  • Software
  • Information Systems
  • Human-Computer Interaction
  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Computer Science Applications

Keywords

  • Alternating-direction-method of multipliers
  • high-dimensional and sparse matrix
  • industrial application
  • non-negative latent factor analysis
  • recommender system

Cite this