Skip to main navigation Skip to search Skip to main content

GenRec: Large Language Model for Generative Recommendation

  • Jianchao Ji
  • , Zelong Li
  • , Shuyuan Xu
  • , Wenyue Hua
  • , Yingqiang Ge
  • , Juntao Tan
  • , Yongfeng Zhang

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In recent years, Large Language Models (LLMs) have emerged as powerful tools for diverse natural language processing tasks. However, their potential for recommender systems under the generative recommendation paradigm remains relatively unexplored. This paper presents an innovative approach to recommender systems using Large Language Models (LLMs) purely based on raw text data, i.e., using item name or title as item IDs rather than creating meticulously designed user or item IDs. More specifically, we present a novel LLM for Generative Recommendation (GenRec) method that utilizes the expressive power of LLM to directly generate the target item to recommend, rather than calculating the ranking score for each candidate item one by one as in traditional discriminative recommendation. GenRec uses LLM’s understanding ability to interpret context, learn user preferences, and generate relevant recommendations. Our proposed approach leverages the vast knowledge encoded in Large Language Models to accomplish recommendation tasks. We formulate specialized prompts to enhance the ability of LLM to comprehend recommendation tasks. Subsequently, we use these prompts to LoRA-fine-tune the LLaMA backbone LLM on the user-item interaction data represented by raw text (using raw item name or title as the item’s ID) to capture user preferences and item characteristics. Our research underscores the potential of LLM-based generative recommendation in revolutionizing the domain of recommendation systems and offers a foundational framework for future explorations in this field. We conduct extensive experiments on benchmark datasets, and the experiments show that our GenRec method achieves better results on large datasets. Code and data are are open-source at GitHub (https://github.com/rutgerswiselab/GenRec).

Original languageEnglish (US)
Title of host publicationAdvances in Information Retrieval - 46th European Conference on Information Retrieval, ECIR 2024, Proceedings
EditorsNazli Goharian, Nicola Tonellotto, Yulan He, Aldo Lipani, Graham McDonald, Craig Macdonald, Iadh Ounis
PublisherSpringer Science and Business Media Deutschland GmbH
Pages494-502
Number of pages9
ISBN (Print)9783031560620
DOIs
StatePublished - 2024
Event46th European Conference on Information Retrieval, ECIR 2024 - Glasgow, United Kingdom
Duration: Mar 24 2024 → Mar 28 2024

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume14610 LNCS

Conference

Conference46th European Conference on Information Retrieval, ECIR 2024
Country/TerritoryUnited Kingdom
CityGlasgow
Period3/24/24 → 3/28/24

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Keywords

  • Generative Recommendation
  • Large Language Model
  • Natural Language Processing
  • Recommender Systems

Fingerprint

Dive into the research topics of 'GenRec: Large Language Model for Generative Recommendation'. Together they form a unique fingerprint.

Cite this