Analyzing question quality through intersubjectivity: World views and objective assessments of questions on social question-answering

Vanessa Kitzie, Erik Choi, Chirag Shah

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

Social question-answering (SQA) allows people to ask questions in natural language and receive answers from others. While research on SQA has focused on the quality of answers provided with implications for system-based interventions, few studies have examined whether the questions asked to elicit these answers accurately depict an asker's information need. To address this gap, the current study explores the viability for system based interventions to improve questions by comparing human, non-textual assessments of question quality to automatic, textual features extracted from the questions' content in order to determine whether there is a significant relationship between subjective judgments on one hand, and objective ones on the other. Findings indicate that not only is there a significant relationship between human-based ratings of question quality criteria and extracted textual features, but also that distinct textual features contribute to explaining the variability of each human-based rating. These findings encourage further study of the relationship between the reasons for why a question might be of poor quality and textual features that can be extracted from the question. This relationship can ultimately inform design of intervention-based systems that can not only automatically assess question quality, but also provide reasons that can be understood by the asker as to why the quality of his or her question is poor and suggest how to revise the question.

Original languageEnglish (US)
JournalProceedings of the ASIST Annual Meeting
Volume50
Issue number1
DOIs
StatePublished - 2013

ASJC Scopus subject areas

  • Information Systems
  • Library and Information Sciences

Keywords

  • Question quality
  • Satisfaction
  • Social QandA

Fingerprint

Dive into the research topics of 'Analyzing question quality through intersubjectivity: World views and objective assessments of questions on social question-answering'. Together they form a unique fingerprint.

Cite this