From Log Files to Assessment Metrics: Measuring Students' Science Inquiry Skills Using Educational Data Mining

Janice D. Gobert, Michael Sao Pedro, Juelaila Raziuddin, Ryan S. Baker

Research output: Contribution to journalArticlepeer-review

98 Scopus citations

Abstract

We present a method for assessing science inquiry performance, specifically for the inquiry skill of designing and conducting experiments, using educational data mining on students' log data from online microworlds in the Inq-ITS system (Inquiry Intelligent Tutoring System; www.inq-its.org). In our approach, we use a 2-step process: First we use text replay tagging, a type of rapid protocol analysis in which categories are developed and, in turn, used to hand-score students' log data. In the second step, educational data mining is conducted using a combination of the text replay data and machine-distilled features of student interactions in order to produce an automated means of assessing the inquiry skill in question; this is referred to as a detector. Once this detector is appropriately validated, it can be applied to students' log files for auto-assessment and, in the future, to drive scaffolding in real time. Furthermore, we present evidence that this detector developed in 1 scientific domain, phase change, can be used-with no modification or retraining-to effectively detect science inquiry skill in another scientific domain, density.

Original languageEnglish (US)
Pages (from-to)521-563
Number of pages43
JournalJournal of the Learning Sciences
Volume22
Issue number4
DOIs
StatePublished - Oct 2013

ASJC Scopus subject areas

  • Education
  • Developmental and Educational Psychology

Fingerprint

Dive into the research topics of 'From Log Files to Assessment Metrics: Measuring Students' Science Inquiry Skills Using Educational Data Mining'. Together they form a unique fingerprint.

Cite this