Hirt, Franziska S and Moser, Ivan and Werlen, Egon and Imhof, Christof and Bergamin, Per
(2018)
A comparison of students' emotional self-reports with automated facial emotion recognition in a reading situation.
Abstract
This study investigated the measurement of students’ emotional states during a common learning activity, digital reading of factual texts. The objective was to compare emotional self- reports with automated facial emotion recognition. The latter promises non-intrusive measurements of emotions, which could inform adaptive learning systems. We used an established facial emotion recognition software trained on experts’ ratings of facial expressions (FaceReader). For basic emotions, previous studies have reported high agreement of the software with human raters. However, little evidence exists a) on its performance for the epistemic emotions of interest and boredom, b) on its agreement with self-reports, and c) in naturalistic reading situations. We compared the facial expression based recognition of interest, boredom, and valence of affect to students’ self-reports of those emotional states. Analyses of webcam recordings of 103 students revealed no relationship between facial emotion recognition and self-reports. Due to the low agreement of the facial emotion recognition software with self-reports, it remains unclear what the facial expression based recognition of interest, boredom, and valence actually implies. We advise to wait for more comprehensive evidence a) on the agreement of facial emotion recognition software with self- reports or b) on its predictive validity for learning before applying it in educational practice (e.g., in adaptive learning systems).
| Item Type: | Article in conference proceedings or Presentation at a conference (Paper) |
|---|---|
| Uncontrolled Keywords: | adaptive learning,emotional self-reports,epistemic emotions,facereader,facial emotion recognition |
| Subjects: | Education > Others in education > Education not elsewhere classified |
| Department/unit: | Fernfachhochschule Schweiz |
| Depositing User: | Franziska Hirt |
| Date Deposited: | 08 Jul 2019 05:20 |
| Last Modified: | 08 Jul 2019 05:20 |
| URI: | http://repository.supsi.ch/id/eprint/10704 |
Actions (login required)
 |
View Item |