An experimental analysis of assessor specific bias in a programming assessment in multi-assessor scenarios utilizing an eye tracker
Paper
Paper/Presentation Title | An experimental analysis of assessor specific bias in a programming assessment in multi-assessor scenarios utilizing an eye tracker |
---|---|
Presentation Type | Paper |
Authors | Debnath, Tanmoy (Author), Paul, Manoranjan (Author), Chakraborty, Subrata (Author), Podder, Pallab Kanti (Author), Gururajan, Raj (Author) and Hafeez-Baig, Abdul (Author) |
Editors | Shoniregun, Charles A. and Akmayeva, Galyna A. |
Journal or Proceedings Title | London International Conference on Education: Proceedings (LICE-2016) |
Number of Pages | 6 |
Year | 2016 |
Place of Publication | London, United Kingdom |
ISBN | 9781908320766 |
Web Address (URL) of Paper | http://csusap.csu.edu.au/~rpaul/paper/Lice2016.pdf |
Conference/Event | London International Conference on Education (LICE-2016) |
Event Details | London International Conference on Education (LICE-2016) Event Date 14 to end of 17 Nov 2016 Event Location London, United Kingdom |
Abstract | It has been experienced and reported by academic institutions around the globe that marking of most subject’s assessment scripts vary when different assessors are utilized for a given subject. To understand the difference, we capture and analysis pattern while they are marking the scripts. For this, a Java programming assessment from a real life university examination is marked by independent assessors. The assessors marked the scanned assessment scripts on a computer screen in front of an Eye tracker machine and their eye gaze data were recorded real time. Data indicate that different assessors marked the same answer script differently and their visual pattern are also varied although they were given the exact same instructions which demonstrates bias to a degree. For quality marking, several findings including the number of assessors needed are also presented in this manuscript. |
Keywords | marker bias, Eye tracking, assessment |
ANZSRC Field of Research 2020 | 390303. Higher education |
460999. Information systems not elsewhere classified | |
Public Notes | Copyright © LICE-2016. No evidence of copyright restrictions preventing deposit of Submitted version. |
Byline Affiliations | Charles Sturt University |
School of Management and Enterprise | |
Institution of Origin | University of Southern Queensland |
https://research.usq.edu.au/item/q3987/an-experimental-analysis-of-assessor-specific-bias-in-a-programming-assessment-in-multi-assessor-scenarios-utilizing-an-eye-tracker
Download files
Submitted Version
An experimental analysis of assessor specific bias in a programming assessment.pdf | ||
File access level: Anyone |
1178
total views151
total downloads1
views this month4
downloads this month