Exploring programming assessment instruments: a classification scheme for examination questions

Paper

Sheard, Judy, Carbone, Angela, Chinn, Donald, Laakso, Mikko-Jussi, Clear, Tony, de Raadt, Michael, D'Souza, Daryl, Harland, James, Lister, Raymond, Philpott, Anne and Warburton, Geoff. 2011. "Exploring programming assessment instruments: a classification scheme for examination questions." Sanders, Kate (ed.) ICER 2011: 7th International Workshop on Computing Education Research . Providence, United States 08 - 09 Aug 2011 New York, NY. United States . https://doi.org/10.1145/2016911.2016920
Paper/Presentation Title

Exploring programming assessment instruments: a classification scheme for examination questions

Presentation TypePaper
AuthorsSheard, Judy (Author), Carbone, Angela (Author), Chinn, Donald (Author), Laakso, Mikko-Jussi (Author), Clear, Tony (Author), de Raadt, Michael (Author), D'Souza, Daryl (Author), Harland, James (Author), Lister, Raymond (Author), Philpott, Anne (Author) and Warburton, Geoff (Author)
EditorsSanders, Kate
Journal or Proceedings TitleProceedings of the 7th International Workshop on Computing Education Research (ICER 2011)
ERA Conference ID43185
Number of Pages6
Year2011
Place of PublicationNew York, NY. United States
ISBN9781450308298
Digital Object Identifier (DOI)https://doi.org/10.1145/2016911.2016920
Conference/EventICER 2011: 7th International Workshop on Computing Education Research
International Computing Education Research Conference
Event Details
International Computing Education Research Conference
ICER
Rank
B
B
B
Event Details
ICER 2011: 7th International Workshop on Computing Education Research
Event Date
08 to end of 09 Aug 2011
Event Location
Providence, United States
Abstract

This paper describes the development of a classification scheme that can be used to investigate the characteristics of introductory programming examinations. We describe the process of developing the scheme, explain its categories, and present a taste of the results of a pilot analysis of a set of CS1 exam papers. This study is part of a project that aims to investigate the nature and composition of formal examination instruments used in the summative assessment of introductory programming students, and the pedagogical intentions of the educators who construct these
instruments.

Keywordsexamination papers; CS1; introductory programming; measurement
ANZSRC Field of Research 2020461204. Programming languages
390113. Science, technology and engineering curriculum and pedagogy
390402. Education assessment and evaluation
Public Notes

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. To copy
otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee.

Byline AffiliationsMonash University
University of Washington, United States
University of Turku, Finland
Auckland University of Technology, New Zealand
Centre for Research in Transformative Pedagogies
Royal Melbourne Institute of Technology (RMIT)
University of Technology Sydney
Institution of OriginUniversity of Southern Queensland
Permalink -

https://research.usq.edu.au/item/q0x91/exploring-programming-assessment-instruments-a-classification-scheme-for-examination-questions

Log in to edit
  • 1875
    total views
  • 40
    total downloads
  • 2
    views this month
  • 0
    downloads this month

Export as

Related outputs

Moodle 1.9 top extensions cookbook
de Raadt, Michael. 2010. Moodle 1.9 top extensions cookbook. Birmingham, United Kingdom. Packt Publishing.
My students don't learn the way I do
de Raadt, Michael. 2011. "My students don't learn the way I do." Hamer, Jack and de Raadt, Michael (ed.) ACE 2011: 13th Australasian Computing Education Conference. Perth, Australia 17 - 20 Jan 2011 Sydney, Australia.
A simple time-management tool for students' online learning activities
de Raadt, Michael and Dekeyser, Stijn. 2009. "A simple time-management tool for students' online learning activities." Atkinson, Roger J. and McBeath, Clare (ed.) 26th Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education (ASCILITE 2009). Auckland, New Zealand 06 - 09 Dec 2009 Auckland, New Zealand.
Teaching programming strategies explicitly to novice programmers
de Raadt, Michael. 2008. Teaching programming strategies explicitly to novice programmers. PhD Thesis Doctor of Philosophy. University of Southern Queensland.
Introductory programming languages at Australian universities at the beginning of the twenty first century
de Raadt, Michael, Watson, Richard and Toleman, Mark. 2003. "Introductory programming languages at Australian universities at the beginning of the twenty first century." Journal of Research and Practice in Information Technology. 35 (3), pp. 163-167.
A system employing peer review and enhanced computer assisted assessment of querying skills
de Raadt, Michael, Dekeyser, Stijn and Lee, Tien Y.. 2007. "A system employing peer review and enhanced computer assisted assessment of querying skills." Informatics in Education. 6 (1), pp. 163-178.
The distinctive role of lab practical classes in computing education
de Raadt, Michael, Sutton, Ken and Venables, Anne. 2006. "The distinctive role of lab practical classes in computing education." Berglund, Anders and Wiggberg, Mattias (ed.) 6th Baltic Sea Conference on Computing Education Research (Koli Calling 2006). Koli, Finland 09 - 12 Nov 2006 Sweden. https://doi.org/10.1145/1315803.1315814
An objective comparison of languages for teaching introductory programming
Mannila, Linda and de Raadt, Michael. 2006. "An objective comparison of languages for teaching introductory programming." Berglund, Anders and Wiggberg, Mattias (ed.) 6th Baltic Sea Conference on Computing Education Research (Koli Calling 2006). Koli, Finland 09 - 12 Nov 2006 Uppsala, Sweden. https://doi.org/10.1145/1315803.1315811
Do students SQLify?: improving learning outcomes with peer review and enhanced computer assisted assessment of querying skills
de Raadt, Michael, Dekeyser, Stijn and Lee, Tien Yu. 2006. "Do students SQLify?: improving learning outcomes with peer review and enhanced computer assisted assessment of querying skills." Berglund, Anders and Wiggberg, Mattias (ed.) 6th Baltic Sea Conference on Computing Education Research (Koli Calling 2006). Koli, Finland 09 - 12 Nov 2006 Sweden. https://doi.org/10.1145/1315803.1315821
Electronic peer review: a large cohort teaching themselves?
de Raadt, Michael, Toleman, Mark and Watson, Richard. 2005. "Electronic peer review: a large cohort teaching themselves?" Goss, Halima (ed.) 22nd Annual Conference of the Australasian Society for Computers in Learning in Tertiary Education (ASCILITE 2005). Brisbane, Australia 04 - 07 Dec 2005 Brisbane, Australia. Australasian Society for Computers in Learning in Tertiary Education (ASCILITE).
Approaches to learning in computer programming students and their effect on success
de Raadt, Michael, Hamilton, Margaret, Lister, Raymond, Tutty, Jodi, Baker, Bob, Box, Ilona, Cutts, Quintin, Fincher, Sally, Hamer, John, Haden, Patricia, Petre, Marian, Robins, Anthony, Simon, ., Sutton, Ken and Tolhurst, Denise. 2005. "Approaches to learning in computer programming students and their effect on success." Brew, Angela and Asmar, Christine (ed.) 28th Higher Education Research and Development Society of Australasia Annual Conference (HERDSA 2005). Sydney, Australia 03 - 06 Jul 2005 Sydney, Australia.
Introductory programming in a web context
de Raadt, Michael. 2010. "Introductory programming in a web context." Clear, Tony and Hamer, John (ed.) 12th Australasian Computing Education Conference (ACE 2010) . Brisbane, Australia 18 - 22 Jan 2010 Sydney, Australia.
Eight years of computing education papers at NACCQ
Sheard, Judy, Carbone, Angela, de Raadt, Michael, Hamilton, Margaret, Lister, Raymond and Thompson, Errol. 2008. "Eight years of computing education papers at NACCQ." Mann, Samuel and Lopez, Mike (ed.) Conference of the National Advisory Committee on Computing Qualifications (NACCQ 2008). Auckland, New Zealand 04 - 07 Jul 2008 Hamilton, New Zealand.
Training strategic problem solvers
de Raadt, Michael, Toleman, Mark and Watson, Richard. 2004. "Training strategic problem solvers." ACM SIGCSE Bulletin. 36 (2), pp. 48-51. https://doi.org/10.1145/1024338.1024370
Classifying computing education papers: process and results
Carbone, Angela, de Raadt, Michael, Lister, Raymond, Hamilton, Margaret and Sheard, Judy. 2008. "Classifying computing education papers: process and results ." Caspersen, Michael (ed.) 4th International Computing Education Research Workshop (ICER 2008) . Sydney, Australia 06 - 07 Sep 2008 New York, NY. United States. https://doi.org/10.1145/1404520.1404536
Teaching programming strategies explicitly to novice programmers: can the way we teach strategies improve novice outcomes?
de Raadt, Michael. 2009. Teaching programming strategies explicitly to novice programmers: can the way we teach strategies improve novice outcomes? Sasrbrucken, Germany. VDM Verlag Dr. Muller.
Language trends in introductory programming courses
de Raadt, Michael, Watson, Richard and Toleman, Mark. 2002. "Language trends in introductory programming courses." Cohen, Eli B. and Boyd, E. (ed.) 2002 Informing Science + Information Technology Education Joint Conference (InSITE 2002). Cork, Ireland 19 - 21 Jun 2002 Santa Rosa, CA, United States.
Introductory programming: what's happening today and will there be any students to teach tomorrow?
de Raadt, Michael, Watson, Richard and Toleman, Mark. 2004. "Introductory programming: what's happening today and will there be any students to teach tomorrow?" Lister, Raymond and Young, Alison (ed.) ACE 2004: 6th Australasian Computing Education Conference. Dunedin, New Zealand 18 - 24 Feb 2004 Bedford Park, South Australia.
Language trends in introductory programming courses
de Raadt, Michael, Watson, Richard and Toleman, Mark. 2002. Language trends in introductory programming courses. Toowoomba, Australia. University of Southern Queensland.
Language tug-of-war: industry demand and academic choice
de Raadt, Michael, Watson, Richard and Toleman, Mark. 2003. "Language tug-of-war: industry demand and academic choice." Greening, Tony and Lister, Raymond (ed.) ACE 2003: 5th Australasian Computing Education Conference. Adelaide, Australia 04 - 07 Feb 2003 Sydney, Australia.
Teaching and assessing programming strategies explicitly
de Raadt, Michael, Watson, Richard and Toleman, Mark. 2009. "Teaching and assessing programming strategies explicitly." Hamilton, Margaret and Clear, Tony (ed.) ACE 2009: 11th Australasian Computing Education Conference. Wellington, New Zealand 20 - 23 Jan 2009 Bedford Park, South Australia.
An evaluation of electronic individual peer assessment in an introductory programming course
de Raadt, Michael, Lai, David and Watson, Richard. 2008. "An evaluation of electronic individual peer assessment in an introductory programming course." Lister, Raymond (ed.) 7th Baltic Sea Conference on Computing Education Research (Koli Calling 2007). Koli National Park, Finland 15 - 18 Nov 2007 Sydney, Australia.
Incorporating programming strategies explicitly into curricula
de Raadt, Michael, Toleman, Mark and Watson, Richard. 2008. "Incorporating programming strategies explicitly into curricula." Lister, Raymond (ed.) 7th Baltic Sea Conference on Computing Education Research (Koli Calling 2007). Koli National Park, Finland 15 - 18 Nov 2007 Sydney, Australia.
A review of Australasian investigations into problem solving and the novice programmer
de Raadt, Michael. 2007. "A review of Australasian investigations into problem solving and the novice programmer." Computer Science Education. 17 (3), pp. 201-213. https://doi.org/10.1080/08993400701538104
Variation in approaches to lab practical classes among computing academics
de Raadt, Michael and Venables, Anne. 2007. "Variation in approaches to lab practical classes among computing academics." Informatics in Education. 6 (1), pp. 215-230.
Differing ways that computing academics understand teaching
Lister, Raymond, Berglund, Anders, Box, Ilona, Cope, Chris, Pears, Arnold, Avram, Chris, Bower, Matt, Carbone, Angela, Davey, Bill, de Raadt, Michael, Doyle, Bernard, Fitzgerald, Sue, Mannila, Linda, Kutay, Cat, Peltomaki, Mia, Sheard, Judy, Sutton, Ken, Traynor, Des, Tutty, Jodi and Venables, Anne. 2007. "Differing ways that computing academics understand teaching." Mann, Samuel (ed.) ACE 2007: 9th Australasian Computing Education Conference. Ballarat, Australia 30 Jan - 02 Feb 2007 Sydney, Australia.
The Carrick vision and computing education: four case studies in multi-institutional collaboration
Carbone, Angela, de Raadt, Michael, Kay, Judy, Lister, Raymond, Litchfield, Andrew, Raban, Richard, Roe, Paul, Santamaria, Daniel, Sheard, Judy, Shepherd, John, Solomon, Andrew and Thomas, Richard. 2007. "The Carrick vision and computing education: four case studies in multi-institutional collaboration." Mann, Samuel (ed.) ACE 2007: 9th Australasian Computing Education Conference. Ballarat, Australia 30 Jan - 02 Feb 2007 Sydney, Australia.
Predictors of success in a first programming course
Fincher, Sally, Robins, Anthony, Baker, Bob, Box, Ilona, Cutts, Quintin, de Raadt, Michael, Haden, Patricia, Hamer, John, Hamilton, Margaret, Lister, Raymond, Petre, Marian, Sutton, Ken, Tolhurst, Denise and Tutty, Jodi. 2006. "Predictors of success in a first programming course." Tolhurst, Denise and Mann, Samuel (ed.) ACE 2006: 8th Australasian Computing Education Conference. Hobart, Australia 16 - 19 Jan 2006 Sydney, Australia.
The ability to articulate strategy as a predictor of programming skill
Cutts, Quintin, Fincher, Sally, Haden, Patricia, Robins, Anthony, Sutton, Ken, Baker, Bob, Box, Ilona, de Raadt, Michael, Hamer, John, Hamilton, Margaret, Lister, Raymond, Petre, Marian, Tolhurst, Denise and Tutty, Jodi. 2006. "The ability to articulate strategy as a predictor of programming skill." Tolhurst, Denise and Mann, Samuel (ed.) ACE 2006: 8th Australasian Computing Education Conference. Hobart, Australia 16 - 19 Jan 2006 Sydney, Australia.
Chick sexing and novice programmers: explicit instruction of problem solving strategies
de Raadt, Michael, Toleman, Mark and Watson, Richard. 2006. "Chick sexing and novice programmers: explicit instruction of problem solving strategies." Tolhurst, Denise and Mann, Samuel (ed.) ACE 2006: 8th Australasian Computing Education Conference. Hobart, Australia 16 - 19 Jan 2006 Sydney, Australia.
Do map drawing styles of novice programmers predict success in programming? a multi-national, multi-institutional study
Tolhurst, Denise, Baker, Bob, Hamer, John, Box, Ilona, Lister, Raymond, Cutts, Quintin, Petre, Marian, de Raadt, Michael, Robins, Anthony, Fincher, Sally, Haden, Patricia, Sutton, Ken, Hamilton, Margaret and Tutty, Jodi. 2006. "Do map drawing styles of novice programmers predict success in programming? a multi-national, multi-institutional study." Tolhurst, Denise and Mann, Samuel (ed.) ACE 2006: 8th Australasian Computing Education Conference. Hobart, Australia 16 - 19 Jan 2006 Sydney, Australia.
An effective system for electronic peer review
de Raadt, Michael, Toleman, Mark and Watson, Richard. 2006. "An effective system for electronic peer review." International Journal of Business and Management Education. 13 (9), pp. 48-62.
Computer assisted assessment of SQL query skills
Dekeyser, Stijn, de Raadt, Michael and Lee, Tien Yu. 2007. "Computer assisted assessment of SQL query skills." Bailey, James and Fekete, Alan (ed.) 18th Australasian Database Conference (ADC 2007). Ballarat, Australia 29 Jan - 02 Feb 2007 Bedford Park, South Australia.
Textbooks: under inspection
de Raadt, Michael, Watson, Richard and Toleman, Mark. 2005. Textbooks: under inspection. Toowoomba, Australia. University of Southern Queensland.