Skilling up: evaluation of a design-based research methodology
Article
Trimmer, Karen. 2020. "Skilling up: evaluation of a design-based research methodology." The Australian Educational Researcher. 47 (2), pp. 357-375. https://doi.org/10.1007/s13384-019-00336-0
| Article Title | Skilling up: evaluation of a design-based research methodology |
|---|---|
| ERA Journal ID | 20008 |
| Article Category | Article |
| Authors | |
| Author | Trimmer, Karen |
| Journal Title | The Australian Educational Researcher |
| Journal Citation | 47 (2), pp. 357-375 |
| Number of Pages | 19 |
| Year | 2020 |
| Publisher | Springer |
| Place of Publication | Netherlands |
| ISSN | 0311-6999 |
| 2210-5328 | |
| Digital Object Identifier (DOI) | https://doi.org/10.1007/s13384-019-00336-0 |
| Abstract | This paper reports on the external evaluation of a two-year project aimed at improving educational opportunities for Aboriginal Education Workers (AEWs) through technology-based pedagogy. A design-based approach was selected by the research team to increase the relevance of the research for both praxis and practice, with emphasis on improvement of practice through evidence-based education throughout the project. To complement this research approach, a design-based approach was also adopted for the external evaluation that was undertaken in parallel to the research study. Design-based methodology has advantages and issues for an independent evaluator due to the inter-relationship of the research team in iteratively using findings of phases of the evaluation to inform and enhance the project. Internal evaluative data collected by the research team need to be balanced with that collected independently by the external evaluator to ensure authentic evaluation of the nature and effects of the interventions on participants. The paper reports on the outcomes of the external evaluation process and reflects on its capacity to serve dual objectives for evaluator and research team. |
| Keywords | Aboriginal education, Indigenous education, design-based, evaluation, education, technology-based pedagogy |
| ANZSRC Field of Research 2020 | 390405. Educational technology and computing |
| 390402. Education assessment and evaluation | |
| 450299. Aboriginal and Torres Strait Islander education not elsewhere classified | |
| Public Notes | File reproduced in accordance with the copyright policy of the publisher/author. |
| Byline Affiliations | School of Education |
| Institution of Origin | University of Southern Queensland |
Permalink -
https://research.usq.edu.au/item/q5988/skilling-up-evaluation-of-a-design-based-research-methodology
Download files
149
total views353
total downloads1
views this month0
downloads this month
Export as
Related outputs
Innovative School Leadership: Impacting Aboriginal Student Outcomes into the Future
Trimmer, Karen and Dixon, Roselyn. 2023. "Innovative School Leadership: Impacting Aboriginal Student Outcomes into the Future." Moodie, Nikki, Lowe, Kevin, Dixon, Roselyn and Trimmer, Karen (ed.) Assessing the Evidence in Indigenous Education Research: Implications for Policy and Practice. Switzerland. Palgrave Macmillan. pp. 141-160Trauma-informed behavior support with youth in flexible learning and vocational education settings: Exploring the acceptability of an online trauma-informed education program
Gavin, Tessa, Krishnamoorthy, Govind, Ayre, Kay, Bryce, India and Trimmer, Karen. 2024. "Trauma-informed behavior support with youth in flexible learning and vocational education settings: Exploring the acceptability of an online trauma-informed education program." Preventing School Failure. 68 (1), pp. 8-15. https://doi.org/10.1080/1045988X.2022.2132197Roadblocks and Enablers for Teacher Engagement in Professional Development Opportunities Aimed at Supporting Trauma-informed Classroom Pedagogical Practice
Collier, Simone, Trimmer, Karen, Bryce, India and Krishnamoorthy, Govind. 2022. "Roadblocks and Enablers for Teacher Engagement in Professional Development Opportunities Aimed at Supporting Trauma-informed Classroom Pedagogical Practice." Journal of Graduate Education Research. 3, pp. 51-65.Validating the barriers and enablers for teachers accessing professional development of trauma informed pedagogy
Collier, Simone, Bryce, India, Trimmer, Karen and Krishnamoorthy, Govind. 2022. "Validating the barriers and enablers for teachers accessing professional development of trauma informed pedagogy." Social Sciences & Humanities Open. 6 (1), pp. 1-7. https://doi.org/10.1016/j.ssaho.2022.100332The Need for an Understanding of Education Law Principles by School Principals
Butlin, Mark and Trimmer, Karen. 2018. "The Need for an Understanding of Education Law Principles by School Principals." Trimmer, Karen, Dixon, Roselyn and Findlay, Yvonne S. (ed.) The Palgrave handbook of education law for schools. Switzerland. Palgrave Macmillan. pp. 3-21Educational innovation: challenges of conducting and applying research in schools
Trimmer, Karen, Donovan, Jennifer and Flegg, Nicholas. 2020. "Educational innovation: challenges of conducting and applying research in schools." Donovan, Jennifer, Trimmer, Karen and Flegg, Nicholas (ed.) Curriculum, schooling and applied research: challenges and tensions for researchers. Cham, Switzerland. Palgrave Macmillan. pp. 1-17Evaluating frameworks for practice in mainstream primary school classrooms catering for children with developmental trauma: an analysis of the literature
Collier, Simone, Bryce, India, Trimmer, Karen and Krishnamoorthy, Govind. 2020. "Evaluating frameworks for practice in mainstream primary school classrooms catering for children with developmental trauma: an analysis of the literature." Children Australia. 45 (SI4), pp. 258-265. https://doi.org/10.1017/cha.2020.53Indigenous postgraduate education
Trimmer, Karen, Hoven, Debra and Keskitalo, Pigga. 2020. "Indigenous postgraduate education." Trimmer, Karen, Hoven, Debra and Keskitalo, Pigga (ed.) Indigenous postgraduate education: intercultural perspectives. Charlotte, NC, United States. Information Age Publishing. pp. 3-14TQM's presence within legal systems: example of impact on Australian higher education
Padro, Fernando F., Trimmer, Karen, Chang, Heejin and Green, Jonathan. 2024. "TQM's presence within legal systems: example of impact on Australian higher education." The TQM Journal. 36 (7), pp. 1845-1864. https://doi.org/10.1108/TQM-12-2019-0307Towards a Culturally Inclusive Model of Care: Quality Practice and Care Through the Lens of a Practising Nurse
Goldman, Natalie and Trimmer, Karen. 2019. "Towards a Culturally Inclusive Model of Care: Quality Practice and Care Through the Lens of a Practising Nurse." Trimmer, Karen, Newman, Tara and Padro, Fernando (ed.) Ensuring quality in professional education volume I: human client fields pedagogy and knowledge structures. Cham, Switzerland. Palgrave Macmillan. pp. 123-149School leadership and Aboriginal student outcomes: systematic review
Trimmer, Karen, Dixon, Rose and Guenther, John. 2021. "School leadership and Aboriginal student outcomes: systematic review." Asia-Pacific Journal of Teacher Education. 49 (1), pp. 20-36. https://doi.org/10.1080/1359866X.2019.1685646The need for case studies to illustrate quality practice: teaching in higher education to ensure quality of entry level professionals
Newman, Tara, Trimmer, Karen and Padro, Fernando F.. 2019. "The need for case studies to illustrate quality practice: teaching in higher education to ensure quality of entry level professionals." Trimmer, Karen, Newman, Tara and Padro, Fernando F (ed.) Ensuring quality in professional education volume I: human client fields pedagogy and knowledge structures. Cham, Switzerland. Palgrave Macmillan. pp. 1-17How about professionalism, professions and standards: the creation of acculturated professionals
Padro, Fernando F., Kek, Megan Y. C. A., Press, Nona, Trimmer, Karen, Green, Jonathan H., Hawke, Michael F. and Hawke, Laurie. 2019. "How about professionalism, professions and standards: the creation of acculturated professionals." Trimmer, Karen, Newman, Tara and Padro, Fernando F. (ed.) Ensuring quality in professional education volume II: engineering pedagogy and international knowledge structures. Cham, Switzerland. Palgrave Macmillan. pp. 1-28Retention of Indigenous pre-service teachers enrolled in an Australian regional university
Trimmer, Karen, Ward, Raelene and Wondunna-Foley, Linda. 2018. "Retention of Indigenous pre-service teachers enrolled in an Australian regional university." Teaching and Teacher Education. 76 (Special Issue), pp. 58-67. https://doi.org/10.1016/j.tate.2018.08.006Using the QFD matrix as a major continuous improvement tool to improve organizational quality
Mohsin, Ahmed Mansour, Padro, Fernando F. and Trimmer, Karen. 2018. "Using the QFD matrix as a major continuous improvement tool to improve organizational quality." Krishnan, Archana (ed.) Cases on quality initiatives for organizational longevity. Hershey, PA, United States. IGI Global. pp. 1-34Meeting the cultural and service needs of Arabic international students by using QFD
Mohsin, Ahmed Mansour and Trimmer, Karen. 2018. "Meeting the cultural and service needs of Arabic international students by using QFD." Padro, Fernando F., Erwee, Ronel, Harmes, Meredith A., Harmes, Marcus K. and Danaher, Patrick Alan (ed.) Postgraduate education in higher education. Singapore. Springer. pp. 315-336Development of a questionnaire to measure risk-taking in decision-making by school principals
Trimmer, Karen. 2017. "Development of a questionnaire to measure risk-taking in decision-making by school principals." Athens Journal of Education. 4 (3), pp. 223-251.Reinventing Another Unaipon: Indigenous Science Leaders for the Future
Trimmer, Karen, Gower, Graeme and Lock, Graeme. 2018. "Reinventing Another Unaipon: Indigenous Science Leaders for the Future." The Australian Journal of Indigenous Education. 47 (2), pp. 216-225. https://doi.org/10.1017/jie.2017.14Master teachers as leaders in school-based action research
Trimmer, Karen, Donovan, Jennifer, Findlay, Yvonne S. and Mohamed, Kamariah. 2017. "Master teachers as leaders in school-based action research." Leading and Managing. 23 (2), pp. 1-12.The impact of public policy on support services for indigenous families with children with special education needs
Trimmer, Karen and Dixon, Roselyn. 2017. "The impact of public policy on support services for indigenous families with children with special education needs." The Australian Journal of Indigenous Education. https://doi.org/10.1017/jie.2017.17Researching in-betweens: blurring the boundaries of mainstream and marginal education research
Riddle, Stewart, Black, Alison L. and Trimmer, Karen. 2015. "Researching in-betweens: blurring the boundaries of mainstream and marginal education research." Trimmer, Karen, Black, Alison L. and Riddle, Stewart (ed.) Mainstreams, margins and the spaces in-between: new possibilities for education research. Abingdon, Oxford. Routledge. pp. 1-12Decision-making by school principals and education researchers: the dilemma of reverse coding in structural equation modeling and its resolution in a study of risk-taking in decision-making for school principals
Trimmer, Karen. 2013. "Decision-making by school principals and education researchers: the dilemma of reverse coding in structural equation modeling and its resolution in a study of risk-taking in decision-making for school principals." Papanikos, Gregory T. (ed.) 15th Annual International Conference on Education (ATINER 2013). Athens, Greece 20 - 23 May 2013 Athens, Greece.Political pressures on international social research and evaluation
Trimmer, Karen. 2016. "Political pressures on international social research and evaluation." Research Intelligence. 131, pp. 28-29.The pressures within: dilemmas in the conduct of evaluation from within government
Trimmer, Karen. 2016. "The pressures within: dilemmas in the conduct of evaluation from within government." Trimmer, Karen (ed.) Political pressures on educational and social research: international perspectives. Oxon, United Kingdom. Routledge. pp. 180-191The pressures of the political on rigorous and ethical research
Trimmer, Karen. 2016. "The pressures of the political on rigorous and ethical research." Trimmer, Karen (ed.) Political pressures on educational and social research: international perspectives. Oxon, United Kingdom. Routledge. pp. 3-9Maths challenges for pre-service teachers
Flegg, Nicholas and Trimmer, Karen. 2015. "Maths challenges for pre-service teachers." Trimmer, Karen, Black, Alison L. and Riddle, Stewart (ed.) Mainstreams, margins and the spaces in-between: new possibilities for education research. Abingdon, Oxford. Routledge. pp. 181-194Measurement and modeling: sequential use of analytical techniques in a study of risk-taking in decision-making by school principals
Trimmer, Karen. 2016. "Measurement and modeling: sequential use of analytical techniques in a study of risk-taking in decision-making by school principals." Teacher Development. 20 (3), pp. 398-416. https://doi.org/10.1080/13664530.2016.1155477Evaluation as an educational development to improve practice: teacher ICT knowledge, skills and integration
Trimmer, Karen. 2015. "Evaluation as an educational development to improve practice: teacher ICT knowledge, skills and integration." Lock, Jennifer, Redmond, Petrea and Danaher, Patrick Alan (ed.) Educational developments, practices and effectiveness: global perspectives and contexts. Basingstoke, UK. Palgrave Macmillan. pp. 93-110The business of schools: the application of strategic management theories to risk taking in decision making in public schools
Trimmer, Karen. 2015. "The business of schools: the application of strategic management theories to risk taking in decision making in public schools." Baguley, Margaret M., Findlay, Yvonne S. and Kerby, Martin C. (ed.) Meanings and motivation in education research. New York, United States. Routledge. pp. 179-191Impacts on awareness, access and utilisation of early intervention support services for Indigenous families living in rural and remote areas: the National Disability Insurance Scheme
Trimmer, Karen, Dixon, Roselyn and Stubbs, Kerry. 2015. "Impacts on awareness, access and utilisation of early intervention support services for Indigenous families living in rural and remote areas: the National Disability Insurance Scheme." Trimmer, Karen, Black, Alison L. and Riddle, Stewart (ed.) Mainstreams, margins and the spaces in-between: new possibilities for education research. Abingdon, Oxford. Routledge. pp. 195-208Decision-making by school principals and education researchers: the dilemma of reverse coding in structural equation modeling and its resolution in a study of risk-taking in decision-making for school principals
Trimmer, Karen. 2014. "Decision-making by school principals and education researchers: the dilemma of reverse coding in structural equation modeling and its resolution in a study of risk-taking in decision-making for school principals." Athens Journal of Education. 1 (1), pp. 69-82.Principals' voices via modelling? Issues of voice in quantitative studies and the use of complexity theory
Trimmer, Karen. 2014. "Principals' voices via modelling? Issues of voice in quantitative studies and the use of complexity theory." Midgley, Warren, Davies, Andy, Oliver, Mark E. and Danaher, Patrick Alan (ed.) Echoes: ethics and issues of voice in education research. Rotterdam, Netherlands. Sense Publishers. pp. 197-209Gender differences in tertiary entrance scores
Peck, Bob and Trimmer, Karen. 1995. "Gender differences in tertiary entrance scores." Jeffery, Peter L. (ed.) Association for Research in Education Conference (AARE 1994). Newcastle, Australia Melbourne, Australia.The late birthday effect in Western Australia
Peck, Bob and Trimmer, Karen. 1995. "The late birthday effect in Western Australia." Issues in Educational Research. 5 (1), pp. 35-52.Synthesising the literature concerning math anxiety to inform a project on pre-service teacher retention rates
Flegg, Nicholas, Mohamed, Kamariah and Trimmer, Karen. 2013. "Synthesising the literature concerning math anxiety to inform a project on pre-service teacher retention rates." Veenstra, Cindy P. and Standridge, Charles R. (ed.) 2013 ASQ Advancing the STEM Agenda Conference. Grand Rapids, United States 03 - 04 Jun 2013 Milwaukee, WI. United States.Independent public schools: a move to increased autonomy and devolution of decision-making in Western Australian public schools
Trimmer, Karen. 2013. "Independent public schools: a move to increased autonomy and devolution of decision-making in Western Australian public schools." Childhood Education. 89 (3), pp. 178-184. https://doi.org/10.1080/00094056.2013.792703Walking the labyrinth: a metaphorical understanding of approaches to metaphors for, in and of education research
Midgley, Warren and Trimmer, Karen. 2013. "Walking the labyrinth: a metaphorical understanding of approaches to metaphors for, in and of education research." Midgley, Warren, Trimmer, Karen and Davies, Andy (ed.) Metaphors for, in and of education research. Newcastle Upon Tyne, United Kingdom. Cambridge Scholars Publishing. pp. 1-9Butterflies and black swans: metaphors that provide new perspectives to understand quantitative models in educational research
Trimmer, Karen. 2013. "Butterflies and black swans: metaphors that provide new perspectives to understand quantitative models in educational research." Midgley, Warren, Trimmer, Karen and Davies, Andy (ed.) Metaphors for, in and of education research. Newcastle Upon Tyne, United Kingdom. Cambridge Scholars Publishing. pp. 173-188Policy for all? The impact of centrally developed, universally applied policy on decision-making in Western Australian public schools
Trimmer, Karen. 2012. "Policy for all? The impact of centrally developed, universally applied policy on decision-making in Western Australian public schools." Fan, Si, Le, Thao, Le, Quynh and Yue, Yun (ed.) 2012 International Conference: Innovative Research in a Changing and Challenging World (AUAMII 2012). Phuket, Thailand 16 - 18 May 2012 Launceston, Tasmania.This item comprises data from the following sources: Web of Science