A performance measurement framework for IT service management

PhD Thesis


Gacenga, Francis Njoroge. 2013. A performance measurement framework for IT service management. PhD Thesis Doctor of Philosophy. University of Southern Queensland.
Title

A performance measurement framework for IT service management

TypePhD Thesis
Authors
AuthorGacenga, Francis Njoroge
SupervisorCater-Steel, Aileen
Summers, Jane
Institution of OriginUniversity of Southern Queensland
Qualification NameDoctor of Philosophy
Number of Pages472
Year2013
Abstract

The use of Information Technology (IT) has become more pervasive and, progressively, there has been a shift from a technology focus to a service focus in managing IT. The performance measurement of IT service management (ITSM) is a major challenge faced by organisations adopting best practice frameworks. The extensive adoption of ITSM frameworks by organisations may point to the acceptance by IT service managers that best practice frameworks such as Information Technology Infrastructure Library (ITIL®) and standards such as ISO/IEC 20000 can deliver real operational efficiencies, ultimately translating into business benefits. Some organisations implementing ITSM initiatives have reported realisation of benefits in cost savings and standardisations in delivery of IT service.
Despite the appeal and the potential to realise benefits, the implementation of ITSM initiatives is complicated by the complexity in measuring performance. Measurement of the performance of ITSM is critical due to the size of the investment and the crucial importance of IT services to organisations. Few guidelines on the performance measurement of ITSM exist for industry practitioners; and scant academic research has been conducted on the performance measurement of ITSM. The objective of this research is to develop a framework that can be used to measure the performance of ITSM and, hence, contribute to ITSM initiatives in organisations.
To achieve this objective, the study uses a mixed-method and multi-paradigm approach to develop an ITSM performance measurement framework and contingency theory for the performance measurement of ITSM. The study uses a survey of ITSM benefits and performance measurement to identify ITSM performance measurement practices. A survey was conducted on the ITSM performance measurement practices of members of the IT Service Management Forum of Australia (itSMFA). The survey findings were used to identify six ITSM performance measurement exemplar organisations for case study. The case studies provided further insight into ITSM performance measurement practices. The results of the literature review, survey and case studies formed the basis for the design of the ITSM performance measurement framework. The design science approach of Design Science Research Methodology (DSRM) and the design method of Matching Analysis Projection and Synthesis (MAPS) were used to develop the ITSM performance measurement framework.
The study provides a comprehensive literature review on the performance measurement of ITSM. A review of the existing industry and academic literature showed a gap in theory for performance measurement of ITSM. There was also a lack of a contextualised performance measurement framework for ITSM. The study developed categories for types of organisation level and process level ITSM, and categories for types of ITSM performance metrics. The performance measurement framework developed by the study is structured using the Balanced Scorecard (BSC) and can be used to quantify benefits and link organisational level benefits and metrics with process level metrics. The developed framework includes a consolidated ITSM metrics catalogue structure. The study identified the internal and external organisational factors that influence the selection of ITSM performance metrics and proposes a contingency theory for the performance measurement of ITSM. The study makes theoretical and practical contributions in ITSM performance measurement by extending ITSM performance measurement theory, IS design theory and developing a holistic multi-level ITSM performance measurement framework that can be used by organisations.
This dissertation is a result of a study funded by an Australian Research Council (ARC) linkage project grant in partnership with Queensland Health (QH) and the IT Service Management Forum (itSMF) Australia. The study contributes to the linkage project by addressing the complex interactions of benefits, performance metrics and methods to enable Chief Information Officers (CIOs) and IT service managers to measure the performance of IT service management.

KeywordsInformation technology; IT service management; performance measurement; ITSM initiatives; industry practitioners; frameworks;
ANZSRC Field of Research 2020460999. Information systems not elsewhere classified
460908. Information systems organisation and management
350303. Business information systems
Byline AffiliationsSchool of Information Systems
Permalink -

https://research.usq.edu.au/item/q2019/a-performance-measurement-framework-for-it-service-management

Download files


Published Version
Gacenga_2013_whole.pdf
File access level: Anyone

  • 3300
    total views
  • 3761
    total downloads
  • 6
    views this month
  • 6
    downloads this month

Export as

Related outputs

Applying the FAIR principles to the Drought Monitor to improve accessibility of data
Gacenga, Francis, An-Vo, Duc-Anh, McCulloch, Jillian and Cobon, David. 2024. "Applying the FAIR principles to the Drought Monitor to improve accessibility of data." 30th Conference of the Australian Meteorological and Oceanographic Society. Canberra, Australia 05 - 09 Feb 2024 Australia.
Using ARDC Nectar VMs, Jupyter Hub and GitHub to Deploy Agricultural Modelling Applications on the AgReFed Platform
Gacenga, Francis and An-Vo, Duc-Anh. 2023. "Using ARDC Nectar VMs, Jupyter Hub and GitHub to Deploy Agricultural Modelling Applications on the AgReFed Platform." eResearch Australasia 2023 Conference. Brisbane, Australia 16 - 20 Oct 2023 Australia.
Making an Agricultural Research Dataset FAIR: A case study of the Australian Drought Monitor Dataset
Gacenga, Francis, An-Vo, Duc-Anh, Cobon, David, Young, Richard and McCulloch, Jillian. 2023. "Making an Agricultural Research Dataset FAIR: A case study of the Australian Drought Monitor Dataset." eResearch Australasia 2023 Conference. Brisbane, Australia 16 - 20 Oct 2023 Australia.
Australian Drought Monitor
Cobon, David, Gacenga, Francis, An-Vo, Duc-Anh, Pudmenzky, Christa, Nguyen-Huy, Thong, Stone, Roger, Guillory, Laura, McCulloch, J., Svoboda, M., Swigart, J. and Meat & Livestock Australia. 2022. Australian Drought Monitor. Toowoomba. https://doi.org/10.26192/dmek-v625
A Performance Measurement Framework for IT Service Management
Gacenga, Francis. A Performance Measurement Framework for IT Service Management. Springfield. https://doi.org/10.26192/jngt-yc63
Application of FAIR and CARE Principles in Research Data Management Practice
Gacenga, Francis, Chesters, Racheal, Nguyen-Huy, Thong, Adeyinka, Adewuyi Ayodele and Rose, Samantha. 2021. "Application of FAIR and CARE Principles in Research Data Management Practice." 2021 Australasian Research Management Society VirtualConference (2021 ARMS Virtual Conference Conference): Disrupting the Status Quo: Challenging the Research and Innovation Culture. Online 03 - 05 Nov 2021 Australia.
An evaluation of the effectiveness of adoption and implementation of FAIR (Findable, Accessible, Interoperable and Reusable) data management principles in research – a case study of the University of Southern Queensland
Gacenga, Francis, Chesters, Racheal, Nguyen-Huy, Thong and Rose, Samantha. 2021. "An evaluation of the effectiveness of adoption and implementation of FAIR (Findable, Accessible, Interoperable and Reusable) data management principles in research – a case study of the University of Southern Queensland." 2021 Collaborative Conference on Computational & Data Intensive Science (C3DIS). Online 06 - 08 Jul 2021 Australia.
Data, data everywhere…and yet nowhere. RDM for HDRs
Kelly, Tricia and Gacenga, Francis. 2020. "Data, data everywhere…and yet nowhere. RDM for HDRs." 2020 15th Research Data Alliance (RDA) Plenary Meeting 18 - 20 March. Online 18 - 20 Mar 2020 Online.
Navigating, negotiating and nullifying education research mazes: successful strategies for mobilising contextual, conceptual, methodological and transformational challenges and opportunities
Danaher, Patrick Alan, Rossi, Dolene and Gacenga, Francis. 2016. "Navigating, negotiating and nullifying education research mazes: successful strategies for mobilising contextual, conceptual, methodological and transformational challenges and opportunities." Rossi, Dolene, Gacenga, Francis and Danaher, Patrick Alan (ed.) Navigating the education research maze: contextual, conceptual, methodological and transformational challenges and opportunities for researchers. Cham, Switzerland. Palgrave Macmillan. pp. 1-16
Open Data, Materials and Code Introduction
Gacenga, Francis, Sparks, Adam and Del Ponte, Emerson M.. 2019. "Open Data, Materials and Code Introduction." Panczack, R., Gacenga, F., Sparks, A., King, R., Baker, P., Li, L., Schnyder, N., Lim, C. and Vickers-Jones, R. (ed.) Re:Produce Workshop - A Theo Murphy Initiative. Brisbane, Australia 10 - 11 Dec 2019 Australia. https://doi.org/10.17605/OSF.IO/XQ7C5
Alleviating design silence in design science research: a proposal of a design method
Gacenga, Francis, Cater-Steel, Aileen, Toleman, Mark and Tan, Wui-Gee. 2012. "Alleviating design silence in design science research: a proposal of a design method." McClean, Rachel (ed.) 11th European Conference on Research Methods in Business and Management. Bolton, United Kingdom 28 - 29 Jun 2012 Reading, UK.
IT service management: a cross-national study of ITIL adoption
Marrone, Mauricio, Gacenga, Francis, Cater-Steel, Aileen and Kolbe, Lutz. 2014. "IT service management: a cross-national study of ITIL adoption." Communications of the Association for Information Systems. 34 (1), pp. 865-892. https://doi.org/10.17705/1cais.03449
The HPC next door: enabling research outcomes using QCIF HPC facilities
Gacenga, Francis, Bell, Jason, Samalca, Irvin K. and Brieva, Daniel. 2014. "The HPC next door: enabling research outcomes using QCIF HPC facilities." eResearch Australasia 2014 Conference: Towards Unified Global Research. Melbourne, Australia 27 - 31 Oct 2014
Pleasant encounters of the VM kind: leveraging on NeCTAR VMs to achieve research outcomes
Gacenga, Francis, Kelly, Nick and Rayment, Erin. 2014. "Pleasant encounters of the VM kind: leveraging on NeCTAR VMs to achieve research outcomes." eResearch Australasia 2014 Conference: Towards Unified Global Research. Melbourne, Australia 27 - 31 Oct 2014 Sydney, Australia.
You don't know what you don't know: ethics and participant consent issues for eResearch users
Ostini, Jenny, Gacenga, Francis, Pocock, Celmara and Whiteside, Eliza. 2014. "You don't know what you don't know: ethics and participant consent issues for eResearch users." eResearch Australasia 2014 Conference: Towards Unified Global Research. Melbourne, Australia 27 - 31 Oct 2014 Sydney, Australia.
A proposal and evaluation of a design method in design science research
Gacenga, Francis, Cater-Steel, Aileen, Toleman, Mark and Tan, Wui-Gee. 2012. "A proposal and evaluation of a design method in design science research." Electronic Journal of Business Research Methods. 10 (2), pp. 89-100.
Extending the IT service quality measurement framework through a systematic literature review
Lepmets, Marion, Cater-Steel, Aileen, Gacenga, Francis and Ras, Eric. 2012. "Extending the IT service quality measurement framework through a systematic literature review." Journal of Service Science Research. 4 (1), pp. 7-47. https://doi.org/10.1007/s12927-012-0001-6
IT service management: towards a contingency theory of performance measurement
Gacenga, Francis, Cater-Steel, Aileen, Tan, Wui-Gee and Toleman, Mark. 2011. "IT service management: towards a contingency theory of performance measurement." 32nd International Conference on Information Systems (ICIS 2011). Shanghai, China 04 - 07 Dec 2011 Atlanta, GA. United States.
Measuring the performance of IT service management
Gacenga, Francis, Cater-Steel, Aileen and Toleman, Mark. 2011. "Measuring the performance of IT service management." Communications of Global Information Technology (COGIT). 3 (2011), pp. 13-24.
Measuring IT service management performance: a model development
Gacenga, Francis, Cater-Steel, Aileen, Toleman, Mark and Tan, Wui-Gee. 2012. "Measuring IT service management performance: a model development." Belkhamza, Zakariya and Wafa, Syed Azizi (ed.) Measuring organizational information systems success: new technologies and practices. Hershey, PA. United States. IGI Global. pp. 102-119
Measuring the performance of service orientated IT management
Gacenga, Francis, Cater-Steel, Aileen, Toleman, Mark and Tan, Wui-Gee. 2011. "Measuring the performance of service orientated IT management." Sprouts: working papers on information environments, systems and organizations. 11 (162).
Keeping score: measuring ITSM performance
Gacenga, Francis, Cater-Steel, Aileen, Toleman, Mark and Tan, Wui-Gee. 2011. "Keeping score: measuring ITSM performance." 14th National Conference of IT Service Management Forum (itSMF) Australia. Perth, Australia 17 - 19 Aug 2010 Melbourne, Australia.
Performance measurement of IT service management: a case study of an Australian university
Gacenga, Francis and Cater-Steel, Aileen. 2011. "Performance measurement of IT service management: a case study of an Australian university." Seddon, Peter and Gregor, Shirley (ed.) 15th Pacific Asia Conference on Information Systems (PACIS 2011): Quality Research in Pacific Asia. Brisbane, Australia 07 - 11 Jul 2011 Brisbane, Australia.
Towards a framework and contingency theory for performance measurement: a mixed-method approach [Research in progress]
Gacenga, Francis, Cater-Steel, Aileen and Tan, Wui-Gee. 2011. "Towards a framework and contingency theory for performance measurement: a mixed-method approach [Research in progress]." Seddon, Peter and Gregor, Shirley (ed.) 15th Pacific Asia Conference on Information Systems (PACIS 2011): Quality Research in Pacific Asia. Brisbane, Australia 07 - 11 Jul 2011 Brisbane, Australia.
An International Analysis of IT Service Management Benefits and Performance Measurement
Gacenga, Francis, Cater-Steel, Aileen and Toleman, Mark. 2010. "An International Analysis of IT Service Management Benefits and Performance Measurement ." Journal of Global Information Technology Management. 13 (4), pp. 28-63. https://doi.org/10.1080/1097198X.2010.10856525
Delivering value through IT service management metrics
Gacenga, Francis and Cater-Steel, Aileen. 2010. "Delivering value through IT service management metrics." ITSMF Bulletin: Informed Intelligence. Summer, pp. 8-9.
What's Your PMF challenge?
Gacenga, Francis and Cater-Steel, Aileen. 2010. "What's Your PMF challenge?" ITSMF Bulletin: Informed Intelligence. Winter, pp. 15-17.
Results from a survey of members of the IT Service Management Forum of Australia to measure the performance of service orientated IT management
Gacenga, Francis. 2009. Results from a survey of members of the IT Service Management Forum of Australia to measure the performance of service orientated IT management. Toowoomba. University of Southern Queensland. https://doi.org/10.26192/q37yz