Revolutionizing healthcare with federated reinforcement learning: from machine learning to machine unlearning

PhD by Publication


Shaik, Thanveer Basha. 2023. Revolutionizing healthcare with federated reinforcement learning: from machine learning to machine unlearning. PhD by Publication Doctor of Philosophy. University of Southern Queensland. https://doi.org/10.26192/z6096
Title

Revolutionizing healthcare with federated reinforcement learning: from machine learning to machine unlearning

TypePhD by Publication
AuthorsShaik, Thanveer Basha
Supervisor
1. FirstProf Xiaohui Tao
2. SecondProf Raj Gururajan
3. ThirdProf Xujuan Zhou
A/Pr Niall Higgins
Institution of OriginUniversity of Southern Queensland
Qualification NameDoctor of Philosophy
Number of Pages198
Year2023
PublisherUniversity of Southern Queensland
Place of PublicationAustralia
Digital Object Identifier (DOI)https://doi.org/10.26192/z6096
Abstract

The landscape of healthcare is undergoing a transformative shift with the emergence of artificial intelligence (AI) and machine learning (ML) technologies, particularly in remote patient monitoring systems. These systems offer real-time data on patients’ health conditions, enabling healthcare professionals to make informed decisions and improve patient outcomes. This doctoral thesis presents a comprehensive investigation into the role of AI in enhancing patient monitoring systems, focusing on innovations in federated learning, reinforcement learning, and machine unlearning across various healthcare settings including remote patient monitoring, personalized activity tracking, mental health facilities, and predictive monitoring. The research outcomes reveal significant advancements in remote patient monitoring through AIpowered systems, enabling early anomaly detection and personalized care. FedStack, a novel federated learning architecture designed for personalized activity monitoring in remote patient monitoring systems, is introduced. Experimental results demonstrate its effectiveness in surpassing traditional approaches and optimizing sensor placement for activity recognition. Furthermore, multi-agent deep reinforcement learning models empower healthcare professionals to predict patient behaviors and take proactive interventions. The exploration of multimodality fusion and graph-enabled techniques demonstrates the potential of comprehensive smart healthcare systems that integrate diverse data sources and enable informed decision-making. Additionally, the thesis introduces a Graph-enabled Reinforcement Learning framework for time series forecasting, leveraging graphical neural networks to outperform traditional models in dynamic environments. The thesis also explores the emerging field of machine unlearning, investigating techniques to address privacy and security concerns. Explainable AI frameworks, such as QXAI, contribute to the reliability and interpretability of patient monitoring systems, fostering trust and collaboration between AI and human experts. FRAMU, a federated reinforcement learning framework with attention-based machine unlearning, is introduced, demonstrating its effectiveness in improving model performance and preserving privacy in dynamic data environments. QXAI, an explainable AI framework for quantitative analysis in patient monitoring, achieves state-of-the-art results in heart rate prediction and activity classification, enhancing model interpretability. While the research demonstrates promising outcomes, it acknowledges certain limitations, including data scale, explainability, and data privacy concerns. Future directions such as dynamic clustering, predictive vital sign monitoring, ensemble methods, and continued progress in machine unlearning are proposed to address these limitations and propel AI-driven patient monitoring systems further. This thesis makes significant contributions to the domain of AI-driven patient monitoring systems, paving the way for personalized, proactive, and effective healthcare delivery globally. It posits that the transformative potential of AI in healthcare is within reach, with continued research and innovation shaping the future of patient care, where AI-driven monitoring becomes an indispensable tool in enhancing patient well-being and transforming healthcare practices.

Keywordsartificial intelligence; machine unlearning; Reinforcement Learning; Federated Learning; Healthcare; Patient monitoring
Related Output
Has partRemote patient monitoring using artificial intelligence: Current state, applications, and challenges
Has partFedStack: Personalized Activity Monitoring using Stacked Federated Learning
Has partClustered FedStack: Intermediate Global Models with Bayesian Information Criterion
Has partA survey of multimodal information fusion for smart healthcare: Mapping the journey from data to wisdom
Has partFRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learning
Contains Sensitive ContentDoes not contain sensitive content
ANZSRC Field of Research 2020461103. Deep learning
460202. Autonomous agents and multiagent systems
460102. Applications in health
Public Notes

Files associated with this item cannot be displayed due to copyright restrictions.

Byline AffiliationsSchool of Mathematics, Physics and Computing
Permalink -

https://research.usq.edu.au/item/z6096/revolutionizing-healthcare-with-federated-reinforcement-learning-from-machine-learning-to-machine-unlearning

Restricted files

Published Version

  • 92
    total views
  • 1
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

Graph-Enabled Reinforcement Learning for Time Series Forecasting With Adaptive Intelligence
Shaik, Thanveer, Tao, Xiaohui, Xie, Haoran, Li, Lin, Yong, Jianming and Li, Yuefeng. 2024. "Graph-Enabled Reinforcement Learning for Time Series Forecasting With Adaptive Intelligence." IEEE Transactions on Emerging Topics in Computational Intelligence. 8 (4), pp. 2908-2918. https://doi.org/10.1109/TETCI.2024.3398024
Making sense of student feedback and engagement using artificial intelligence
Dann, Christopher, Redmond, Petrea, Fanshawe, Melissa, Brown, Alice, Getenet, Seyum, Shaik, Thanveer, Tao, Xiaohui, Galligan, Linda and Li, Yan. 2024. "Making sense of student feedback and engagement using artificial intelligence." Australasian Journal of Educational Technology. 40 (3). https://doi.org/10.14742/ajet.8903
FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learning
Shaik, Thanveer, Tao, Xiaohui, Li, Lin, Xie, Haoran, Cai, Taotao, Zhu, Xiaofeng and Li, Qing. 2024. "FRAMU: Attention-based Machine Unlearning using Federated Reinforcement Learning ." IEEE Transactions on Knowledge and Data Engineering. https://doi.org/10.1109/TKDE.2024.3382726
A survey of multimodal information fusion for smart healthcare: Mapping the journey from data to wisdom
Shaik, Thanveer, Tao, Xiaohui, Li, Lin, Xie, Haoran and Velasquez, Juan D.. 2024. "A survey of multimodal information fusion for smart healthcare: Mapping the journey from data to wisdom." Information Fusion. 102. https://doi.org/10.1016/j.inffus.2023.102040
Clustered FedStack: Intermediate Global Models with Bayesian Information Criterion
Shaik, Thanveer, Tao, Xiaohui, Li, Lin, Higgins, Niall, Gururajan, Raj, Zhou, Xujuan and Yong, Jianming. 2024. "Clustered FedStack: Intermediate Global Models with Bayesian Information Criterion." Pattern Recognition Letters. 177. https://doi.org/10.1016/j.patrec.2023.12.004
The Impact on Employability by COVID-19 Pandemic - AI Case Studies
Bandi, Venkata Bharath, Tao, Xiaohui, Shaik, Thanveer, Yong, Jianming and Zhang, Ji. 2023. "The Impact on Employability by COVID-19 Pandemic - AI Case Studies ." 24th International Conference on Web Information Systems Engineering (WISE 2023). Melbourne, Australia 25 - 27 Oct 2023 Singapore . Springer. https://doi.org/10.1007/978-981-99-7254-8_66
Designing an artificial intelligence tool to understand student engagement based on teacher's behaviours and movements in video conferencing
Verma, Navdeep, Getenet, Seyum, Dann, Christopher and Shaik, Thanveer. 2023. "Designing an artificial intelligence tool to understand student engagement based on teacher's behaviours and movements in video conferencing." Computers and Education: Artificial Intelligence. 5. https://doi.org/10.1016/j.caeai.2023.100187
Characteristics of engaging teaching videos in higher education: a systematic literature review of teachers’ behaviours and movements in video conferencing
Verma, Navdeep, Getenet, Seyum, Dann, Christopher and Shaik, Thanveer. 2023. "Characteristics of engaging teaching videos in higher education: a systematic literature review of teachers’ behaviours and movements in video conferencing." Research and Practice in Technology Enhanced Learning. 18. https://doi.org/10.58459/rptel.2023.18040
Remote patient monitoring using artificial intelligence: Current state, applications, and challenges
Shaik, Thanveer, Tao, Xiaohui, Higgins, Niall, Li, Li, Gururajan, Raj, Zhou, Xujuan and Acharya, U. Rajendra. 2023. "Remote patient monitoring using artificial intelligence: Current state, applications, and challenges." WIREs Data Mining and Knowledge Discovery. 13 (2). https://doi.org/10.1002/widm.1485
AI enabled RPM for Mental Health Facility
Shaik, Thanveer, Tao, Xiaohui, Higgins, Niall, Xie, Haoran, Gururajan, Raj and Zhou, Xujuan. 2022. "AI enabled RPM for Mental Health Facility." 1st ACM Workshop on Mobile and Wireless Sensing for Smart Healthcare (WMSSH 2022). Sydney, Australia 21 Oct 2022 New York, United States. https://doi.org/10.1145/3556551.3561191
A Review of the Trends and Challenges in Adopting Natural Language Processing Methods for Education Feedback Analysis
Shaik, Thanveer, Tao, Xiaohui, Li, Yan, Dann, Christopher, McDonald, Jacquie, Redmond, Petrea and Galligan, Linda. 2022. "A Review of the Trends and Challenges in Adopting Natural Language Processing Methods for Education Feedback Analysis." IEEE Access. 10, pp. 56720-56739. https://doi.org/10.1109/ACCESS.2022.3177752
FedStack: Personalized Activity Monitoring using Stacked Federated Learning
Shaik, Thanveer, Tao, Xiaohui, Higgins, Niall, Gururajan, Raj, Li, Yuefeng, Zhou, Xujuan and Acharya, U Rajendra. 2022. "FedStack: Personalized Activity Monitoring using Stacked Federated Learning." Knowledge-Based Systems. 257, pp. 1-14. https://doi.org/10.1016/j.knosys.2022.109929
Educational Decision Support System Adopting Sentiment Analysis on Student Feedback
Shaik, Thanveer, Tao, Xiaohui, Dann, Chris, Quadrelli, Carol, Li, Yan and O’Neill, Shirley. 2022. "Educational Decision Support System Adopting Sentiment Analysis on Student Feedback." 2022 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT). Niagara Falls, Canada 17 - 20 Nov 2022 United States. IEEE (Institute of Electrical and Electronics Engineers). https://doi.org/10.1109/WI-IAT55865.2022.00062
Remote Patient Monitoring Using Radio Frequency Identification (RFID) Technology and Machine Learning for Early Detection of Suicidal Behaviour in Mental Health Facilities
Tao, Xiaohui, Shaik, Thanveer Basha, Higgins, Niall, Gururajan, Raj and Zhou, Xujuan. 2021. "Remote Patient Monitoring Using Radio Frequency Identification (RFID) Technology and Machine Learning for Early Detection of Suicidal Behaviour in Mental Health Facilities." Sensors. 21 (3), pp. 1-20. https://doi.org/10.3390/s21030776