Integrating RGB-thermal image sensors for non-contact automatic respiration rate monitoring

Article

Khanam, Fatema-Tuz-Zohra, Perera, Asanka G., Al-Naji, Ali, Mcintyre, Timothy D. and Chahl, Javaan. 2024. "Integrating RGB-thermal image sensors for non-contact automatic respiration rate monitoring." Journal of the Optical Society of America A: Optics, Image Science and Vision. 41 (6), pp. 1140-1151. https://doi.org/10.1364/JOSAA.520757
Article Title

Integrating RGB-thermal image sensors for non-contact automatic respiration rate monitoring

ERA Journal ID34297
Article CategoryArticle
AuthorsKhanam, Fatema-Tuz-Zohra, Perera, Asanka G., Al-Naji, Ali, Mcintyre, Timothy D. and Chahl, Javaan
Journal TitleJournal of the Optical Society of America A: Optics, Image Science and Vision
Journal Citation41 (6), pp. 1140-1151
Number of Pages12
Year2024
PublisherOptical Society of America (OSA)
Place of PublicationUnited States
ISSN1084-7529
1520-8532
Digital Object Identifier (DOI)https://doi.org/10.1364/JOSAA.520757
Web Address (URL)https://opg.optica.org/josaa/abstract.cfm?uri=josaa-41-6-1140
Abstract

Respiration rate (RR) holds significance as a human health indicator. Presently, the conventional RR monitoring system requires direct physical contact, which may cause discomfort and pain. Therefore, this paper proposes a non-contact RR monitoring system integrating RGB and thermal imaging through RGB-thermal image alignment. The proposed method employs an advanced image processing algorithm for automatic region of interest (ROI) selection. The experimental results demonstrated a close correlation and a lower error rate between measured thermal, measured RGB, and reference data. In summary, the proposed non-contact system emerges as a promising alternative to conventional contact-based approaches without the associated discomfort and pain.

Contains Sensitive ContentDoes not contain sensitive content
ANZSRC Field of Research 20204007. Control engineering, mechatronics and robotics
Public Notes

Files associated with this item cannot be displayed due to copyright restrictions.

Byline AffiliationsUniversity of South Australia
School of Engineering
Defence Science and Technology Group, Australia
Permalink -

https://research.usq.edu.au/item/z771w/integrating-rgb-thermal-image-sensors-for-non-contact-automatic-respiration-rate-monitoring

Log in to edit
  • 151
    total views
  • 0
    total downloads
  • 12
    views this month
  • 0
    downloads this month

Export as

Related outputs

Drone Imaging and Sensors for Situational Awareness in Hazardous Environments: A Systematic Review
Perera, Asanka, Rattanaamporn, Siripan, Nguyen, Andy, Ngo, Thanh Binh and Chahl, Javaan. 2025. "Drone Imaging and Sensors for Situational Awareness in Hazardous Environments: A Systematic Review." Journal of Sensor and Actuator Networks. 14 (5). https://doi.org/10.3390/jsan14050098
FlowCraft: Unveiling adversarial robustness of LiDAR scene flow estimation
Mahima, K.T., Perera, Asanka G., Anavatti, Sreenatha and Garratt, Matt. 2025. "FlowCraft: Unveiling adversarial robustness of LiDAR scene flow estimation." Pattern Recognition Letters. 191, pp. 37-43. https://doi.org/10.1016/j.patrec.2025.02.029
C2L3-Fusion: An Integrated 3D Object Detection Method for Autonomous Vehicles
Ngo, Thanh Binh, Ngo, Long, Phi, Anh Vu, Nguyen, Trung Thị Hoa Trang, Nguyen, Andy, Brown, Jason and Perera, Asanka. 2025. "C2L3-Fusion: An Integrated 3D Object Detection Method for Autonomous Vehicles." Sensors. 25 (9). https://doi.org/10.3390/s25092688
Active Sensing Strategy: Multi-Modal, Multi-Robot Source Localization and Mapping in Real-World Settings with Fixed One-Way Switching
Tran, Vu Ph, Perera, Asanka G., Garratt, Matthew A., Kasmarik, Kathryn and Anavatti, Sreenatha G.. 2025. "Active Sensing Strategy: Multi-Modal, Multi-Robot Source Localization and Mapping in Real-World Settings with Fixed One-Way Switching." Journal of Field Robotics. 42 (4), pp. 1166-1190. https://doi.org/10.1002/rob.22441
3DR-DIFF: Blind Diffusion Inpainting for 3D Point Cloud Reconstruction and Segmentation
Mahima, K. T. Yasas, Perera, Asanka G., Anavatti, Sreenatha and Garratt, Matt. 2024. "3DR-DIFF: Blind Diffusion Inpainting for 3D Point Cloud Reconstruction and Segmentation." 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Abu Dhabi, United Arab Emirates 14 - 18 Oct 2024 United Arab Emirates. IEEE (Institute of Electrical and Electronics Engineers). https://doi.org/10.1109/IROS58592.2024.10802338
A Deep Learning Biomimetic Milky Way Compass
Tao, Yiting, Lucas, Michael, Perera, Asanka, Teague, Samuel, Mcintyre, Timothy, Ogunwa, Titilayo, Warrant, Eric and Chahl, Javaan. 2024. "A Deep Learning Biomimetic Milky Way Compass." Biomimetics. 9 (10). https://doi.org/10.3390/biomimetics9100620
A Comprehensive Review of UAV-UGV Collaboration: Advancements and Challenges
Munasinghe, Isuru, Perera, Asanka and Deo, Ravinesh C.. 2024. "A Comprehensive Review of UAV-UGV Collaboration: Advancements and Challenges." Journal of Sensor and Actuator Networks. 13 (6). https://doi.org/10.3390/jsan13060081
Toward Robust 3D Perception for Autonomous Vehicles: A Review of Adversarial Attacks and Countermeasures
Yasas, K. T., Perera, Asanka G., Anavatti, Sreenatha and Garratt, Matt. 2024. "Toward Robust 3D Perception for Autonomous Vehicles: A Review of Adversarial Attacks and Countermeasures." IEEE Transactions on Intelligent Transportation Systems. 25 (12), pp. 19176-19202. https://doi.org/10.1109/TITS.2024.3456293
The Effects of Different Image Parameters on Human Action Recognition Models Trained on Real and Synthetic Image Data
Man, Keith, Chahl, Javaan, Mayer, Wolfgang and Perera, Asanka. 2024. "The Effects of Different Image Parameters on Human Action Recognition Models Trained on Real and Synthetic Image Data." IEEE Access. 12, pp. 95223-95244.
Intelligent Control System for Ground Vehicles
Tungthamrongkul, Yok, Perera, Asanka, Islam, Rafiqul and Anavatti, Sreenatha. 2024. "Intelligent Control System for Ground Vehicles." 2024 10th International Conference on Mechatronics and Robotics Engineering (ICMRE). Milan, Italy 27 2024 - 29 Feb 5224 Italy.
Computer Vision Techniques Demonstrate Robust Orientation Measurement of the Milky Way Despite Image Motion
Tao, Yiting, Perera, Asanka, Teague, Samuel, Mcintyre, Timothy, Warrant, Eric and Chahl, Javaan. 2024. "Computer Vision Techniques Demonstrate Robust Orientation Measurement of the Milky Way Despite Image Motion." Biomimetics. 9 (7). https://doi.org/10.3390/biomimetics9070375
Non-invasive and non-contact automatic jaundice detection of infants based on random forest
Khanam, Fatema-Tuz-Zohra, Al-Naj, Ali, Perera, Asanka G., Wang, Danyi and Chahl, Javaan. 2023. "Non-invasive and non-contact automatic jaundice detection of infants based on random forest." Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization. 11 (6), pp. 2516-2529. https://doi.org/10.1080/21681163.2023.2244601
Radio Source Localization using Sparse Signal Measurements from Uncrewed Ground Vehicles
Perera, Asanka, Tran, Vu Phi, Anavatti, Sreenatha, Kasmarik, Kathryn and Garratt, Matthew A.. 2023. "Radio Source Localization using Sparse Signal Measurements from Uncrewed Ground Vehicles." 2023 Australasian Conference on Robotics and Automation (ACRA 2023). Sydney, Australia 04 - 06 Dec 2023 Australia.
Exploring Adversarial Robustness of LiDAR Semantic Segmentation in Autonomous Driving
Mahima, K. T. Yasas, Perera, Asanka, Anavatti, Sreenatha and Garratt, Matt. 2023. "Exploring Adversarial Robustness of LiDAR Semantic Segmentation in Autonomous Driving." Sensors. 23 (23). https://doi.org/10.3390/s23239579
A Computer Vision Milky Way Compass
Tao, Yiting, Lucas, Michael, Perera, Asanka, Teague, Samuel, Warrant, Eric and Chahl, Javaan. 2023. "A Computer Vision Milky Way Compass." Applied Sciences. 13 (10). https://doi.org/10.3390/app13106062
Neural network‐based optical flow versus traditional optical flow techniques with thermal aerial imaging in real‐world settings
Nguyen, Tran Xuan Bach, Rosser, Kent, Perera, Asanka, Moss, Philip and Chahl, Javaan. 2023. "Neural network‐based optical flow versus traditional optical flow techniques with thermal aerial imaging in real‐world settings." Journal of Field Robotics. 40 (7), pp. 1817-1839. https://doi.org/10.1002/rob.22219
Coverage Path Planning With Budget Constraints for Multiple Unmanned Ground Vehicles
Tran, Vu Phi, Perera, Asanka, Garrat, Matthew A., Kasmarik, Kathryn and Anavatti, Sreenatha G.. 2023. "Coverage Path Planning With Budget Constraints for Multiple Unmanned Ground Vehicles." IEEE Transactions on Intelligent Transportation Systems. 24 (11), pp. 12506-12522. https://doi.org/10.1109/TITS.2023.3285624
Remote Vital Signs Monitoring in Neonatal Intensive Care Unit Using a Digital Camera
Khanam, Fatema-Tuz-Zohra, Al-Naji, Ali, Perera, Asanka G., Gibson, Kim and Chahl, Javaan. 2022. "Remote Vital Signs Monitoring in Neonatal Intensive Care Unit Using a Digital Camera." International Journal of Biomedical and Biological Engineering. 16 (10), pp. 138-144.
Road Severity Distance Calculation Technique using Deep Learning Predictions in 3-D Space
Perera, Asanka G. and Verma, Brijesh. 2022. "Road Severity Distance Calculation Technique using Deep Learning Predictions in 3-D Space." IEEE Access. 10, pp. 68000-68008. https://doi.org/10.1109/ACCESS.2022.3185997
Non-contact automatic vital signs monitoring of neonates in NICU using video camera imaging
Khanam, Fatema-Tuz-Zohra, Al-Naji, Ali, Perera, Asanka G., Gibson, Kim and Chahl, Javaan. 2022. "Non-contact automatic vital signs monitoring of neonates in NICU using video camera imaging." Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization. 11 (2), pp. 278-285. https://doi.org/10.1080/21681163.2022.2069598
Characteristics of optical flow from aerial thermal imaging,“thermal flow”
Nguyen, Tran Xuan Bach, Rosser, Kent, Perera, Asanka, Moss, Philip, Teague, Sam and Chahl, Javaan. 2022. "Characteristics of optical flow from aerial thermal imaging,“thermal flow”." Journal of Field Robotics. 39 (5), pp. 580-599. https://doi.org/10.1002/rob.22065
Noncontact Sensing of Contagion
Khanam, Fatema-Tuz-Zohra, Chahl, Loris A., Chahl, Jaswant S., Al-Naji, Ali, Perera, Asanka G., Wang, Danyi, Lee, Y.H., Ogunwa, Titilayo T., Teague, Samuel, Nguyen, Tran Xuan Bach, Mcintyre, Timothy D., Pegoli, Simon P., Tao, Yiting, McGuire, John L., Huynh, Jasmine and Chahl, Javaan. 2021. "Noncontact Sensing of Contagion." Journal of Imaging. 7 (2). https://doi.org/10.3390/jimaging7020028
Non-Contact Automatic Vital Signs Monitoring of Infants in a Neonatal Intensive Care Unit Based on Neural Networks
Khanam, Fatema-Tuz-Zohra, Perera, Asanka G., Al-Naji, Ali, Gibson, Kim and Chahl, Javaan. 2021. "Non-Contact Automatic Vital Signs Monitoring of Infants in a Neonatal Intensive Care Unit Based on Neural Networks." Journal of Imaging. 7 (8). https://doi.org/10.3390/jimaging7080122
Drones—healthcare, humanitarian efforts and recreational use
Tarr, Anthony A., Perera, Asanka G., Chahl, Javaan, Chell, Cameron, Ogunwa, Titilayo and Paynter, Kirsty. 2021. "Drones—healthcare, humanitarian efforts and recreational use." Tarr, Anthony A., Tarr, Julie-Anne, Thompson, Maurice and Ellis, Jeffrey (ed.) Drone Law and Policy: Global Development, Risks, Regulation and Insurance. United Kingdom. Routledge. pp. 35-54
A Low Redundancy Wavelet Entropy Edge Detection Algorithm
Tao, Yiting, Scully, Thomas, Perera, Asanka G., Lambert, Andrew and Chahl, Javaan. 2021. "A Low Redundancy Wavelet Entropy Edge Detection Algorithm." Journal of Imaging. 7 (9). https://doi.org/10.3390/jimaging7090188
Detection and Localisation of Life Signs from the Air Using Image Registration and Spatio-Temporal Filtering
Perera, Asanka G, Khanam, Fatema-Tuz-Zohra, Al-Naji, Ali and Chahl, Javaan. 2020. "Detection and Localisation of Life Signs from the Air Using Image Registration and Spatio-Temporal Filtering." Remote Sensing. 12 (3). https://doi.org/10.3390/rs12030577
A multiviewpoint outdoor dataset for human action recognition
Perera, Asanka G., Law, Yee Wei, Ogunwa, Titilayo T and Chahl, Javaan. 2020. "A multiviewpoint outdoor dataset for human action recognition." IEEE Transactions on Human-Machine Systems. 50 (5), pp. 405-413. https://doi.org/10.1109/THMS.2020.2971958
UAV-GESTURE: A Dataset for UAV Control and Gesture Recognition
Perera, Asanka G., Law, Yee Wei and Chahl, Javaan. 2019. "UAV-GESTURE: A Dataset for UAV Control and Gesture Recognition." UAVision workshop, ECCV 2018. Germany. Springer. https://doi.org/10.1007/978-3-030-11012-3_9
The sixth visual object tracking vot2018 challenge results
Kristan, Matej, Leonardis, Ales, Matas, Jiří, Felsberg, Michael, Pflugfelder, Roman, Zajc, Luka Čehovin, Vojír̃, Tomáš, Bhat, Goutam, Lukežič, Alan, Eldesokey, Abdelrahman, Fernández, Gustavo, García-Martín, Álvaro, Iglesias-Arias, Álvaro, Alatan, A. Aydin, González-García, Abel, Petrosino, Alfredo, Memarmoghadam, Alireza, Vedaldi, Andrea, Muhič, Andrej, ..., He, Zhiqun. 2019. "The sixth visual object tracking vot2018 challenge results." European Conference on Computer Vision 2018 Workshops. Munich, Germany 09 - 14 Sep 2018 Germany. Springer. https://doi.org/10.1007/978-3-030-11009-3_1
Visdrone-sot2018: The vision meets drone single-object tracking challenge results
Wen, Longyin, Zhu, Pengfei, Du, Dawei, Bian, Xiao, Ling, Haibin, Hu, Qinghua, Liu, Chenfeng, Cheng, Hao, Liu, Xiaoyu, Ma, Wenya, Nie, Qinqin, Wu, Haotian, Wang, Lianjie, Perera, Asanka G., Zhang, Baochang, Heo, Byeongho, Liu, Chunlei, Li, Dongdong, Michail, Emmanouil, ..., He, Zhiqun. 2019. "Visdrone-sot2018: The vision meets drone single-object tracking challenge results." European Conference on Computer Vision 2018 Workshops. Munich, Germany 09 - 14 Sep 2018 Germany. Springer. https://doi.org/10.1007/978-3-030-11021-5_28
Cross-correlation-based robust object tracking in aerial videos
Perera, Asanka G, Law, Yee Wei and Chahl, Javaan. 2019. "Cross-correlation-based robust object tracking in aerial videos." 18th Australian International Aerospace Congress (AIAC18). Melbourne, Australia 24 - 26 Feb 2019 Australia .
Life Signs Detector Using a Drone in Disaster Zones
Al-Naji, Ali, Perera, Asanka G., Mohammed, Saleem Latteef and Chahl, Javaan. 2019. "Life Signs Detector Using a Drone in Disaster Zones." Remote Sensing. 11 (20). https://doi.org/10.3390/rs11202441
Drone-Action: An Outdoor Recorded Drone Video Dataset for Action Recognition
Perera, Asanka G., Law, Yee Wei and Chahl, Javaan. 2019. "Drone-Action: An Outdoor Recorded Drone Video Dataset for Action Recognition." Drones. 3 (4). https://doi.org/10.3390/drones3040082
Human motion analysis from UAV video
Perera, Asanka G., Law, Yee We, Al-Naji, Ali and Chahl, Javaan. 2018. "Human motion analysis from UAV video." International Journal of Intelligent Unmanned Systems. 6 (2), pp. 69-92. https://doi.org/10.1108/IJIUS-10-2017-0012
Human detection and motion analysis from a quadrotor UAV
Perera, Asanka G., Al-Naji, Ali, Law, Al-Naji, Ali and Chahl, Javaan. 2018. "Human detection and motion analysis from a quadrotor UAV." AEROTECH VII - Sustainability in Aerospace Engineering and Technology. Putrajaya, Malaysia 07 - 08 Aug 2018 United Kingdom. IOP Publishing. https://doi.org/10.1088/1757-899X/405/1/012003
Remote measurement of cardiopulmonary signal using an unmanned aerial vehicle
Al-Naji, Ali, Perera, Asanka G. and Chahl, Javaan. 2018. "Remote measurement of cardiopulmonary signal using an unmanned aerial vehicle ." AEROTECH VII - Sustainability in Aerospace Engineering and Technology. Putrajaya, Malaysia 07 - 08 Aug 2018 United Kingdom. IOP Publishing. https://doi.org/10.1088/1757-899X/405/1/012001
Human pose and path estimation from aerial video using dynamic classifier selection
Perera, Asanka G., Law, Yee Wei and Chahl, Javaan. 2018. "Human pose and path estimation from aerial video using dynamic classifier selection." Cognitive Computation. 10 (6), pp. 1019-1041. https://doi.org/10.1007/s12559-018-9577-6
Remote monitoring of cardiorespiratory signals from a hovering unmanned aerial vehicle
Al-Naji, Ali, Perera, Asanka G. and Chahl, Javaan. 2017. "Remote monitoring of cardiorespiratory signals from a hovering unmanned aerial vehicle." BioMedical Engineering OnLine. 16. https://doi.org/10.1186/s12938-017-0395-y