Opportunistic and context-aware affect sensing on smartphones: the concept, challenges and opportunities
Article
Article Title | Opportunistic and context-aware affect sensing on smartphones: the concept, challenges and opportunities |
---|---|
ERA Journal ID | 4434 |
Article Category | Article |
Authors | Rana, Rajib (Author), Hume, Margee (Author), Reilly, John (Author), Jurdak, Raja (Author) and Soar, Jeffrey (Author) |
Journal Title | IEEE Pervasive Computing |
Journal Citation | 15 (2), pp. 60-69 |
Number of Pages | 10 |
Year | 2016 |
Place of Publication | United States |
ISSN | 1536-1268 |
1558-2590 | |
Digital Object Identifier (DOI) | https://doi.org/10.1109/MPRV.2016.36 |
Web Address (URL) | http://ieeexplore.ieee.org/document/7445775/ |
Abstract | Opportunistic affect sensing offers unprecedented potential for capturing spontaneous affect, eliminating biases inherent in the controlled setting. Facial expression and voice are two major affective displays, but most affect sensing systems on smartphones avoid them due to extensive power requirements. Encouragingly, due to the recent advent of low-power DSP coprocessor and GPU technology, audio and video sensing are becoming more feasible on smartphones. To utilize opportunistically captured facial expressions and voice, gathering contextual information about the dynamic audiovisual stimuli is also important. This article discusses recent advances in affect sensing on smartphones and identifies the key barriers and potential solutions for implementing opportunistic and context-aware affect sensing on smartphone platforms. In addition to exploring the technical challenges (privacy, battery life, and robust algorithms), the authors also consider the challenges of recruiting and retaining mental health patients. Experimentation with mental health patients is difficult but crucial to showcase the importance and effectiveness of smartphone-centered affect sensing technology. |
Keywords | DSP coprocessor; GPU; healthcare; mental health; mobile; opportunistic affect sensing; pervasive computing; smartphone |
ANZSRC Field of Research 2020 | 460212. Speech recognition |
460299. Artificial intelligence not elsewhere classified | |
461199. Machine learning not elsewhere classified | |
Public Notes | © 2016 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
Byline Affiliations | Centre for Health Sciences Research |
Central Queensland University | |
Department of Health, Queensland | |
Commonwealth Scientific and Industrial Research Organisation (CSIRO), Australia | |
School of Management and Enterprise | |
Institution of Origin | University of Southern Queensland |
https://research.usq.edu.au/item/q35v2/opportunistic-and-context-aware-affect-sensing-on-smartphones-the-concept-challenges-and-opportunities
1831
total views16
total downloads1
views this month0
downloads this month