Intelligent sensing and data fusion in a smart environment for human activity recognition to support self-management of long-term conditions

Given the pressure on health and social care resources, there is a growing incentive to explore methods for self-management for long-term conditions. Smart environments, realised through a range of ambient integrated sensors and service robotics, could people with long-term conditions improve their quality of life. There is emerging research on intelligent data fusion to combine a range of ambient and wearable data sensors for modelling and analysing physiological and behavioural data collected over time.

This can be used to provide early warning or guidance for the patient themselves, or their healthcare professionals.

The research challenges lie in developing person-specific machine learning models, which are verifiable and robust in the face of noisy real-world sensor data that will change over time, as the person's condition changes. There is also a gap in knowledge on how best to select and integrate multiple types of sensor data, in a way that preserves the integrity of the different streams of information, while also providing a meaningful representation of the person's activity.

This research will address the challenges noted, and also explore the design of interactive systems that can incorporate user input for semantic labelling and modelling, using an active learning approach. Keeping the user in the loop can improve engagement, while offering improved reasoning and confidence in sensor selection and fusion techniques. This research will explore multi-modal user-input approaches for eliciting and integrating user input for semantic labelling, using a combination of supervised, un-supervised and self-learning techniques to address the challenges of noisy data and reliably tracking changes in long-term conditions over time.

This research will be informed by, and related to, ongoing preclinical work being conducted by members of the interdisciplinary supervisory team, exploring behavioural and physiological changes in response to pregnancy, the ageing process and age-related diseases such as stroke, diabetes and cardiovascular dysfunction.