On the use of brain decoded signals for online user adaptive gesture recognition systems

K Förster, A Biasiucci, R Chavarriaga… - … Pervasive 2010, Helsinki …, 2010 - Springer
Pervasive Computing: 8th International Conference, Pervasive 2010, Helsinki …, 2010Springer
Activity and context recognition in pervasive and wearable computing ought to continuously
adapt to changes typical of open-ended scenarios, such as changing users, sensor
characteristics, user expectations, or user motor patterns due to learning or aging. System
performance inherently relates to the user's perception of the system behavior. Thus, the
user should be guiding the adaptation process. This should be automatic, transparent, and
unconscious. We capitalize on advances in electroencephalography (EEG) signal …
Abstract
Activity and context recognition in pervasive and wearable computing ought to continuously adapt to changes typical of open-ended scenarios, such as changing users, sensor characteristics, user expectations, or user motor patterns due to learning or aging. System performance inherently relates to the user’s perception of the system behavior. Thus, the user should be guiding the adaptation process. This should be automatic, transparent, and unconscious.
We capitalize on advances in electroencephalography (EEG) signal processing that allow for error related potentials (ErrP) recognition. ErrP are emitted when a human observes an unexpected behavior in a system. We propose and evaluate a hand gesture recognition system from wearable motion sensors that adapts online by taking advantage of ErrP. Thus the gesture recognition system becomes self-aware of its performance, and can self-improve through re-occurring detection of ErrP signals.
Results show that our adaptation technique can improve the accuracy of a user independent gesture recognition system by 13.9% when ErrP recognition is perfect. When ErrP recognition errors are factored in, recognition accuracy increases by 4.9%. We characterize the boundary conditions of ErrP recognition guaranteeing beneficial adaptation. The adaptive algorithms are applicable to other forms of activity recognition, and can also use explicit user feedback rather than ErrP.
Springer
Showing the best result for this search. See all results