Decoding mental states from brain activity in humans

Recent advances in human neuroimaging have shown that it is possible to accurately decode a person’s conscious experience based only on non-invasive measurements of their brain activity. Such brain reading has mostly been studied in the domain of visual perception, where it helps reveal the way in which individual experiences are encoded in the human…

Real-time inference of mental states from facial expressions and upper body gestures

We present a real-time system for detecting facial action units and inferring emotional states from head and shoulder gestures and facial expressions. The dynamic system uses three levels of inference on progressively longer time scales. Firstly, facial action units and head orientation are identified from 22 feature points and Gabor filters. Secondly, Hidden Markov Models…