The camera will pick up expressions on our face, while the microphone will detect sounds, such as laughter. The patent states that the emotion detector will also be able to differentiate between our many moods, detecting when we're sad, excited, angry or even bored. The patent explains that boredom is detected if the user is “looking away from the presentation, yawning, or talking over the presentation.”
The application isn't limited to just games either, but can also be applied to films and T.V. shows.