The patent is about a system that controls the smart automated assistant, or let’s just say, Siri. It uses a motion sensor to track a user’s movements while they speak and checks if the movements match certain words or phrases. If they do, Siri performs the related task. In other words, Siri will respond to specific gestures.
The patent application explains that Apple wants to use mouth movements to make Siri’s responses more accurate. Sometimes, voice-only systems like Siri misunderstand because of background noises or other people speaking. By teaching Siri to read lips, it could avoid these mistakes.
Apple suggests that by using motion detection, it might be possible to turn off the microphones that listen for wake words like “Siri” or “Hey, Siri.” Currently, these microphones are always active, which consumes power and processing resources even when the user is not using voice control.
The patent also explains that when a person speaks, their mouth, face, head, and neck create vibrations and movements. Motion sensors like accelerometers and gyroscopes can detect these movements. Unlike audio sensors such as microphones, these motion sensors use less power, so motion detection might save your battery, which is always welcomed.
If the motion detection is fast and effective, it will recognize when a user says “Siri.” The device should then activate the microphones in time to capture the rest of the voice command.
