Will Kinect 2 Be So Accurate It Can Lip Read?

Will Kinect 2 Be So Accurate It Can Lip Read?

According to Eurogamer, sources have claimed that Microsoft is working on a new version of Kinect so accurate that it will be able to lip read, read various emotions and detect which direction the player is facing.

The original Kinect was limited in the amount of information it could send to the Xbox 360 through USB, which is part of the reason why the resolution and the frame rate was lowered. By having the new Kinect directly built into the machine itself, the potential for the device in increased multifold.

Some rumours are stating that a next generation Xbox 360 will be launched next year, others give the more realistic date of 2013. Regardless, we expect that we’ll most likely see something at E3 2012 this year.

But lip reading? That’s pie in the sky talk! That said, as the bearer of a broad Scottish accent, it may be the only way Kinect will be able to understand a single word I say!

Kinect 2 so accurate it can lip read [Eurogamer]


  • I can’t help but think that when our machines can accurately read our emotions, the first thing we’ll do is figure out how to successfully lie to it.

  • I would believe Kinect 2 COULD be accurate enough to read lips, if the hardware is designed correctly…. but it could be expensive.

  • Can the current Kinect even do what was originally advertised?
    Everyone who I know who has one just reckons its a massive hassle and its pretty much on par with waggle wear games

  • Do you mean it will be able to recognise a smile/frown or to actually lip read?

    I assume the former, because the latter really doubtful. Lip-reading isn’t one to one. It actually involves a huge amount of guess work and filling the blanks. It would require a capacity for language processing most adults don’t possess, let alone our rudimentary computing systems.

  • I doubt even if they set all the programmers at Microsoft onto lip reading they could pull it off. As for emotions, maybe roughly, maybe more advanced if they apply some real biological theory to it and have mm perfect 3d cameras but then they would be using it at a poker table, not on an xbox.

  • Lip reading? Hell no. That requires natural language processing and no computers can do that well yet, let alone handle the guesswork necessary for reading your lip movements and turning that into speech.

    I could absolutely believe finger tracking and expression reading though. I wish the Kinect was more accurate than it is, I really struggled with it not picking up the more subtle actions I was doing when I tried to play Child of Eden. Killed the game for me, felt like I was constantly fighting with the system, plus it requires an enormous amount of space to work.

  • Then we’ll have to wait over a year for an update that will let it cope with Australian pronunciation. YE GODS WHAT ARE THEY SAYING?!?!? *explodes*

  • I don’t understand why they’re saying it will be able to see which way the player is facing – maybe more accuracy and detail? The tech is good enough already to determine the direction the player’s body is facing, if not the head (although the data it provides makes it possible to estimate). Here’s hoping for at least joint orientations!
    As for lip-reading, I doubt it. Emotion detection – maybe basic facial expression detection…

  • That’s nice Microsoft, how about utilizing this new technology in a long overdue new console. Or are you just going to keep releasing 360 consoles until 2014?

Show more comments

Log in to comment on this story!