We Need This New iPad App In Games NOW!

We Need This New iPad App In Games NOW!

The new iPad 2 has a front facing camera. ‘Big wowee’, I hear you groan. Well, what if said front facing camera to create a fully interactive, glasses-free monocular 3D display? Would that get you excited? What if the monocular 3D effect was integrated into games?

Still not convinced? You probably need to watch this incredible video.

Amazingly, this effect is not created using the iPad’s accelerometers, it actually works via a form of head tracking – similar to the famous Wii hack shown a couple of years back.

We track the head of the user with the front facing camera in order to create a glasses-free monocular 3D display. Such spatially-aware mobile display enables to improve the possibilities of interaction. It does not use the accelerometers and relies only on the front camera.

The possibilities for this technology seem endless. This app is not available for download, it’s simply a concept for now, but we’d love to see this integrated into some form of interactive gaming experience.


    • It’s not really the same thing, though. The iPad, like the 3DS, is only intended to be viewed by one person, and they know it’ll be from a fairly limited range of distances/viewing angles.

      This wouldn’t work for a TV because as soon as you get more than one person there, that’s 2 (or more) heads to track but only one screen to display the 3D effect on. So at best one person would get a cool 3D effect, the others would get a mess.

    • Oh Adam, don’t hate the player, hate the game. You will get your 3D without glasses soon enough and then you can be happy again.

      In the meantime I will enjoy my HI Def 3D in the comfort of my home for the next few years till glasses less 3d comes out… and then I will enjoy that too 🙂

      • Exactly, I’m enjoying the current 3D tech and when the next step comes along, then I’ll get that. Not sure why that makes me a chump 😀

    • The problem is, this method doesn’t give any depth to the image. It’s just changing the viewing angle. Two completely different technologies.

      When they combine the two, then I will be excited.

  • There’s a guy* on youtube who works for MS (I think?) who’s been doing this sort of thing for yeeeeeeears just using the tech behind the Wiimote (i.e. mostly IR) – it really is awesome, and I’m honestly not sure why it isn’t being done.

    *I just can’t remember his name! D:

    • That guy was Johnny Lee. These guys were inspired by his work. But yeah, instead of using any external tech they’re just using the front-facing camera to track where your head is in relation to the screen. Damn clever!

    • He was one of the leads on the Kinect team… but I think he works for Google now.

      I still don’t know why this hasn’t been implemented on Kinect yet though.

  • “We need this in games now” — there are already a couple that do this (although with the accelerometer, not camera), Labyrinth and Labyrinth 2.

  • My mind would have been blown were it not for the wii one all those years ago… but still it’s pretty nifty either way

  • You guys seem to be forgetting this stuff was already being done with the Nintendo Dsi with it’s front facing camera.

    • Tis true.

      Problem lies in that it involves an Apple product. If it’s done on/with an Apple product it somehow negates it being done before with another companies product.

  • There was a DSiWare game last year that utilised this technique, “Tales in a Box: Hidden Shapes in Perspective’. I had a lot of fun with it. The game’s downside was that you had to do a whole bunch of calibration, and it would start to fall apart if the lighting wasn’t just right, or if your environment wasn’t significantly different to the colour of your face.

    The effect is pretty neat, but it has problems. Either you or the device needs to be in motion in order to see the effect. And in its current state, it can only really work for a single person at the one time.

  • You know, this stuff’s been round for years; but the processing overhead has been huge. Someone also did it last month with Kinect:
    And there’s also the IPhone app “Holotoy” (among others) that can do the same thing. What baffles me more than the technology is why the sudden publicity… is it because it’s on an iPad? Not denying that it’s cool software, but it’s been around for a while.

  • “It’s been done before” doesn’t mean it’s not great to see it demoed on what is emerging as a major new gaming platform. And for all the ‘been done’ talk, it’s ridiculous that it isn’t being implemented! Maybe some DSi devs did a little bit with it, but seeing it on a high-resolution tablet without any special hacks changes the tech into something that really feels like you’re looking through a window into a real 3D space.

  • Although this video looks amazing, like you said “monocular 3d display” as in the only way you’ll be able to view this in person is to have one eye closed at all times… Or looking through a camera. Not an easy thing to do when you would like to play games using this effect for hours on end!

  • I want to moan like the other people who are upset when an Apple product article comes up announcing exciting ‘new’ technologies which have already been used before. You should link to the DSi videos also, to show how it is implemented in a real application, not just a “concept” created after the fact.

Show more comments

Log in to comment on this story!