Video Game Faces Might Finally Start Bridging The Uncanny Valley

Video Game Faces Might Finally Start Bridging The Uncanny Valley
Gif: Ziva

Photorealistic faces in video games have been with us for a while, but they’ve still been a long way from what you’d call realistic, as while we’ve got the polygons and texturing almost perfected, facial animations remain are still stuck in the depths of the uncanny valley.

This isn’t to heap shit on animators and modellers — mimicking the nuances of human facial expressions is clearly very hard work, and teams have come a long from Goldeneye to Half-Life 2 to Yakuza — but it is what it is. Progress is still being made, though, and while we’ve all got used to accepting the fact video game characters can look kinda real until they open their mouths or try and look scared, we are going to get to the point one day where the uncanny valley is bridged, and they simply do look real.

This is one way we might get there. You’re looking at the work of VFX studio Ziva Dynamics, whose Unreal Engine-based examples here are showing off the creation of facial animation tech which is capable of some truly outstanding stuff. As an example, look at the model on the left generated from real-time capture on the right:

This real-time stuff looks fine, excellent even, but also not that much past what we’re used to at the moment. Now look what happens when you run the same model through some terabytes of reference data and pass it by some AI learning:

Gif: Ziva Gif: Ziva

Holy shit. While Ziva work across the entertainment industry, from TV to movies, this tech has the gaming industry in particular in mind, since it would allow developers to introduce a whole range of facial emotions that are difficult if not impossible to get across at the moment using just expressions.

For a slightly more technical example, here’s an industry-focused trailer from the company, which at the end shows one of the more promising side-effects of the approach being used: that it can work across ethnicities and even (fictional) species:

Comments

  • That’s really kind of terrifying. It’s like some AI studied humans and then attempted to create some visual representation that it thought we’d be familiar with but ended up with some kind of parody due to the limitations of the engine it used to generate the simulacrum…. Oh wait…

  • I can’t wait for a rushed deadline, poor implementation, suboptimal light rigging, and bad lip syncing ruin that beautiful face.

  • These are the first videogame faces I’ve seen that really DO end up in the uncanny valley. Most videogame faces are so obviously not real that there’s nothing unsettling about them.

    …from the article it sounds like Luke thinks the uncanny valley is just ‘when a face doesn’t look real,’ which is… not what it is. It’s this, where the face does look kinda real but you can tell something is wrong.

  • “…the more promising side-effects of the approach being used: that it can work across ethnicities…”

    It’s clearly their intention for that to be facilitated through their current process, rather than compatibility with peoples of different racial stocks being a byproduct.

Show more comments

Log in to comment on this story!