Final Fantasy 7 Remake Uses AI To Manipulate Facial Expressions By Detecting Emotions

Square Enix spent over a decade working on Final Fantasy 7 Remake but the passionate project was not the only thing eating away precious resources. The developer was also building an advanced piece of technology alongside for one specific purpose — to make the in-game characters look as lifelike as possible.

Speaking with Edge for the latest issue, co-director Naoki Hamaguchi explained how artificial intelligence (AI) decides what expressions each character has to make during conversations. The program detects emotions from every line of dialogue delivered in Final Fantasy 7 Remake and manipulates faces accordingly.

You can generally tell the emotional content of any piece of dialogue from the intonation and patterns, if you look at it on a graph and at how the levels of tension go up and down.

So we took a number of samples from various different voice data, downloaded them into a database, and then looked for the patterns to create a system where we could get a very high level of recognition on the actual emotional content of any piece of dialogue.

Hamaguchi confirmed that the same AI also does the job of lip-syncing and can even calculate the optimal angle (and distance) from characters speaking in a scene to automatically move the camera to that spot. The technology was being built “pretty much throughout the entire development cycle” and hence, is as old as Final Fantasy 7 Remake itself.

In another interview, Hamaguchi explained the reason why Final Fantasy 7 Remake weighs over 100 GB. Square Enix basically decided against the recycling of assets and hence, built each location with new and unique assets. That means regardless of where players venture in Midgar, they will almost never see assets from other different areas. Furthermore, the assets cover more than just textures and terrains. Square Enix even decided to go for specially designed assets like background music and characters per location — all for the sake of providing a “unique gameplay experience” no matter where players choose to explore.

Final Fantasy 7 Remake will release exclusively for PlayStation 4 on April 10, 2020. The exclusivity will be timed and will last for a whole year. Heads up though, since the coronavirus outbreak forced Square Enix to allow retailers to release physical copies earlier than the street date. Hence, the game is already out in certain territories like Australia and Europe.