Researchers advance artificial intelligence for player goal prediction in gaming

"We developed this software for use in educational gaming, but it has applications for all video game developers," says Dr. James Lester, a professor of computer science at NC State and senior author of a paper on the work. "This is a key step in developing player-adaptive games that can respond to player actions to improve the gaming experience, either for entertainment or -- in our case -- for education."

The researchers used "deep learning" to develop the AI software. Deep learning describes a family of machine learning techniques that can extrapolate patterns from large collections of data and make predictions. Deep learning has been actively investigated in various research domains such as computer vision and natural language processing in both academia and industry.

In this case, the large collection of data is the sum total of actions that players have made in a game. The predictive AI software can then draw on all of that data to determine what an individual player is trying to accomplish, based on his or her actions at any given point in the game. And the software is capable of improving its accuracy over time, because the more data the AI program has, the more accurate it becomes.

"At some point that improvement will level off, but we haven't reached that point yet," Lester says.

To test the AI program, the researchers turned to an educational game called "Crystal Island," which they developed years earlier. While testing Crystal Island, the researchers amassed logs of player behavior (tracking every action a player took in the game) for 137 different players. The researchers were able to test the predictive AI software against the Crystal Island player logs to determine its accuracy in goal recognition. In other words, they could tell the AI everything a player had done in Crystal Island up to a certain point and see what goal the AI thought the player was trying to accomplish. By checking the AI's response against the player log, the researchers could tell whether the AI was correct.

"For games, the current state-of-the-art AI program for goal recognition has an accuracy rate of 48.4 percent," says Wookhee Min, a Ph.D. student at NC State and lead author of the paper. "The accuracy rate for our new program is 62.3 percent. That's a big jump."

The paper, "Deep Learning-Based Goal Recognition in Open-Ended Digital Games," will be presented at the Tenth Annual Conference on Artificial Intelligence and Interactive Digital Entertainment, being held Oct. 5-7 in Raleigh, North Carolina. The research was supported by the National Science Foundation under grants IIS-1138497 and IIS-1344803.