University of Waterloo using AI to analyze hockey decisions on the ice

Using AI to analyze pro hockey games CTV’s Colton Wiens meets a team of researchers using artificial intelligence to get more insight into the decisions players make on the ice.

Researchers at the University of Waterloo are using artificial intelligence to analyze hockey players and better understand the decisions they make on the ice.

“Essentially, picking patterns in video,” explained John Zelek, an associate professor in UW’s department of systems design engineering. “The patterns have to be the players moving and how they're interacting.”

The researchers have partnered with Stathletes, a professional hockey performance data and analytics company in St. Catharines, Ont., to automate the process of tracking players. They use clips from the main camera view of an NHL broadcast and then apply the AI technology. Unlike more common tracking systems, the AI can analyze a player’s movement on the ice and indicate the direction they’re facing.

“To understand, not what players are doing, but what are they doing relative to each other. Then that starts feeding into strategy and outcomes,” said David Clausi, another professor in UW’s department of systems design engineering.

Stathletes started using the technology in house, but the researchers said creating the tool hasn’t been easy.

“They have this highly non-linear rapid motion. For example, shifts in ice hockey happened without any notice at all. These are really challenging, yet very ripe grounds for computer vision,” said UW masters student Harish Prakash.

The equipment used in the game also presents a challenge.

“The bloody sticks,” explained UW masters student Bavesh Balaji.

Researchers had to teach the AI to track how players are holding their stick in order to understand their technique.

“I had to do a lot of workarounds and I had to find a lot of algorithms,” Balaji said.

A challenge researcher’s face going forward is how to teach the AI to track the puck during a game.

“Its things humans take for granted in the game, like knowing where the puck is innately, is something that's very difficult to teach an algorithm to do,” Clausi explained.

In the NHL, infrared technology combines with up to 20 cameras to capture data from trackers inside the pucks and every jersey. The researchers said their technology requires less equipment and can be used across different hockey leagues. It can also be applied to other sports or even outside of athletics, like helping robots work together in the future.

“We can think about which robot is essentially helping the other properly or improperly and how can we accomplish a task more efficiently,” said Sirisha Rambhatla, an assistant professor in the department of managing science and engineering at the University of Waterloo.