Socially Sensitive AI Software Coaches Call-Center Workers

Next time you call customer support, the person on the other end of the line may be getting a little help from emotionally intelligent AI software.

Some call-center workers are now receiving real-time coaching from software that analyzes their speech and the nature of their dialogue interactions with customers. As they are talking to someone the software might recommend that they talk more slowly or interrupt less often, or warn that the person on the other end of the line seems upset.

This gives us a fascinating glimpse of how AI and humans might increasingly work together in the future. Plenty of routine work is becoming automated in call centers and other back office settings, but real human interaction seems likely to resist automation for a long while yet. Even so, AI software may change the way people interact with customers by serving in an advisory capacity.

The call-center software is supplied by Cogito, a company based in Boston. Its software automatically assesses the dynamics of a conversation, and has been trained to recognize certain pertinent characteristics. Rather than the substance of a conversation, it analyzes the raw audio. “Conversation is like a dance,” says Josh Feast, CEO of Cogito. “You can tell whether people are in sync, and it turns out this is a much better measure than language.”

Call centers have long sought to analyze customers’ voices for signs of agitation or frustration. Software is getting much better at analyzing social interactions and emotions thanks to clever new machine-learning techniques and copious amounts of training data.

Feast says his company has found that call centers do not want to replace phone workers, but they are keen to improve the way they operate. “Humans are social beings,” he says. “We engage with each other for emotional reasons, and we want somebody to help us, to counsel us.”

Feast founded Cogito, in 2007, with Sandy Pentland, a professor in the MIT Media Lab who specializes in studying human dynamics. The company originally developed its technology with funding from DARPA as a way to…