We use what is known as inner speech, where we talk to ourselves, to evaluate situations and make more-informed decisions. Now, a robot has been trained to speak aloud its inner decision-making process, giving us a view of how it prioritises competing demands.
Arianna Pipitone and Antonio Chella at the University of Palermo, Italy, programmed a humanoid robot named Pepper, made by SoftBank Robotics in Japan, with software that models human cognitive processes, as well as a text-to-speech processor. This allowed Pepper to voice its decision-making process while completing a task. “With inner speech, we can better understand what the robot wants to do and what its plan is,” says Chella.
The software allowed Pepper to retrieve relevant information from its memory and find the correct way to act based on human commands.
The researchers asked Pepper to set a dinner table according to etiquette rules they had encoded into the robot. Inner speech was either enabled or disabled to see how it affected Pepper’s ability to do what was requested.
Read more: Chit-chat makes humans and robots work together better
When instructed to place a napkin on a fork with inner speech enabled, Pepper asked itself what the etiquette required and concluded that this request went against the rules it had been given. It then asked the researchers if putting the napkin on the fork was the correct action. When told it was, Pepper said, “OK, I prefer to follow your desire,” and explained how it was going to place the napkin on the fork.
When asked to do the same task without voicing the inner speech, Pepper knew this contradicted the etiquette rules so didn’t perform the task or explain why.