Author profile picture

How will robots change the world? A frequently asked and as yet unanswered question. After all, we do not have a crystal ball. What we do know is that digitalization and automation have changed the world enormously in recent decades. At Eindhoven University of Technology (TU/e) in the Netherlands, the potential of smart machines in industry and daily life is being researched each and every day. Scientists immerse themselves in technology and student teams get to work on concrete solutions to social problems. This series will tell you about the latest robots, their background, and their future. Today, the seventh episode today: social robots.

In the Social Robotics Lab at TU/e, researchers and students are taking up the challenge: They are researching the ways to teach social skills to robots. Will robots still be distinguishable from humans in the future?

We are using robots more and more often in everyday life, for instance in the workplace or for domestic tasks. Practical and repetitive tasks can be performed very well by robots, even better than humans can. But how close do you actually get to someone when you want to ask something? And during a conversation, how long do you look at someone before you look away? These are all social skills that we don’t even think about, these things just happen automatically. For a robot, these things are difficult to determine, especially because they are not set facts or tasks.

Step for step

Emilia Barakova and Raymond Cuijpers, the founders of the Social Robotics Lab, are working on these issues each and every day. Barakova is a senior lecturer on socially intelligent systems at the Faculty of Industrial Design and Cuijpers researches cognitive robots and human-robot interactions. “We teach the robots specific skills step by step,” Barakova explains. “This always involves a great deal of research.” So it seems that in the coming years, we will not have to worry about perfect social robots that are going to lead their own lives.


“It is a world in which human psychology and robotics converge,” Cuijpers notes. Social robotics is a relatively new field of research. Where many researchers now focus on the practical and technological challenges posed by robots, Cuijpers and Barakova are looking further ahead. Because the more robots go and do things, the more important their social skills will become. For example, a lot of research is being done into robots in elderly care so that people can stay in their own homes for longer. “What struck us is that people feel less social pressure with a robot. When a person needs assistance in going to the toilet, the elderly often feel a bit uncomfortable. They don’t feel that way with a robot,” Cuijpers explains. “They need an impartial robot, a buddy, a bit like a pet. In that case, particular skills for putting someone at ease are very important.”

Body language

“The robot needs to be able to grasp both verbal and non-verbal communication,” says Barakova. Cuijpers continues: “If the robot asks how things are going, a person can say that they are doing fine. But that word in itself usually doesn’t say that much. You look at facial expressions and listen to the tone to see if someone really means it.” According to the researcher, the robot understands more of the context in which things are being said by also looking at non-verbal communication. According to him, this is important both for humanoid robots, (robots that resemble people), and for machines such as service robots. “Most robots work with people and therefore need to understand people. It is easier for robots that look like humans to communicate non-verbally, for example with facial expressions.”

Over the past few years, Barakova has been researching the use of robots in therapy for children living with autism. Recognizing non-verbal communication is very difficult for these children. The robot has learned a number of non-verbal forms of communication which it can then convey to the child. “For instance, the robot and a child can play the memory game together. The child flips over a card and the robot looks at the matching card that is still turned upside down. This teaches the child to follow the robot’s viewing direction in order to find the card,” Barakova continues. “Following the viewing direction is a social skill that people often use in everyday life. This kind of robot is also capable of supporting people with cognitive or visual impairments. “The robot is then a sort of coach that helps you to express yourself in a certain situation.”

This image has an empty alt attribute; its file name is image004.png
A robot plays a memory card game with a child.

Analyzing behavior

In order to train a robot in social behavior, Cuijpers primarily focuses on the psychology of humans. “There is a lot of literature on human behavior. For example, qualitative rules have been drawn up by psychologists with regard to making eye contact. The person who is listening looks at the other person almost the whole time, while the person who is talking occasionally stares into space,” he says. ” I’m trying to translate this into a model, as in qualitative rules, that the robot can apply. We can subsequently test this and refine it until we are satisfied with the robot’s behavior.”

Apart from that, Cuijpers states that the robot makes use of a number of basic social rules, e.g. traffic rules. “A graduate has done research into autonomous carts that drive through hospital corridors to pick up laundry. The robot uses navigation to know where to drive to. When doing that, it makes use of the basic rules, like always driving on the right-hand side. Things get interesting when there is an obstacle on the road,” he says. “In principle, the robot can then drive past on the left, provided there is no oncoming traffic. Then it has to either speed up, slow down or come to a standstill. In order to make a decision, it must also look at what the other person is doing and indicate what it intends to do. Consequently, it must be able to read and give non-verbal signals”.

Ultimately, a lot of testing is required to be able to use these types of applications. “The interaction between people, which is often explored in psychology, is different from the interaction between people and robots,” Cuijpers explains. “In addition, a model can work well with a single person in a room, but it becomes more difficult when there are several people.” These are all aspects that the researchers need to take into account.

Convince consumers

Worldwide research is being done on robots. “Asia is at the forefront of this,” says Barakova. After her Ph.D., she worked for a number of years in various Japanese laboratories where research is focused on social robotics. “Robots are much more widely accepted there, whereas people are more skeptical in the Netherlands,” she says. In order to convince people of the advantages of robots, Barakova believes that more robust applications are called for. Robots have to be able to work anytime and anywhere. “When people experience what it’s like to work with a robot and when they see what the possibilities are, they are often more open to it,” she notes. “In the near future, we will be investigating new applications and looking at how we can best incorporate robots into people’s work or daily lives.

Are you curious about the other special robots at the TU/e High Tech System Center? Read the previous episodes about Experts in Robotics them here