As an actress, producer, director and theatre arts lecturer at The University of Texas at Arlington, Julienne Greer knows the techniques that help draw people’s deepest emotions to the surface. Now, she’s building on her experience and research to help scientists and robotics engineers better understand the human experience so that they can build more responsive robots.
Greer, who holds a master’s degree in media arts and a doctorate in humanities, recently authored the paper, “Building emotional authenticity between humans and robots.” In it, she referenced a robot named ‘Pepper,’ which has been widely hailed as an emotionally responsive humanoid robot that understands feelings, and is meant solely to emotionally interact with people.
When Pepper was unveiled in Japan in June 2014, SoftBank CEO Masayoshi Son said that his company’s aim was to “develop affectionate robots that can make people smile.” In her paper, Greer noted in response that when humans make certain gestures, such as a smile, it could mean that they are “happy.” It could also mean that they are “angry,” but smiling in order to make themselves less aggressive in tense situations.
Scholars intrigued by Greer’s work, invited her to present her paper at the Sixth International Conference on Social Robotics held in Sydney, Australia last month. They also requested that she lead attendees in a session on enhancing the relationship between human beings and emotional robots.
“Most people only think of engineers and scientists when it comes to robots, which I truly believe will one day be a part of our normal, day-to-day lives,” Greer said. “With that in mind, don’t we want the people who design this technology to also consider how human beings express feelings and interact with one another in addition to considering how a robot should be wired?”
SoftBank robot Pepper is expected to sell at U.S. stores by summer 2015.
Greer’s expertise is in the performance technique method acting, so she led the workshop attendees through several brief method exercises. One exercise consisted of verbally guiding the participants through the re-creation of drinking a beverage through the engagement with and discovery of individuals’ sensory responses.
“Although it seems simple, it is a rather complex undertaking as it involves shuttling their attention between all of their senses—sight, hearing, taste, smell, touch, as well as an inner kinesthetic sense of the muscles used in swallowing,” Greer said. “By utilizing all of the senses, I improve the chance the subject will have at least one significant sensory experience.”
During the question and answer session afterwards, many of the participants spoke about their experiences. One learned their strongest sensory response of the re-creation of the beverage was the weight of the liquid in the glass and how the balance of the glass was altered as the liquid swirled within it.
“The fascinating aspect of sensory work is how it opens the imagination to the cognitive work our senses do all day, every day to connect us to our world. The subject becomes aware of new sensory stimuli, which in turn creates an emotional response.“ Greer said this is significant. The categorization of behaviors or gestures and an understanding of how they create specific emotions in humans will allow the engineers and roboticists to apply those gestures and behavior to the programming of robots.
Giuseppe Boccignone, a keynote speaker at the conference and computer science associate professor at the University of Milan, Italy, remarked after attending Greer’s presentation: “It is not in the algorithms and models, per se, that lies the creation of an actual relationship between humans and social robots, but in the measure of how algorithms and models serve the purpose of building connection and authenticity. “
Beth Wright, dean of the UT Arlington College of Liberal Arts, said that Greer’s research demonstrates the many opportunities for the arts and sciences to work together.
“Nationwide we are seeing exciting examples when STEM (science, technology, engineering and math) becomes STEAM (science, technology, engineering, art and math),” Wright said. “This type of relationship presents unlimited opportunities for innovation and real world problem-solving across university disciplines. Such collaborations can unite faculty and students with a common desire to learn, share and explore as disciplines become more integrated.”
The plan now is for Greer to develop a data-capturing test that would among other things, find out the response of humans to robots confronting a variety of circumstances.
“Performance, connection and authenticity are the gold standard that should be hoped for in the creation of the relationship between humans and robots,” Greer said. “We can attain these goals through the specific application of understanding human behavior, gesture, shape and relationships. We must be specific in programming robots to respond to, and to eventually to learn from, the human relationships they will be a part of.”
Greer’s current studies stem from her research into the emotive connection between humans and their video game counterparts. Her 2011 paper, “Digital Companions: Analyzing the emotive connection between players and non-player character companions in video game space,” was published by Inter-Disciplinary.Net, a global network of people, projects and events.
About The University of Texas at Arlington
The University of Texas at Arlington is a comprehensive research institution of more than 40,000 students in Texas and around the world and is the second largest institution in The University of Texas System. The Chronicle of Higher Education ranked UT Arlington as the seventh fastest-growing public research university in 2013. U.S. News & World Report ranks UT Arlington fifth in the nation for undergraduate diversity. Visit www.uta.edu to learn more. Follow #UTAdna on Twitter.