Italy

While Wizard-of-Oz (WOz) techniques are frequently used to supplement a machine&#39;s abilities, extending this approach to human entities can increase experimental control in studies comparing evaluations of humans and machines in the same role. This article describes the design, implementation, and use of a WOz system for facilitating controlled verbal interactions between children and robot or human interviewers. A collaborative interface allows multiple remote wizards to combine participant responses with interaction-specific goals in order to direct a robot or human interviewer&#39;s behavior in a consistent manner. While robot interviewers are controlled directly, human interviewers receive direction through a tablet device or via a projection system concealed from participants. In addition to the system&#39;s technical design, we describe the division of responsibilities between wizards and insights from using the system across three extensive interview studies to facilitate a total of 217 interactions with children.

IEEE RO-MAN 2022

Multi-perspective human robot interaction through an augmented video interface supported by deep learning

**31st IEEE International Conference on Robot & Human Interactive Communication**
 This conference is a leading forum where state-of-the-art innovative results, the latest developments as well as future perspectives relating to robot and human interactive communication are presented and discussed.
 
 The conference covers a wide range of topics related to Robot and Human Interactive Communication, involving theories, methodologies, technologies, empirical and experimental studies. Papers related to the study of robotic technology, psychology, cognitive science, artificial intelligence, human factors, ethics and policies, interaction-based robot design and other topics related to human-robot interaction are welcome.
 
 **CONFERENCE THEME:**
 Social, asocial, and antisocial robots
 
 Robots are starting to populate our lives: at work, in our homes, hotels, shops. However, not everybody is comfortable with robots finding a place in society. For example, people may be afraid that robots will replace humans in their jobs. This belief is exacerbated by the media that, on one side, raise expectations of robots’ capabilities, while amplifying fears and worries on the other side.
 
 In the next years, due to the increasing request for interaction with people in social environments, academic research and market analyses predict that robots will become more and more “social”. But, at the same time, robots may incur the risk of being perceived as “asocial” as their pervasiveness in everyday environments may become an obstacle to social interaction between humans. Or they may even be rejected as “antisocial” if researchers do not take care to develop robots that behave according to the customs and habits of the communities where they are expected to operate.
 
 To prevent this from happening, robotic researchers can no longer take the luxury of being mere technicians. They must be capable of addressing all the challenges raised by future robot-populated communities in a multidisciplinary way. They need to share their knowledge with the public to make people aware of what robots really are, what expectations we can have from them, the risks we may incur, and the possible mitigation plans.
 
 While being open to any kind of contribution related to Human-Robot Interactive Communication, the RO-MAN 2022 conference will emphasize these aspects of robotic research. How can we create robots capable of being welcomed as our assistants and companions in society while, at the same time, not being perceived as “asocial” or “antisocial?” How can we create robots perceived as facilitators of the natural development of human beings and communities, rather than obstacles?
 
 Contributions from different disciplines, not exclusively related to technological development, will be welcomed as crucial to pave the way to global acceptance of future robots with an informed attitude.
 
 [![](https://assets.underline.io/uploads/markdown_image/1/image/af259abe105b3791c498ae1552d75710.png)](https://drive.google.com/file/d/18w73BZPB_JVOgcrcdZDqYpEupwVt4CnU/view?usp=sharing)

A registration is required to access this event page. If you have not already done so, please use the below link to register for the event. 

[Register Here](http://www.smile.unina.it/ro-man2022/welcome-to-ieee-ro-man-2022/)

Registration Is Required

31st IEEE International Conference on Robot & Human Interactive Communication
This conference is a leading forum where state-of-the-art innovative results, the latest developments as well as future perspectives relating to robot and human interactive communication are presented and discussed.

While Wizard-of-Oz (WOz) techniques are frequently used to supplement a machine's abilities, extending this approach to human entities can increase experimental control in studies comparing evaluations of humans and machines in the same role. This article describes the design, implementation, and use of a WOz system for facilitating controlled verbal interactions between children and robot or human interviewers. A collaborative interface allows multiple remote wizards to combine participant responses with interaction-specific goals in order to direct a robot or human interviewer's behavior in a consistent manner. While robot interviewers are controlled directly, human interviewers receive direction through a tablet device or via a projection system concealed from participants. In addition to the system's technical design, we describe the division of responsibilities between wizards and insights from using the system across three extensive interview studies to facilitate a total of 217 interactions with children.

technical paper

As the world surpasses a billion cameras [1] and
their coverage of the public and private spaces increases, the
possibility of using their visual feed to not just observe, but
to command robots through their video becomes an ever more
interesting prospect. Our work deals with multi-perspective interaction, where a robot autonomously maps image pixels from
reachable cameras to positions on its global coordinate space.
This enables an operator to send the robot to specific positions
in the camera with no manual calibration. Furthermore, robot
information, such as planned paths, can be used to augment all
affected camera images with an overlayed projection of their
visual information. The robustness of this approach has been
validated in both simulated and real world experiments.


From Message to Expression: Exploring Non-Verbal Communication for Appearance-Constrained Robots

Augmented Reality (AR) provides a method to superimpose
real-time information on the physical world. AR is
well-suited for complex robotic systems to help users
understand robot behavior, status, and intent. This paper
presents an AR system, Augmented Robot Environment (AugRE),
that combines ROS-based robotic systems with Microsoft
HoloLens 2 AR headsets to form a scalable multi-agent
human-robot teaming system for indoor and outdoor
exploration. The system allows multiple users to
simultaneously localize, supervise, and receive labeled
images from robotic clients. An overview of AugRE and
details of the novel system architecture that allows for
large-scale human-robot teaming is presented below. Studies
showcasing system performance with multiple robotic clients
are presented. Results show that AugRE can scale to 50
robotic clients with minimal performance degradation, due
in part to key components that leverage a recent
advancement in robotic client-to-client communication
called Robofleet. Finally we discuss new capabilities
enabled by AugRE

Visualizing Robot Intent for Object Handovers with Augmented Reality

The development of artificial intelligence has led to significant progress in activity detection; however, a proper evaluation of the activity detection performance is not guaranteed and is still lacking in real-life environments. In this study, to verify the stability and usefulness of activity detection in a real-world setting, we analyzed the activity detection performance for 40 elderly people using a human care robot.

Knowing Where to Look: A Planning-based Architecture to Automate the Gaze Behavior of Social Robots

Learning in universities challenges students to engage in self-directed learning, which requires a high degree of self-motivation while individual support by teachers is limited. Research on social robots has already demonstrated their potential to support students in their learning process. In this paper, we focus on the benefits of adaptivity of a robotic tutor in a higher education scenario. To this end, we conducted a field study over three sessions over the course of a semester and implemented two conditions (adaptive and non-adaptive) of a robotic tutor to support students with exam preparation. After participant learned with both version in random order in the first two sessions, their preferred condition was used in the third session. Our results show that significantly more students preferred to learn with the adaptive robotic tutor. Additionally, participation resulted in significantly better exam performance compared to the average of the course. However, there was no significant difference in the learning experience such as motivation or need satisfaction between conditions.

Towards an automatic generation of natural gestures for a storyteller robot

Current research on the impact of gender appear-
ance in virtual agents and social robots highlights the danger
of transmitting and solidifying existing gender stereotypes. To
investigate gender-stereotyped interaction at public spaces in
dependency of virtual agents gender, we varied the gender of a
virtual agent at a metro station. We used an ethnographic study
approach, combining a two-day behavior observation with semi-
structured interviews with descriptive and qualitative system
log analysis of four weeks. Our results show that topics of
conversation differ in dependency of the virtual agents gender:
the male virtual agent was asked about topics such as brothels,
drugs and alcohol and insulted frequently, while the female one
was asked for relationship status or about flirting.

Familiar Acoustic Cues for Legible Service Robots

When service robots will be employed in private and public spaces, conflicts in human-robot interaction (HRI) might arise. To gain priority and continue its tasks, the robot would benefit from conflict resolution strategies (CRS) that are acceptable and effective. Previous studies have mainly investigated verbal or text-based CRS. As verbal interaction might not suit every application context or robot type, movement-based CRS were investigated. First, four possible implementations were pre-tested in an online study (N = 101). Then two CRS varying in modality (verbal vs. motoric) and assertiveness (submissive vs. dominant) were tested for acceptance and compliance in a lab study (N = 31) and compared for three robot types (humanoid, zoomorphic, and mechanoid). The verbal appeal was the most effective strategy to achieve user compliance. The motoric dominant strategy (moving back and forth) was perceived as most assertive and least polite if applied by the mechanoid cleaning robot but was not more effective than the verbal strategy. These studies provide insights into the influence of robot type on the acceptability and effectiveness of robot conflict resolution behavior depending on the modality.

Continuous and Incremental Learning in physical Human-Robot Cooperation using Probabilistic Movement Primitives (ProMPs)

Increasing demand for automation and recent intact trends have accelerated the employment of robots in manufacturing and service areas. Thus, there is a growing demand for easier and safer operation of robots, both by experts and non-professionals. This paper proposes a detachable smart
robot teaching device with collision prediction to meet such demands. The proposed device is composed of two modules. One is for easy teaching based on a 6D mouse, and the other is for safe operation by measuring the distance to the surrounding obstacles and predicting the collision situation. The teaching module is used only in a teaching phase and can be separated
afterward. A prototype is implemented, and the performance is verified through experiments with a collaborative robot.

Detachable smart teaching device for the easy and safe operation of robot manipulator

With the increasing use of social robots and automated machines in our daily lives, roboticists need to design robots that are suitable for human-robot collaboration. Prior work suggests that robots that are perceived to be intentional (i.e., are able to experience mental life capacities), can, in most cases, positively affect human-robot collaboration. With studies highlighting the importance of individual differences and how they drive our perception. We aimed to investigate how individual differences in gender moderate the relationship between subjective perceptions of robots and behavioral performance in a human-robot collaborative task. Participants rated a humanoid robot (i.e., iCub) on whether it can experience mental life capacities and completed a collaborative task with it. We correlated their subjective ratings with the completion time of the collaborative task and found a positive correlation between perceiving iCub to experience basic and social emotion with their performance (i.e., movement times). This relationship, however, was evident for males but not females. The results of this study suggest that perceiving humanoid robots as capable of experiencing mental states influences collaborative performance differently depending on gender. These findings can be relevant for the field of social robotics and to successfully design robot interaction partners for workplaces.

Expectations about mental states of a robot influence performance in a collaborative task with a robot for males but not females

Students with a learning disability (LD) generally require supplementary one-to-one instruction and support to acquire the foundational academic skills learned at school. Because learning is more difficult for students with LD, students can frequently display off-task behaviours to avoid attempting or completing challenging learning tasks. Re-directing students back to their learning task is a frequent strategy used by educators to support students. However, there have been limited studies investigating the use of assistive technology to support student re-direction, specifically in a ``real-world'' educational setting. In this in situ study, we investigate the impact of integrating socially assistive robot to provide re-direction strategies to students. A social robot, QT, was employed within the existing learning program during one-to-one remedial instruction sessions. The study comprised two phases, ``Instruction as usual" (IAU) and ``Robot-mediated instructions" (RMI). Both followed the students' one-to-one instructional program where students get personalised learning support from their instructors, except for the RMI phase which included a social robot as a tool. We investigated the impact of the robot on students' on-task behaviours and progress towards learning goals. The results of our mixed method analysis suggest that the robotic intervention supported students in staying on-task and completing their learning goal.

Reimagining RViz: Multidimensional Augmented Reality Robot Signal Design

Bidirectional object handover between a human and a robot enables an important functionality skill in robotic human-centered manufacturing or services. The problem in achieving this skill lies in the capacity of any solution to deal with three important aspects: (i) synchronized timing for the handing over phases; (ii) the handling of object pose constraints; and (iii) understanding the haptic exchanging to seamlessly achieve some steps of the (i). We propose a new approach for (i) and (ii) consisting in explicitly formulating the handover process as constraints in a task-space quadratic programming control framework to achieve implicit time and trajectory encounters. Our method is implemented on Panda robotic arm taking objects from a human operator.

Premium content

Multi-perspective human robot interaction through an augmented video interface supported by deep learning

Downloads

Next from IEEE RO-MAN 2022

From Message to Expression: Exploring Non-Verbal Communication for Appearance-Constrained Robots

Similar lecture

Augmented Environment Representations with Complete Object Models

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES