United States

When we humans interact with each other, we adapt our behaviors to the people we interact with. We do this by interpreting subtle cues and signals from them in each interaction. With this paper, we created a robot that uses speech and body movement characteristics to recognize and distinguish between users interacting with it through small duration interactions. We investigate how these characterics are influenced by changing the physical context.

IEEE RO-MAN 2021

A Minimalistic Approach to User Group Adaptation of Robot Behaviors Using Movement and Speech Analysis

movement-characteristics

speech-characteristics

behavior

adaptation

context

ICPR 2020 is the premier international conference on Pattern Recognition, gathering leading researchers from around the world to present their latest achievements in Pattern Analysis and Recognition, applied Artificial Intelligence and Machine Learning. The topic of the year is " Putting Artificial intelligence to work on Patterns". 
For the first time, ICPR has employed a two-round review process similar to journal submissions, with new papers allowed to be submitted in either the first or second round and papers submitted in the first round and not accepted allowed to be revised and re-submitted for second round review. 

In this edition of the **ICPR 2020** Conference, there are 1407 Oral/Poster presentations organized in five Tracks: 
- Artificial Intelligence, Machine Learning for Pattern Analysis; 
- Biometrics, Human Analysis and Behavior Understanding; Computer Vision, Robotics and Intelligent Systems; 
- Document and Media Analysis; and 
- Image and Signal Processing. 

The **ICPR 2020** Main Conference program also includes 7 Keynotes from prominent world-renowned scientists, 8 Tutorials, 28 Demos, 8 Challenges, 2 Panels, as well as an Industry/Sponsor Exhibition. In addition, 41 Workshops on a range of important current and emerging research topics complete the ICPR 2020 program. 


ICPR 2020

panel

RO-MAN 2021's theme is trustworthiness and cooperation. We chose this term well before the pandemic put the world on edge and added a new reason for us to question our own personal safety when in the company of others. But what about in the company of social robots? What would cause us to trust, or not trust, them? How do we as researchers create that feeling, that critical component of any relationship? With social robots, it is of course largely in our power to design the physical form, the control code and the interface software to maximize trustworthiness, facilitate cooperation and enhance the quality of human-robot interaction. This theme also touches upon people's expectations and perceptions of robots, as well as other social, cognitive and cultural factors that will influence human-robot interactions. We will have a special session/track on this topic, invite targeted submissions and include plenary speakers who are specialist in this area. We sincerely hope that this focus will help enlighten the design-thinking of all of us as we fabricate and program our own various systems.

To access RO-MAN Virtual 2021, [please register here.](https://ro-man2021.org/registration/)

RO-MAN 2021's theme is trustworthiness and cooperation. We chose this term well before the pandemic put the world on edge and added a new reason for us to question our own personal safety when in the company of others. But what about in the company of social robots? What would cause us to trust, or not trust, them? How do we as researchers create that feeling, that critical component of any relationship? With social robots, it is of course largely in our power to design the physical form, the control code and the interface software to maximize trustworthiness, facilitate cooperation and enhance the quality of human-robot interaction. 

This work presents our efforts to enhance the adoption of Robotics in the TV & Film Industry. Specifically, through our efforts in developing the IoT-enabled Robotic Camera Dolly (IRCD), The Pre & Post Interview Protocol, and reporting on the reaction and perception of the TV production and filming crew.

On the Expressivity of a Parametric Humanoid Emotion Model

This paper proposes a street-style study method to conduct human-robot interaction studies in-the-wild where the robots conduct their own experiments by recruiting their audience, conducting the study and gathering data. This street-style study method was implemented using multi-robot comedy as the platform deployed at an arts and technology festival to validate the concept. Twelve robot comedy shows occurred over seven hours with two robots on stage, who queried the audience during and at the end of each show. The multi-robot aspect enabled the robots to act out interactions relative each other, oneself and the audience. The final street-style study method evolved from pilots at a local farmer’s market, with hardware designed for portability and easy replication. The robots conducted their own human experiments in that they queried the audience after displaying experimentally balanced episodes of relational humor, with permutations of who was the `butt of the joke.' Our study results explore the relational humor of the two robots and the audience, asking the audience to agree or disagree with particular perspectives. Delivered as part of the show, the robots invite the audience to vote via a show of hands. ANOVA analyses of the percent-agreement results find that (1) audiences were generally positive about all aspects of the show unless both robots were being negative, and (2) audiences were more ready to protect the robot comedian's ego than their own, strongly supporting the statement that the robot was doing a good job.

Augmented Reality interface to verify Robot Learning

In this paper, we introduce BabyNet, a light-weight (in
terms of trainable parameters) network structure to recognize
infant reaching action from off-body stationary cameras. We
develop an annotated dataset that includes diverse reaches
performed while in a sitting posture by different infants in
unconstrained environments (e.g., in home settings, etc.). 
BabyNet can attain solid performance in terms of (average)
testing accuracy that exceeds that of other larger networks,
and can hence serve as a light-weight data-driven framework
for video-based infant reaching action recognition.

BabyNet: A Lightweight Network for Infant Reaching Action Recognition in Unconstrained Enviroments to Support Future Pediatric Rehabilitation Applications

We try to design a control law using MPC and predictive tracking of a person using LSTM for a socially adept person following robot. The human-robot shared autonomy is the motivation. Tracking a person when it goes out of sight is a challenging task, for which LSTMs are brought to the picture. This adds the natural human part to the work.

Towards Out-Of-Sight Predictive Tracking for Long-Term Indoor Navigation of Non-Holonomic Person Following Robot

Making an agent’s intentions clear from its observed behavior is crucial for seamless human-agent interaction and for increased transparency and trust in AI systems. Existing methods that address this challenge and maximize legibility of
behaviors are limited to deterministic domains. We develop a technique for maximizing legibility in stochastic environments and illustrate that using legibility as an objective improves interpretability of agent behavior in several scenarios. We provide initial empirical evidence that human subjects can better interpret legible behavior.

A Virtual Reality-Based Framework for Enhancing Walking Abilities Using Exoskeleton

This research proposed a remote conversation assisting system for those unbalanced condition by utilizing both physical and virtual aspects of sharing the nonverbal behavior of remote-paticipating interlocutor.
The proposed system is constructed with a rotatable screen which project the life-size avatar of remote interlocutor where the rotation of the screen alternate as body posture and projected avatar show the gesture.

A General Methodology for Teaching Norms to Social Robots

In this study, we aim to verify whether expanding a robot's embodiment influences the ease of inducing behavioral changes in passersby. We conducted a field experiment in a real shop using robots with various embodiments. The results show that expanding the robot's embodiment induces behavioral changes to the desired action, such as stopping in front of the robot and disinfecting their hands. These results indicate that expanding the robot's embodiment was an important factor in inducing behavioral changes in passersby.

Behavioral Changes in Passersby by Expanding Embodiment of a Calling Robot

With more social robots entering different industries such as educational systems, health-care facilities, and even airports, it is important to tackle problems that may hinder high quality interactions in a wild setting including group conversations. This paper presents an autonomous group conversational role coordinator system based on the proxemics of participants in the group with the robot including their distances and orientations. The system accordingly assigns to the group participants around the robot three different statuses: active, bystander, and overhearer. Once the statuses are estimated, the robot autonomously adjusts its gaze pattern in order to adapt to the group dynamics and attributes its attention in relation to the role the member in the group is playing. This system was evaluated through a pilot study (N=16), in which two participants at a time played a trivia game with the robot and had different roles to play within the interaction. The primary results imply that the participants interacting with a robot having this adaptive gaze behavior based on conversational role coordination are more likely to stand closer to the robot. In addition, the robot was perceived as more adaptable, sociable, and socially present as well as more likely to make the participants feel more attended to.

Let me join you! Real-time F-formation Recognition by a Socially Aware Robot

Human-human collaboration is characterized by a
back-and-forth, where an action of one agent elicits the response
of the other. This interaction is inherently multimodal and
includes both high-level modalities such as language and lowlevel ones such as force exchanges. In this work, we investigate
human collaborative manipulation: we show distinct patterns
that can be identified in low-level physical data and that can
be interpreted as primitives used by humans to negotiate about
various aspects of the motion and to execute the motion. These
primitives provide a high-level interpretation of the interaction
and can be used to connect low-level behavior to language.
We describe the human study used to collect the data, the data
analysis process, and discuss how the identified primitives could
be used by a robot’s interaction manager to mediate physical
Human-Robot Interaction (pHRI).

Physical Action Primitives for Collaborative Decision Making in Human-Human Manipulation

In this research, we investigate the use of External Human Machine Interface for delivery robots for expressing their navigational intent. Through a survey, we explore the effectiveness of display and light-based external interfaces in expressing the delivery robots navigational intent.

Premium content

A Minimalistic Approach to User Group Adaptation of Robot Behaviors Using Movement and Speech Analysis

Downloads

Next from IEEE RO-MAN 2021

On the Expressivity of a Parametric Humanoid Emotion Model

Similar lecture

Transformer-Encoder Detector Module: Using Context to Improve Robustness to Adversarial Attacks on Object Detection

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES