Netherlands

Robotic agents that can accomplish manipulation tasks with the competence of humans have been one of the grand research challenges for artificial intelligence (AI) and robotics research for more than 50 years. However, while the fields made huge progress over the years, this ultimate goal is still out of reach. I believe that this is the case because the knowledge representation and reasoning methods that have been proposed in AI so far are necessary but too abstract. In this talk I propose to address this problem by endowing robots with the capability to internally emulate and simulate their perception-action loops based on realistic images and faithful physics simulations, which are made machine-understandable by casting them as virtual symbolic knowledge bases. These capabilities allow robots to generate huge collections of machine-understandable manipulation experiences, which robotic agents can generalize into commonsense and intuitive physics knowledge applicable to open varieties of manipulation tasks. The combination of learning, representation, and reasoning will equip robots with an understanding of the relation between their motions and the physical effects they cause at an unprecedented level of realism, depth, and breadth, and enable them to master human-scale manipulation tasks. This breakthrough will be achievable by combining leading-edge simulation and visual rendering technologies with mechanisms to semantically interpret and introspect internal simulation data structures and processes. Robots with such manipulation capabilities can help us to better deal with important societal, humanitarian, and economic challenges of our aging societies.

ICAART 2022

Knowledge Representation &amp; Reasoning in CRAM: A Cognitive Architecture for Robot Agents Accomplishing Everyday Manipulation Tasks

**About**
 The PErvasive Technologies Related to Assistive Environments (PETRA) conference is a highly interdisciplinary conference that focuses on computational and engineering approaches to improve the quality of life and enhance human performance in a wide range of settings, in the workplace, at home, in public spaces, urban environments, and other. Outcomes of this conference have a broad impact in application areas that include, manufacturing, transportation, healthcare, energy systems, security and safety, robotics, biomedicine, environment and conservation, and many others. PETRA brings together very different types of technologies to also address important social and healthcare issues for sensitive populations, such as the elderly, persons suffering from chronic conditions such as Alzheimer’s, Parkinson’s, Cerebral Palsy, and other disabilities or traumas.

 PETRA (which means “stone” in Greek) addresses important human living needs. From a technological perspective, PETRA motivates and inspires new scientific thrusts, innovations and discoveries to improve living environments, a particularly important issue, in an increasingly crowded and complex world where the need for inclusiveness and connectivity with the rest of the world is key. For the elderly in particular, PETRA addresses the fact that, as people grow older; they will increasingly rely on technology to be able to prolong staying in their homes and enjoy an independent life.

 The PETRA 2021 proceedings will be published in the ACM Digital Library as part of the ACM ICPS program. The ISBN number assigned to PETRA '21 is 978-1-4503-8792-7

PETRA 2021

The PErvasive Technologies Related to Assistive Environments (PETRA) conference is a highly interdisciplinary conference that focuses on computational and engineering approaches to improve the quality of life and enhance human performance in a wide range of settings, in the workplace, at home, in public spaces, urban environments, and other. Outcomes of this conference have a broad impact in application areas that include, manufacturing, transportation, healthcare, energy systems, security and safety, robotics, biomedicine, environment and conservation, and many others. PETRA brings together very different types of technologies to also address important social and healthcare issues for sensitive populations, such as the elderly, persons suffering from chronic conditions such as Alzheimer’s, Parkinson’s, Cerebral Palsy, and other disabilities or traumas.

Knowledge Representation & Reasoning in CRAM: A Cognitive Architecture for Robot Agents Accomplishing Everyday Manipulation Tasks

keynote

The purpose of the International Conference on Agents and Artificial Intelligence is to bring together researchers, engineers and practitioners interested in the theory and applications in the areas of Agents and Artificial Intelligence. Two simultaneous related tracks will be held, covering both applications and current research work. One track focuses on Agents, Multi-Agent Systems and Software Platforms, Distributed Problem Solving and Distributed AI in general. The other track focuses mainly on Artificial Intelligence, Knowledge Representation, Planning, Learning, Scheduling, Perception Reactive AI Systems, and Evolutionary Computing and other topics related to Intelligent Systems and Computational Intelligence. 
CONFERENCE AREAS 
1 . Agents 
2 . Artificial Intelligence

The purpose of the International Conference on Agents and Artificial Intelligence is to bring together researchers, engineers and practitioners interested in the theory and applications in the areas of Agents and Artificial Intelligence. Two simultaneous related tracks will be held, covering both applications and current research work. One track focuses on Agents, Multi-Agent Systems and Software Platforms, Distributed Problem Solving and Distributed AI in general. The other track focuses mainly on Artificial Intelligence, Knowledge Representation, Planning, Learning, Scheduling, Perception Reactive AI Systems, and Evolutionary Computing and other topics related to Intelligent Systems and Computational Intelligence.

In this talk, I will present our work toward building Socially Interactive Agent SIA, that is agent able to be socially aware, interact with human partners, but also adapt its behaviors to favor user’s engagement during the interaction. During an interaction, partners adapt their behaviors to each other. Adaptation can happen at different levels, such as at the linguistic one (choice of vocabulary, grammatical style), the behavior one (change of posture), etc. It can involve the choice of a given conversational strategy to manage user’s impression, or synchronization mechanisms (eg imitate a smile)… Lately we have developed three adaptation mechanisms that work on different levels: conversational strategy, nonverbal behaviors and multimodal signals. I will present the general framework on which these models have been built. As it interacts with a human partner, the agent learns to adapt to maximize the quality of the interaction. These models have been evaluated through a study involving visitors of a science museum. I will discuss the results of these studies. Touch is a modality that is not much considered in human-agent interaction. Social touch bares many functions during an interaction. A caress can convey comfort, a tap human’s attention, etc. We have been working on endowing an agent to respond to social touch by a human and to touch the human to convey different intentions and emotions. I will describe the decision model based on the emotional model FAtiMA we have developed.

Interacting with Socially Interactive Agents

Automation is a fundamental part of industry and our private lives. At Festo, our vision is to free humans from harming tasks – these might be mentally (by being boring and repetitive) or even physically harming. Today, one aspect of an automation solution is that it is engineered to a specific problem and environment and often does not interact actively with humans. For humans to naturally interact with machines, it is needed that the machines can react to changing tasks and environments. Here, AI-based solutions come into play and offer a solution. Mechanisms inspired by biology offer efficient solutions to many questions arising in this field. This keynote will show concrete challenges from within the industrial automation and the solutions Festo research came up with.

Premium content

Knowledge Representation & Reasoning in CRAM: A Cognitive Architecture for Robot Agents Accomplishing Everyday Manipulation Tasks

Downloads

Next from ICAART 2022

Interacting with Socially Interactive Agents

Similar lecture

End-User Framework for Robot Control

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES