Singapore

Manufacturing planners face complex operational challenges that require seamless collaboration between human expertise and intelligent systems to achieve optimal performance in modern production environments. Traditional approaches to analyzing simulation-based manufacturing data often create barriers between human decision-makers and critical operational insights, limiting effective partnership in manufacturing planning. Our framework establishes a collaborative intelligence system integrating Knowledge Graphs and Large Language Model-based agents to bridge this gap, empowering manufacturing professionals through natural language interfaces for complex operational analysis. The system transforms simulation data into semantically rich representations, enabling planners to interact naturally with operational insights without specialized expertise. A collaborative LLM agent works alongside human decision-makers, employing iterative reasoning that mirrors human analytical thinking while generating precise queries for knowledge extraction and providing transparent validation. This partnership approach to manufacturing bottleneck identification, validated through operational scenarios, demonstrates enhanced performance while maintaining human oversight and decision authority. For operational inquiries, the system achieves near-perfect accuracy through natural language interaction. For investigative scenarios requiring collaborative analysis, we demonstrate the framework&#39;s effectiveness in supporting human experts to uncover interconnected operational issues that enhance understanding and decision-making. This work advances collaborative manufacturing by creating intuitive methods for actionable insights, reducing cognitive load while amplifying human analytical capabilities in evolving manufacturing ecosystems.

AAAI 2026

Intelligent Human-Machine Partnership for Manufacturing: Enhancing Warehouse Planning through Simulation-Driven Knowledge Graphs and LLM Collaboration

agentic ai

digital twins

knowledge graphs

We are pleased to announce the Thirty-Ninth AAAI Conference on Artificial Intelligence (AAAI-25), which will be held in Philadelphia, Pennsylvania at the Pennsylvania Convention Center from February 25 to March 4, 2025.

The purpose of the AAAI conference series is to promote research in Artificial Intelligence (AI) and foster scientific exchange between researchers, practitioners, scientists, students, and engineers across the entirety of AI and its affiliated disciplines. AAAI-25 will feature technical paper presentations, special tracks, invited speakers, workshops, tutorials, poster sessions, senior member presentations, competitions, and exhibit programs, and a range of other activities to be announced.

### [Invited Speakers](https://aaai.org/conference/aaai/aaai-25/aaai-25-invited-speakers/)

Register [here](https://aaai.org/conference/aaai/aaai-25/registration/)

AAAI 2025

The purpose of the AAAI conference series is to promote research in Artificial Intelligence (AI) and foster scientific exchange between researchers, practitioners, scientists, students, and engineers across the entirety of AI and its affiliated disciplines. AAAI-25 will feature technical paper presentations, special tracks, invited speakers, workshops, tutorials, poster sessions, senior member presentations, competitions, and exhibit programs, and a range of other activities to be announced.



Manufacturing planners face complex operational challenges that require seamless collaboration between human expertise and intelligent systems to achieve optimal performance in modern production environments. Traditional approaches to analyzing simulation-based manufacturing data often create barriers between human decision-makers and critical operational insights, limiting effective partnership in manufacturing planning. Our framework establishes a collaborative intelligence system integrating Knowledge Graphs and Large Language Model-based agents to bridge this gap, empowering manufacturing professionals through natural language interfaces for complex operational analysis. The system transforms simulation data into semantically rich representations, enabling planners to interact naturally with operational insights without specialized expertise. A collaborative LLM agent works alongside human decision-makers, employing iterative reasoning that mirrors human analytical thinking while generating precise queries for knowledge extraction and providing transparent validation. This partnership approach to manufacturing bottleneck identification, validated through operational scenarios, demonstrates enhanced performance while maintaining human oversight and decision authority. For operational inquiries, the system achieves near-perfect accuracy through natural language interaction. For investigative scenarios requiring collaborative analysis, we demonstrate the framework's effectiveness in supporting human experts to uncover interconnected operational issues that enhance understanding and decision-making. This work advances collaborative manufacturing by creating intuitive methods for actionable insights, reducing cognitive load while amplifying human analytical capabilities in evolving manufacturing ecosystems.

workshop paper

We are pleased to announce the Fortieth AAAI Conference on Artificial Intelligence (AAAI-26), which will be held in Singapore EXPO from January 20 to January 27, 2026.

The purpose of the AAAI conference series is to promote research in Artificial Intelligence (AI) and foster scientific exchange between researchers, practitioners, scientists, students, and engineers across the entirety of AI and its affiliated disciplines. AAAI-26 will feature technical paper presentations, special tracks, invited speakers, workshops, tutorials, poster sessions, senior member presentations, competitions, and exhibit programs, and a range of other activities to be announced.

To access this event page, you need to log in with the **email address you registered with**. Access credentials will be sent to your email from Underline - subject line "Welcome to AAAI 2026". Please be sure to check your spam email folder if you do not see an email confirmation right away.

Please log in

To access this event page, you are required to register.
Please complete your registration to continue.

We recommend reading [**the registration information**](https://aaai.org/conference/aaai/aaai-26/registration/) first.

**Online Registration Form**: https://aaai.getregistered.net/conference-2026 

Registration Required

We are pleased to announce the Fortieth AAAI Conference on Artificial Intelligence (AAAI-26), which will be held in Singapore EXPO from January 20 to January 27, 2026.

Robust object detection in real-world scenarios with out-of-distribution (OOD) shifts is critical for deployment in manufacturing industry, where defect detection systems face limited data, high visual variability, and real-world corruptions (e.g., lighting changes, sensor noise). While image augmentation (IA) has shown promise in improving model robustness, its application often requires deep learning expertise, limiting adoption in industrial settings. To address this, we propose a human-centric pipeline that enables non-expert users to select and fuse IA strategies for fine-tuning object detectors to improve robustness against potential OOD conditions. We conduct a comprehensive benchmark of IA methods (Stylized, AugMix, and PixMix) for enhancing detection robustness on five public OOD datasets (three corruption benchmarks and two natural-shift datasets), evaluating both CNN-based (Faster R-CNN) and Vision Transformer-based (DINO) detectors. Our results show that, on different OOD scenarios, different model and IA strategy may lead to different level of robustness enhancement. Our findings suggest that user-driven selection of models and IA strategies is essential to achieve robust, real-world object detection performance. We also introduce a dataset-agnostic metric, Effectiveness of Robustness Enhancement (ERE), to facilitate cross-dataset comparison. This work provides a practical guidance for deploying robust defect detection in manufacturing applications.

A Human-Centric Augmentation Framework for Robust Object Detection

Human-centric manufacturing requires collaboration between humans and machines, yet digital twins largely ignore human cognitive states. We introduce the adaptive cognitive twin—a lightweight model of worker attention, fatigue, and stress. By fusing EEG, eye-tracking, and heart rate variability with machine learning, our system tracks cognitive states in real time, outperforming state-of-the-art methods in classification accuracy. In real-world factory deployment, it maintained 83.2% fatigue detection accuracy while enabling adaptive robot assistance and safety interventions. We present a complete architecture addressing privacy, interpretability, and scalability, establishing a foundation for human-machine performance optimization.

Adaptive Cognitive Twins: Modeling Human Attention and Fatigue in Collaborative Manufacturing

Understanding human activities in manufacturing requires systems that not only perceive visual cues but also reason about procedural intent. Conventional Temporal Action Segmentation (TAS) methods are primarily perception-centric---optimized to classify visual frames rather than to reconstruct meaningful task structures. To bridge this gap, we propose Cognitive TAS, a lightweight Perception--Reasoning Integration Framework that unites visual adaptation and language-based reasoning for intent-aligned temporal understanding. Stage 1 (Adaptive Perception) employs few-shot prompt tuning of a Video-CLIP model to align textual labels with video representations, reducing annotation dependence and improving generalization. Stage 2 (Language-based Reasoning) leverages a text-only large language model (LLM) to integrate window-level predictions with data-driven soft procedural priors, enabling reasoning about temporal and semantic coherence. Through uncertainty-aware interpretation and contextual reasoning, it reconstructs temporally consistent, intent-aligned action sequences. Experiments on the 50Salads benchmark show that Cognitive TAS improves temporal consistency and semantic coherence over perception-based baselines, while approaching the quality of supervised models in a lightweight, annotation-efficient manner. These results suggest a practical path toward cognitively grounded, intent-aware TAS for human–machine collaboration.

Perception–Reasoning Integration for Temporal Action Segmentation in Human-Centered Manufacturing

The adoption of AI-powered computer vision in industry is often constrained by the need to balance operational utility with worker privacy. Building on our previously proposed privacy-preserving framework, this paper presents its first comprehensive validation on real-world data collected directly by industrial partners in active production environments. We evaluate the framework across three representative use cases: woodworking production monitoring, human-aware AGV navigation, and multi-camera ergonomic risk assessment. The approach employs learned visual transformations that obscure sensitive or task-irrelevant information while retaining features essential for task performance. Through both quantitative evaluation of the privacy–utility trade-off and qualitative feedback from industrial partners, we assess the framework’s effectiveness, deployment feasibility, and trust implications. Results demonstrate that task-specific obfuscation enables effective monitoring with reduced privacy risks, establishing the framework’s readiness for real-world adoption and providing cross-domain recommendations for responsible, human-centric AI deployment in industry.

Privacy-Preserving Computer Vision for Industry: Three Case Studies in Human-Centric Manufacturing

Embodied AI systems in human-robot collaborations continuously capture and process multimodal sensor data (e.g., audio, visual, motion cues, etc.) to perceive and adapt to human actions in real-time. These rich data streams can often expose personally identifiable or proprietary information such as human traits, machine operations, and production processes, posing significant privacy and IP risks during computations. While privacy-enhancing technologies (PETs) such as differential privacy (DP), secure multi-party computation (SMPC), and homomorphic encryption (HE) can protect data during processing, HE incurs high computation overhead, and other PETs such as DP and SMPC are unable to provide runtime protection for active sensor streams in memory. Existing PET solutions primarily focus on securing static data and fail to secure the data-in-use during the sense-to-act loops of embodied AI. The key contributions of this work are thus threefold: (1) defining runtime privacy as a critical dimension of embodied AI security, (2) proposing a PRISM, a hybrid LibOS–TEE framework for continuous multimodal protection, and (3) outlining design insights and future directions for practical deployment. By combining runtime isolation, secure I/O, and context-aware data classification, the proposed framework offers a promising, scalable, and hardware-rooted solution for privacy-preserving embodied AI for human-robot collaborations.

PRISM: A Hybrid LibOS–TEE Framework for Continuous Runtime Privacy in Embodied AI

Explainable AI (XAI) is increasingly adopted in manufacturing to support human-in-the-loop decision-making, enabling practitioners to understand, validate, or override AI-driven recommendations. While, in practice, AI engineers and data scientists often select an XAI method (aka., explainer) based on what they are familiar with and past experience, this is not optimal because it is known -- already proved in the literature -- that the interplay among {dataset, model, explainer} can substantially impact the overall level of trustworthiness of the generated explanation. This work presents a functionally grounded evaluation framework for MTS explanations, organized around three trustworthiness pillars: faithfulness, robustness, and complexity. We adapt state-of-the-art metrics from the image and tabular domains to timechannel attributions and integrate them into an interactive decision support system (DSS) named TRUE-X (TRUstworthy EXplanations). TRUE-X enables practitioners to visualize and balance the trade-off between the trustworthiness of the explanation and the accuracy of the model, fostering a more reliable and transparent XAI in human-centric manufacturing.

Towards Trustworthy Human-Centered Manufacturing: A Decision Support Tool for {Model x Explainer} Selection

The global surge in end-of-life (EOL) photovoltaic (PV) modules presents a critical sustainability challenge, necessitating recycling processes that minimize environmental impact. Traditional Life Cycle Assessment (LCA) methods, while valuable for retrospective analysis, are too slow and static to guide real-time operational decisions in recycling facilities. This creates a significant gap where operators lack immediate feedback on the greenhouse gas (GHG) consequences of their process choices. To bridge this gap, we propose a human-centric AI framework that transforms recycling operators from passive executors into active agents of sustainability. Rather than pursuing full automation, we develop a situation-aware assistance system that augments human capabilities through predictive intelligence. Our approach centers on an ensemble machine learning model (combining Random Forest and XGBoost) that provides real-time GHG emission predictions based on operational parameters, including energy consumption, ambient temperature, humidity, and process type. Trained on a synthesized dataset spanning 12 distinct EOL PV and e-waste recycling processes, our ensemble achieves an RMSE of 23.38, outperforming individual models and providing stable predictions. By integrating this model into an interactive system, we enable operators to forecast the environmental impact of their actions before execution, effectively addressing the limitations of traditional LCA and fostering more sustainable, informed decision-making at the operational level.

Human-Centric AI for Sustainable Manufacturing: Real-Time Emission-Aware Decision Support in PV Recycling

A central challenge for creating coherent teamwork in human-robot teams is maintaining mutual awareness of team member activities and ongoing task alignment. Hereby, human intention recognition is fundamental to enabling effective adaptation of robotic team members. Existing approaches either focus on short-term motion prediction or lack principled links between intention recognition and adaptive planning. We propose a unified framework as a robot agent architecture that based on hierarchical task decomposition links observable behaviors to high-level tasks planning. The framework contributes three key advances: (i) unified representation of both assigned tasks and models of foreseeable human behavior, (ii) integration of intention recognition with adaptive planning, and (iii) cost-based multi-level planning for task reallocation and motion adaptation. We illustrate its functioning in a manufacturing scenario in which humans and robots collaborate.

Intention-Aware Adaptive Planning in Human-Robot Teams

In this paper, we propose ChatRearrange, a novel framework for the text-guided 3D scene rearrangement task. Instructing an algorithm with a text description to rearrange 3D furniture objects remains an unsolved problem in the 3D field. Unfortunately, developing algorithms to address this problem presents two critical challenges. First, we lack appropriate text-labeled scene data for the training procedure. Second, evaluating performance is challenging due to the absence of appropriate benchmarks. To address the first issue, we propose the ChatRearrange framework, which includes an LLM-based Inverse Distillation algorithm, enabling ChatRearrange to train without description-labeled scene data. Additionally, we incorporate a novel gradient-field-based student network to learn the text-3D knowledge from the LLM. For the second challenge, we benchmark the text-guided 3D scene rearrangement task by proposing a new dataset called TextRoom. We also include various metrics for the evaluation. The results show that our algorithm outperforms other baselines by a large margin. We are committed to releasing all the code and dataset if the paper is accepted.

ChatRearrange: Learning Text-guided 3D Scene Rearrangement

3D assembly tasks require automatic agents’ precise interpretations of visual scenes and structural reasoning. While large Vision-Language Models (VLMs) have shown promising capabilities in general Visual Question Answering (VQA), existing benchmarks inadequately reflect the complexities inherent in assembly reasoning. In this paper, we introduce FurniBench, an assembly-specific VQA benchmark, together with FurniQA, a large-scale dataset covering tasks such as part recognition, connection reasoning, and step ordering. Using Qwen2-VL-2B-Instruct as a base model (39.1% accuracy on FurniBench), we first establish a supervised fine-tuning (SFT) baseline, which highlights both the benefits and the limitations of SFT in this domain. Building on this, we propose Assembly-R1, trained with Group Relative Policy Optimization (GRPO), which substantially enhances reasoning ability and achieves 71.7% accuracy, outperforming the base model, the SFT baseline, and other open-source and closed-source commercial VLM candidates. Our results demonstrate that reinforcement learning offers a more robust path toward generalizable 3D assembly reasoning. We will release the dataset and code upon acceptance of this paper.

Downloads

Next from AAAI 2026

A Human-Centric Augmentation Framework for Robust Object Detection

Similar lecture

Embodied AI for Smart Robotic Cells in Manufacturing Applications

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES