FROMANNUAL REVIEWS

AAAI 2026

•

January 23, 2026

•

Singapore, Singapore

Despite the revolutionary impact of the Transformer architecture and the "Attention Is All You Need" paradigm, the field is currently facing a performance plateau characterized by diminishing returns on scaling and the computational bottlenecks of quadratic attention complexity . This talk explores "blue-sky" directions to overcome these limitations through innovations in model architectures and techniques. First, we address the instability issues inherent in current linear attention mechanisms, such as DeltaNet, which suffer from error accumulation due to Euler discretization . We introduce Error-Free Linear Attention (EFLA), a novel framework that derives an exact solution to the underlying continuous-time ordinary differential equation (ODE) . By leveraging Rank-1 matrix dynamics, EFLA achieves a computationally tractable, linear-time update rule that eliminates discretization error, offering guaranteed stability and superior performance in language modeling tasks. Second, we examine the intersection of vision-language reasoning and robotic control (VLA models), identifying the limitations of Supervised Fine-Tuning (SFT) and the scalability challenges of reinforcement learning in robotics . We present NORA- 1.5, a VLA architecture that couples an auto-regressive backbone with a Flow- Matching Action Expert . By utilizing World Model-guided rewards and Direct Preference Optimization (DPO), NORA-1.5 enables scalable post-training on synthetic data, achieving state-of-the-art results on benchmarks like SimplerEnv and LIBERO while demonstrating robust real-world deployment on the Galaxea A1 robot . These contributions collectively chart a path toward more efficient, stable, and capable AI systems."

Downloads

Transcript English (automatic)

Next from AAAI 2026

Anchor-Guided Discriminative Subspace Alignment and Clustering for Cross-Scene Hyperspectral Imagery
technical paper

Anchor-Guided Discriminative Subspace Alignment and Clustering for Cross-Scene Hyperspectral Imagery

AAAI 2026

+2
Zhihua Cai and 4 other authors

23 January 2026

Similar lecture

VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
technical paper

VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model

AAAI 2026

Pengxiang Ding
+13
Can Cui and 15 other authors

23 January 2026

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Presentations
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2026 Underline - All rights reserved

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.