United States

Physics-informed neural networks solve partial differential equations by training neural networks. Since this method approximates infinite-dimensional PDE solutions with finite collocation points, minimizing discretization errors by selecting suitable points is essential for accelerating the learning process. Inspired by number theoretic methods for numerical analysis, we introduce good lattice training and periodization tricks, which ensure the conditions required by the theory. Our experiments demonstrate that GLT requires 2--7 times fewer collocation points, resulting in lower computational cost, while achieving competitive performance compared to typical sampling methods.

AAAI 2025

Number Theoretic Accelerated Learning of Physics-Informed Neural Networks

natural sciences

technical paper

We are pleased to announce the Thirty-Ninth AAAI Conference on Artificial Intelligence (AAAI-25), which will be held in Philadelphia, Pennsylvania at the Pennsylvania Convention Center from February 25 to March 4, 2025.

The purpose of the AAAI conference series is to promote research in Artificial Intelligence (AI) and foster scientific exchange between researchers, practitioners, scientists, students, and engineers across the entirety of AI and its affiliated disciplines. AAAI-25 will feature technical paper presentations, special tracks, invited speakers, workshops, tutorials, poster sessions, senior member presentations, competitions, and exhibit programs, and a range of other activities to be announced.

### [Invited Speakers](https://aaai.org/conference/aaai/aaai-25/aaai-25-invited-speakers/)

Register [here](https://aaai.org/conference/aaai/aaai-25/registration/)

The purpose of the AAAI conference series is to promote research in Artificial Intelligence (AI) and foster scientific exchange between researchers, practitioners, scientists, students, and engineers across the entirety of AI and its affiliated disciplines. AAAI-25 will feature technical paper presentations, special tracks, invited speakers, workshops, tutorials, poster sessions, senior member presentations, competitions, and exhibit programs, and a range of other activities to be announced.



Low-cost accelerometers play a crucial role in modern society due to their advantages of small size, ease of integration, wearability, and mass production, making them widely applicable in automotive systems, aerospace, and wearable technology. However, this widely used sensor suffers from severe accuracy and range limitations. To this end, we propose a honed-energy regularized and optimal supervised GAN (HEROS-GAN), which transforms low-cost sensor signals into high-cost equivalents, thereby overcoming the precision and range limitations of low-cost accelerometers. Due to the lack of frame-level paired low-cost and high-cost signals for training, we propose an Optimal Transport Supervision (OTS), which leverages optimal transport theory to explore potential consistency between unpaired data, thereby maximizing supervisory information. Moreover, we propose a Modulated Laplace Energy (MLE), which injects appropriate energy into the generator to encourage it to break range limitations, enhance local changes, and enrich signal details. Given the absence of a dedicated dataset, we specifically establish a Low-cost Accelerometer Signal Enhancement Dataset (LASED) containing tens of thousands of samples, which is the first dataset serving to improve the accuracy and range of accelerometers and is released in Github. Experimental results demonstrate that a GAN combined with either OTS or MLE alone can surpass the previous signal enhancement SOTA methods by an order of magnitude. Integrating both OTS and MLE, the HEROS-GAN achieves remarkable results, which doubles the accelerometer range while reducing signal noise by two orders of magnitude, establishing a benchmark in the accelerometer signal processing.

HEROS-GAN: Honed-Energy Regularized and Optimal Supervised GAN for Enhancing Accuracy and Range of Low-Cost Accelerometers

Recent advancements in AI alignment techniques have significantly improved the alignment of large language models (LLMs) with static human preferences. However, the dynamic nature of human preferences can render some prior training data outdated or even erroneous, ultimately causing LLMs to deviate from contemporary human preferences and societal norms. Existing methodologies, whether they involve the curation of new data for continual alignment or the manual correction of outdated data for re-alignment, demand costly human resources.
To address this challenge, we propose a novel approach, Large Language Model Behavior Correction with Influence Function Recall and Post-Training (LANCET), which requires no human involvement. LANCET consists of two phases: (1) using influence functions to identify the training data that significantly impact undesirable model outputs, and (2) applying an Influence function-driven Bregman Optimization (IBO) technique to adjust the model’s behavior based on these influence distributions. Our experiments demonstrate that LANCET effectively and efficiently correct inappropriate behaviors of LLMs. Furthermore, LANCET can outperform methods that rely on collecting human preferences, and it enhances the interpretability of learning human preferences within LLMs.

Correcting Large Language Model Behavior via Influence Function

Human experts typically integrate numerical and textual multimodal information to analyze time series. However, most traditional deep learning predictors rely solely on unimodal numerical data, using a fixed-length window for training and prediction on a single dataset, and cannot adapt to different scenarios. The powered pre-trained large language model has introduced new opportunities for time series analysis. Yet, existing methods are either inefficient in training, incapable of handling textual information, or lack zero-shot forecasting capability. In this paper, we innovatively model time series as a foreign language and construct ChatTime, a unified framework for time series and text processing. As an out-of-the-box multimodal time series foundation model, ChatTime provides zero-shot forecasting capability and supports bimodal input/output for both time series and text. We design a series of experiments to verify the superior performance of ChatTime across multiple tasks and scenarios, and create four multimodal datasets to address data gaps. The experimental results demonstrate the potential and utility of ChatTime. Specifically, in the unimodal zero-shot forecasting task, ChatTime achieves 99.9\% of the previous state-of-the-art using only 4\% of the pre-training data. In the multimodal tasks of context-guided forecasting and time series question answering, ChatTime outperforms the previous state-of-the-art by 3.7\% and 36.6\%, respectively.

ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data

Equilibrium problems in Bayesian auction games can be described as systems of differential equations. Depending on the model assumptions, these equations might be such that we do not have a rigorous mathematical solution theory. The lack of analytical or numerical techniques with guaranteed convergence for the equilibrium problem has plagued the field and limited equilibrium analysis to rather simple auction models such as single-object auctions. 
Recent advances in equilibrium learning led to algorithms that find equilibrium under a wide variety of model assumptions. Monotonicity and the Minty condition are the known sufficient conditions for learning algorithms to converge to an equilibrium in games. 
Not much is known about convergence of learning algorithms beyond these conditions. 
We analyze first- and second-price auctions where simple learning algorithms consistently converge to an equilibrium.
The analysis is challenging, because these properties need to be shown in infinite dimensions. 
Interestingly, we show that neither monotonicity nor pseudo- or quasi-monotonicity holds for the respective variational inequalities (VIs). 
The second-price auction's equilibrium is a Minty-type solution, but the first-price auction is not. 
However, the analysis via infinite-dimensional VIs allows us to get ex-post guarantees for gradient-based algorithms. 
We show that the Bayes--Nash equilibrium is the unique solution to the VI within the class of uniformly increasing bid functions, which ensures that gradient-based algorithms attain the equilibrium in case of convergence, as also observed in numerical experiments.

Beyond Monotonicity: On the Convergence of Learning Algorithms in Standard Auction Games

Tropical cyclones (TCs) are complex weather systems characterized by strong winds and heavy rainfall, which lead to substantial loss of life and property. Therefore, accurate TC forecasting is crucial for the effective prevention of disasters caused by TCs. Tropical cyclone (TC) forecasting can be regarded as a spatio-temporal prediction problem. It has been proven that using multi-modal data can more effectively introduce atmospheric information to achieve better prediction results and higher interpretability. But the introduction of multi-modal data inevitably introduces noise into the prediction process. The diffusion model's unique noise modeling capability can effectively reduce prediction noise when using multi-modal datasets. However, adapting the diffusion model to TC forecasting has two main challenges: how to extract valuable information from multi-modal data, and how to utilize this information to guide the generation process. For the first challenge, although recent methods can predict multiple TC attributes by using multi-modal data, they often fall short in considering the interdependence of multiple attributes and the semantic gap between different modalities. Considering the interdependence of attributes, we propose two condition generators that account for the commonalities and characteristics of TC attributes, which extract spatio-temporal and environmental features and incorporate expert knowledge. To reduce the semantic gap between multi-modal TC data, we introduce the PGSA-LSTM module to discover mappings between primary and auxiliary modalities. For the second challenge, we propose a novel Bi-condition multi-modal diffusion model, which sequentially processes conditions from the characteristics to commonalities of attributes, thereby extending the number of conditions and improving the range of guidance information that the diffusion model can accept. Our results surpass those of state-of-the-art deep learning models for TC forecasting and outperform the numerical weather prediction model used by the China Central Meteorological Observatory. Besides, TC-Diffuser shows high generalizability across global ocean areas, strong robustness when most inputs are missing, and higher computational efficiency compared to other methods.

TC-Diffuser: Bi-Condition Multi-Modal Diffusion for Tropical Cyclone Forecasting

Initial discussion of AI literacy assessment has focused on competency frameworks and learning standards rather than materials for classroom use. Responsible AI for Computational Action (RAICA), a constructionist AI curriculum for middle and high school students, includes assessment materials to support teachers with the evaluation of student AI fluency competencies in their classrooms. These materials include exit tickets used as formative assessments at the end of each lesson and both teacher and student-facing rubrics. After beta-testing a module of the curriculum with nine teachers and 282 students, we reviewed teacher usage data and feedback as well as student responses. The review process surfaced a number of improvements to the materials to better align them with classroom teaching practice. These included clarifying language and adding visual scaffolds. We present the assessment materials and iterative design process used to bridge the gap between the theoretical AI literacy competencies and their practical implementation in classrooms.

Supporting AI Fluency Teaching Through the Development of Assessments for Classroom Use

The rapid and nearly pervasive impact of artificial intelligence on fields as diverse as medicine, law, banking, and the arts has made many students who would never enroll in a computer science class become interested in understanding elements of artificial intelligence. Fueled by questions about how this technology would change their own fields, these students are not seeking to become experts in building AI systems but instead are searching for a sufficient understanding to be safe, effective, and informed users. In this paper, we describe a first-of-its-kind course offering, "Artificial Intelligence for Future Presidents" designed and taught during the spring of 2024. We share rationale on the design and structure of the course, consider how best to convey complex technical information to students without the background in programming or mathematics, and consider methods for supporting an understanding of the limits of this technology.

EAAI-127 - Artificial Intelligence for Future Presidents: Teaching AI Literacy to Everyone

The prominence of artificial intelligence and machine learning in everyday life has led to efforts to foster AI literacy for all K–12 students. In this paper, we review how Hour of Code activities engage with the five big ideas of AI, in particular with machine learning and societal impact. We found that a large majority of activities focus on perception and machine learning, with little attention paid to representation and other topics. A surprising finding was the increased attention paid to critical aspects of computing. However, we also observed a limited engagement with hands-on activities. In the discussion, we address how future introductory activities could be designed to offer a broader array of topics, including the development of tools to introduce novices to artificial intelligence and machine learning and the design of more unplugged and collaborative activities.

What Can Youth Learn About Artificial Intelligence and Machine Learning in One Hour? Examining How Hour of Code Activities Address the Five Big Ideas of AI

With the rapid rise of AI technologies such as ChatGPT, understanding and integrating AI into K-12 education has become increasingly important. However, teachers often lack the AI literacy necessary to navigate these tools, which can lead to the perpetuation of misconceptions and biases in the classroom. This study seeks to identify K-12 teachers’ self-identified needs regarding AI education and compare them with existing research on professional development (PD) for AI integration. We surveyed 34 K-12 teachers to assess their knowledge of AI, identify areas where they require further support, and evaluate the relevance of current PD offerings. Our findings reveal a significant disconnect between the top-down assumptions of expert-driven PD initiatives and the practical needs articulated by teachers. Key themes emerged, including a diverse range of AI understanding among educators, a strong preference for hands-on, practical training, and a demand for ongoing institutional support. Additionally, teachers expressed a desire for collaborative learning environments to share strategies and experiences related to AI. This study underscores the importance of tailoring PD programs to address the unique contexts and challenges faced by educators, advocating for a more personalized approach that fosters confidence and competence in AI integration. By aligning PD offerings with teachers’ needs, we aim to enhance their ability to effectively utilize AI tools in the classroom, ultimately enriching the educational experience for students.

Understanding K-12 Teachers’ Needs for AI Education: A Survey-Based Study

Part of a university initiative supporting responsible AI for social empowerment and education, the project-based RAICA (Responsible AI for Computational Action) curriculum supports middle/high school learners and novice AI literacy teachers use AI creatively for good. This paper offers a rare example of design-based implementation research (DBIR) in AI education across widely varied contexts, provides fine grain implementation data that contributes to a foundation for evaluating effectiveness and expanding access. We present a novel approach to analyzing fidelity of implementation data from RAICA’s computer vision module beta-test. Twelve educators working with ~282 students across nine pilot sites in four countries used a bespoke fidelity of implementation data collection tool (pre-made comment prompts in a Google Docs version of the teacher guide) to provide 236 qualitative responses about AI literacy and responsible design activities, plus 111 ordinal ratings of embedded teacher supports. Analyses revealed that while the curriculum was generally implemented as designed, educators frequently made modifications. Although most changes produced practical insights for improved curriculum design, others helped the design team anticipate and prevent changes that could obscure learning objectives and hinder outcomes. We discuss the pedagogical, design, and research implications of these findings for effective AI teaching/learning in diverse settings.

Number Theoretic Accelerated Learning of Physics-Informed Neural Networks

Downloads

Next from AAAI 2025

HEROS-GAN: Honed-Energy Regularized and Optimal Supervised GAN for Enhancing Accuracy and Range of Low-Cost Accelerometers

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES