technical paper

AAAI 2024

February 22, 2024

Vancouver , Canada

Prompt to Transfer: Sim-to-Real Transfer for Traffic Signal Control with Prompt Learning

keywords:

traffic signal control

sim-to-real transfer

llms

reinforcement learning

Numerous methods are proposed for the Traffic Signal Control (TSC) tasks aiming to provide efficient transportation and mitigate congestion waste. In recent, promising results have been attained by Reinforcement Learning (RL) methods through trial and error in simulators, bringing confidence in solving cities' congestion headaches. However, there still exist performance gaps when simulator-trained policies are deployed to the real world. This issue is mainly introduced by the system dynamic difference between the training simulator and the real-world environments. The Large Language Models (LLMs) are trained on mass knowledge and proved to be equipped with astonishing inference abilities. In this work, we leverage LLMs to understand and profile the system dynamics by a prompt-based grounded action transformation. Accepting the cloze prompt template, then filling in the answer based on accessible context, the pre-trained LLM's inference ability is exploited and applied to understand how weather conditions, traffic states, and road types influence traffic dynamics, being aware of this, the policies' action is taken and grounded based on realistic dynamics, thus help the agent learn a more realistic policy. We conduct experiments using DQN to show the effectiveness of the proposed PromptGAT's ability in mitigating the performance gap from simulation to reality (sim-to-real).

Downloads

PaperTranscript English (automatic)

Next from AAAI 2024

Uncertainty Quantification for Forward and Inverse Problems of PDEs via Latent Global Evolution
technical paper

Uncertainty Quantification for Forward and Inverse Problems of PDEs via Latent Global Evolution

AAAI 2024

+2Stefano Ermon
Tailin Wu and 4 other authors

22 February 2024

Stay up to date with the latest Underline news!

Select topic of interest (you can select more than one)

PRESENTATIONS

  • All Lectures
  • For Librarians
  • Resource Center
  • Free Trial
Underline Science, Inc.
1216 Broadway, 2nd Floor, New York, NY 10001, USA

© 2023 Underline - All rights reserved