
Yangyi Chen
University of Illinois Urbana-Champaign
analysis
zero-shot
benchmark
pre-training
curriculum learning
knowledge base
pre-trained language models
calibration
pre-trained model
sememe
dictionary
backdoor attacks
syntactic
backdoor defense
security
15
presentations
27
number of views
SHORT BIO
My research goal is to develop general-purpose models that can follow human instructions to solve tasks in a zero- or few-shot manner. I identify two important directions towards this goal and focus my research on (1) How to effectively acquire knowledge from web-scale data? (2) How to elicit the knowledge stored in pre-trained models to perform downstream tasks?
Presentations

SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales
Tianyang Xu and 6 other authors

R-Tuning: Instructing Large Language Models to Say ‘I Don’t Know’
Hanning Zhang and 8 other authors

Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models
Yangyi Chen and 4 other authors

ViStruct: Visual Structural Knowledge Extraction via Curriculum Guided Code-Vision Representation
Yangyi Chen and 4 other authors

Beat LLMs at Their Own Game: Zero-Shot LLM-Generated Text Detection via Querying ChatGPT
Biru Zhu and 9 other authors

Removing Backdoors in Pre-trained Models by Regularized Continual Pre-training
Yangyi Chen and 8 other authors

A Close Look into the Calibration of Pre-trained Language Models
Yangyi Chen

Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks
Yangyi Chen

Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLP
Yangyi Chen

Exploring the Universal Vulnerability of Prompt-based Learning Paradigm
Lei Xu and 4 other authors

Multi-granularity Textual Adversarial Attack with Behavior Cloning
Yangyi Chen and 2 other authors

Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer
Yangyi Chen

ONION: A Simple and Effective Defense Against Textual Backdoor Attacks
Yangyi Chen

Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger
Fanchao Qi and 2 other authors

Automatic Construction of Sememe Knowledge Bases via Dictionaries
Fanchao Qi and 1 other author