
Tianxiang Sun
pre-trained language model
bert
prompt tuning
evaluation
benchmark
pre-training
text generation
knowledge graph
few-shot learning
large language models
relation extraction
representation learning
sentence-level semantics
social bias
language models
13
presentations
3
number of views
SHORT BIO
Tianxiang Sun is a 4th-year Ph.D. student at the NLP Lab at Fudan University, advised by Prof. Xipeng Qiu and Prof. Xuanjing Huang. Tianxiang's research interests lie in the field of Machine Learning and Natural Language Processing, particularly in pre-trained language models and their optimization-, inference-, and data-efficient methods.
Presentations

Turn Waste into Worth: Rectifying Top-$k$ Router of MoE
Zhiyuan Zeng and 9 other authors

AnyGPT: Unified Multimodal LLM with Discrete Sequence Modeling
Jun Zhan and 15 other authors

LLM can Achieve Self-Regulation via Hyperparameter Aware Generation
Siyin Wang and 8 other authors

Flames: Benchmarking Value Alignment of LLMs in Chinese
Kexin Huang and 11 other authors

LLatrieval: LLM-Verified Retrieval for Verifiable Generation
Xiaonan Li and 5 other authors

CodeIE: Large Code Generation Models are Better Few-Shot Information Extractors
Peng Li and 1 other author

Multitask Pre-training of Modular Prompt for Chinese Few-Shot Learning
Tianxiang Sun and 4 other authors

DiffusionBERT: Improving Generative Masked Language Models with Diffusion Models
Zhengfu He and 1 other author

BERTScore is Unfair: On Social Bias in Language Model-Based Metrics for Text Generation
Tianxiang Sun

BBTv2: Towards a Gradient-Free Future with Large Language Models
Tianxiang Sun

A Simple Hash-Based Early Exiting Approach For Language Understanding and Generation
Tianxiang Sun and 9 other authors

CoLAKE: Contextualized Language and Knowledge Embedding
Tianxiang Sun

DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning
Xinghao Wang and 5 other authors