United States

Code summarization and generation empower conversion between programming language(PL) and natural language (NL), while code translation avails the migration of legacy code from one PL to another. This paper introduces PLBART, a sequence-to-sequence model capable of performing a broad spectrum of program and language understanding and generation tasks. PLBART is pre-trained on an extensive collection of Java and Python functions and associated NL text via denoising autoencoding. Experiments on code summarization in the English language, code generation, and code translation in seven programming languages show that PLBART outperforms or rivals state-of-the-art models. Moreover, experiments on discriminative tasks,e.g., program repair, clone detection, and vulnerable code detection, demonstrate PLBART’s effectiveness in program understanding. Furthermore, analysis reveals that PLBART learns program syn-tax, style (e.g., identifier naming convention), logical flow (e.g., if block inside an else block is equivalent to else if block) that are crucial to program semantics and thus excels even with limited annotations.

NAACL 2021

Unified Pre-training for Program Understanding and Generation

2021 Annual Conference of the North American Chapter of the Association for Computational Linguistics.

**Whova App** 
Stay in touch with your fellow conference attendees via the [Whova App](https://whova.com/portal/webapp/nacon_202106/)

**Conference Structure**
https://2021.naacl.org/blog/conference-structure/

**Walkthrough video of how to NAACL 2021** 

Please take a moment to view this video explaining how to navigate the platform, attend sessions network with other attendees. 


<figure class="video_container">
  <iframe src="https://screencast-o-matic.com/watch/crhwbGVh3vx?v=6&ff=1&title=0&controls=1" width=640  height=350  frameborder="0" allowfullscreen="true"> </iframe>
</figure>

<br>
<br>

technical paper

Challenging distributional models with a conceptual network of philosophical terms

KILT: a Benchmark for Knowledge Intensive Language Tasks

WEC: Deriving a Large-scale Cross-document Event Coreference dataset from Wikipedia

Evaluating Document Coherence Modelling

Beyond Black & White: Leveraging Annotator Disagreement via Soft-Label Multi-Task Learning

UDALM: Unsupervised Domain Adaptation through Language Modeling

Variance-reduced First-order Meta-learning for Natural Language Processing Tasks

A Survey on Recent Approaches for Natural Language Processing in Low-Resource Scenarios

Temporal Knowledge Graph Completion using a Linear Temporal Regularizer and Multivector Embeddings

Diversity-Aware Batch Active Learning for Dependency Parsing

https://d3smihljt9218e.cloudfront.net/transcript/13739/subtitle/6b1ecc2541bb47f0704d7ae3d7e03241.vtt

English (automatic)

Unified Pre-training for Program Understanding and Generation

Downloads

Next from NAACL 2021

Challenging distributional models with a conceptual network of philosophical terms

Similar lecture

On the Transformer Growth for Progressive BERT Training

VIDEO LIBRARY

EVENTS

COMPANY

RESOURCES