Taiwan

IJCNLP-AACL 2022

Assessing Resource-Performance Trade-off of Natural Language Models using Data Envelopment Analysis

operations research

data envelopment analysis

linear programming

Naval Information Warfare Center Pacific is partnering with AFCEA San Diego chapter to host the workshop.

The NAML workshop is an opportunity for researchers from Navy research and development centers and our partner organizations to exchange technical ideas and to come together as a team.

The goals of NAML are:

* To spread awareness of current machine learning research relevant to Naval applications

* To connect machine learning researchers with experts in military requirements

* To build and strengthen collaborations within the defense research community

**Watch this video to hear about the AFCEA purpose.**

<iframe width=1280 height=706 frameborder="0" scrolling="no" src="https://screencast-o-matic.com/player/creleVVcvRh?v=6&ff=1&title=0&controls=1" allowfullscreen="true"></iframe>

NAML 2021

workshop paper

The AACL, Asia-Pacific Chapter of the Association for Computational Linguistics, and the AFNLP, Asian Federation of Natural Language Processing, invite you to participate in the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL) and the 10th International Joint Conference on Natural Language Processing (IJCNLP). 
<br>
<br>

A registration is required to access this event. Access to the event site will be granted to all registered attendees on **November 16th**. If you have not already done so, please register using the link below:
<br>
<br>https://conference.iis.sinica.edu.tw/servlet/Register?ConferenceID=411

Registration Is Required

The AACL, Asia-Pacific Chapter of the Association for Computational Linguistics, and the AFNLP, Asian Federation of Natural Language Processing, invite you to participate in the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL) and the 10th International Joint Conference on Natural Language Processing (IJCNLP). 

Utilizing citations for research artifacts (e.g., dataset, software) in scholarly papers contributes to efficient expansion of research artifact repositories and various applications e.g., the search, recommendation, and evaluation of such artifacts. This study focuses on citations using URLs (URL citations) and aims to identify and analyze research artifact citations automatically. We addressed the classification task for each URL citation to identify (1) the role that the referenced resources play in research activities, (2) the type of referenced resources, and (3) the reason why the author cited the resources. We propose the classification method using section titles and footnote texts as new input features. We extracted URL citations from international conference papers as experimental data. We performed 5-fold cross-validation using the data and computed the classification performance of our method. The results demonstrate that our method is effective in all tasks.

Classification of URL Citations in Scholarly Papers for Promoting Utilization of Research Artifacts

We present a publicly available corpus with detailed annotations describing the core elements of clinical trials: Participants, Intervention, Control, and Outcomes. The corpus consists of 1011 abstracts of breast cancer randomized controlled trials extracted from the PubMed database. The corpus improves previous corpora by providing detailed annotations for outcomes to identify numeric texts that report the number of participants that experience specific outcomes. The corpus will be helpful for the development of systems for automatic extraction of data from randomized controlled trial literature to support evidence-based medicine. Additionally, we demonstrate the feasibility of the corpus by using two strong baselines for named entity recognition task. Most of the entities achieve F1 scores greater than 0.80 demonstrating the quality of the dataset.

PICO Corpus: A Publicly Available Corpus to Support Automatic Data Extraction from Biomedical Literature

Current neural network solutions in scientific document processing employ models pretrained on domain-specific corpi, which are usually limited in model size, as pretraining can be costly and limited by training resources. We introduce a framework that uses data augmentation from such domain-specific pretrained models to transfer domain-specific knowledge to larger general pretrained models and im- prove performance on downstream tasks. Our method improves the performance of Named Entity Recognition in the astrophysical domain by more than 20% compared to domain-specific pretrained models finetuned to the target dataset.

Domain Specific Augmentations as Low Cost Teachers for Large Students

arXiv and Information Extraction

On the portability of extractive Question-Answering systems on scientific papers to real-life application scenarios

Tracking state-of-the-art (SOTA) results in machine learning studies is challenging due to high publication volume. Existing methods for creating leaderboards in scientific documents require significant human supervision or rely on scarcely available LaTeX source files. We propose Table Entity LINker (TELIN), a framework which extracts (task, model, dataset, metric) quadruples from collections of scientific publications in PDF format. TELIN identifies scientific named entities, constructs a knowledge base, and leverages human feedback to iteratively refine automatic extractions. TELIN identifies and prioritizes uncertain and impactful entities for human review to create a cascade effect for leaderboard completion. We show that TELIN is competitive with the SOTA but requires much less human annotation.

TELIN: Table Entity LINker for Extracting Leaderboards from Machine Learning Publications

This corpus contains more than 30,000 classical Chinese poems in their tokenized form. The poems are from the Complete Tang Poems (全唐詩,CTP) and the Complete Song Poems (全宋詩,CSP). Two groups of annotators from two universities carried out the task. More than 5000 of these poems were annotated repeatedly for the inter-rater agreement analysis. The annotators did not agree with each other perfectly, as many readers may have expected, but the degrees and types of their agreements are worthy of discussion. The annotations support some comments, of the Ming dynasty, about the formats of the poems. We applied machine learning methods to train and test their usability for the tokenization task. We could identify 87% of the words, 77% of the whole lines, and 18% of the whole poems in the CTP correctly. We have expanded the scale of our annotated poems, have extended our exploration with deep learning methods, and we wish to report these extensions in a formal report.

Introducing a Large Corpus of Tokenized Classical Chinese Poems of Tang and Song Dynasties

Research has shown that the practice of translation exhibits predictable linguistic cues that make translated texts distinguishable from original-language texts (a phenomenon known as "translationese"). In this paper, we test the extent to which literary translations are subject to the same effects and whether they also exhibit meaningful differences at the level of content. Research into the function of translations within national literary markets using smaller case studies has suggested that translations play a cultural role that is distinct from that of original-language literature, i.e. their differences reside not only at the level of translationese but at the level of content. Using a dataset consisting of original-language fiction in English and translations into English from 120 languages (N=21,302), we find that one of the principal functions of literary translation is to convey predictable geographic identities to local readers that nevertheless extend well beyond the foreignness of persons and places.

The predictability of literary translation

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-tutorials.4/)


Grounding Meaning Representation for Situated Reasoning

To view the proceedings, please [click here](https://aclanthology.org/2022.aacl-tutorials.5/)


Assessing Resource-Performance Trade-off of Natural Language Models using Data Envelopment Analysis

Downloads

Next from IJCNLP-AACL 2022

Classification of URL Citations in Scholarly Papers for Promoting Utilization of Research Artifacts

Similar lecture

Forecasting Obsolescence Model Optimization

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Assessing Resource-Performance Trade-off of Natural Language Models using Data Envelopment Analysis

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from IJCNLP-AACL 2022

Classification of URL Citations in Scholarly Papers for Promoting Utilization of Research Artifacts

Similar lecture

Forecasting Obsolescence Model Optimization

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Downloads