Current neural network solutions in scientific document processing employ models pretrained on domain-specific corpi, which are usually limited in model size, as pretraining can be costly and limited by training resources. We introduce a framework that uses data augmentation from such domain-specific pretrained models to transfer domain-specific knowledge to larger general pretrained models and im- prove performance on downstream tasks. Our method improves the performance of Named Entity Recognition in the astrophysical domain by more than 20% compared to domain-specific pretrained models finetuned to the target dataset.

Domain Specific Augmentations as Low Cost Teachers for Large Students

Logical structure recovery in scientific articles associates text with a semantic section of the article. Although previous work has disregarded the surrounding context of a line, we model this important information by employing line-level attention on top of a transformer-based scientific document processing pipeline. With the addition of loss function engineering and data augmentation techniques with semi-supervised learning, our method improves classification performance by 10% compared to a recent state-of-the-art model. Our parsimonious, text-only method achieves a performance comparable to that of other works that use rich document features such as font and spatial position, using less data without sacrificing performance, resulting in a lightweight training pipeline.

Lightweight Contextual Logical Structure Recovery

[![](https://assets.underline.io/uploads/markdown_image/1/image/fa066bd3696d61289bf9217fc0e3f64e.png)](https://zoom.us/rec/play/8onUtAb7Bn7_pODVmCNcXuafSKjmVvye33w9oZ3c3vCm7Ln-0tcB8oVaoWsI93o1fnV1g-7RwLFomWY.ehdiv5McYi-nrKW1?autoplay=true&startTime=1668958212000) 

[![](https://assets.underline.io/uploads/markdown_image/1/image/f34062db3f5ffa4d48aa0635e5f22a87.png)](https://zoom.us/rec/play/ZEFoEo89MnuE9QLT96_tu_owR3a_aldaXq9OCyYm_bkM81wsfAfugWaNVyKzyLeChTakfBKFT1O_cOMD.04LEbdBmYe2OU325?autoplay=true&startTime=1668967245000)
 
 **Workshop Organizers:**
 Tirthankar Ghosal, Sergi Blanco-Cuaresma, Alberto Accomazzi, and Robert Patton

First Workshop on Information Extraction from Scientific Publications (WIESP)

workshop paper

The AACL, Asia-Pacific Chapter of the Association for Computational Linguistics, and the AFNLP, Asian Federation of Natural Language Processing, invite you to participate in the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL) and the 10th International Joint Conference on Natural Language Processing (IJCNLP).

A registration is required to access this event. Access to the event site will be granted to all registered attendees on **November 16th**. If you have not already done so, please register using the link below:
 
 https://conference.iis.sinica.edu.tw/servlet/Register?ConferenceID=411

Registration Is Required

IJCNLP-AACL 2022

The AACL, Asia-Pacific Chapter of the Association for Computational Linguistics, and the AFNLP, Asian Federation of Natural Language Processing, invite you to participate in the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (AACL) and the 10th International Joint Conference on Natural Language Processing (IJCNLP). 

Click on the Live Session Recording to view the session

**Workshop overview:** As the body of scholarly literature grows, automated methods in NLP, text mining, information retrieval, document understanding etc. are needed to address issues of information overload, disinformation, reproducibility, and more. Though progress has been made, there are significant unique challenges to processing scholarly text that require dedicated attention. The goal of this workshop is to provide a venue for addressing these challenges, as well as a platform for tasks and resources supporting the processing of scientific documents. Our long-term objective is to establish scholarly and scientific texts as an essential domain for NLP research, to supplement current efforts on web text and news articles.

This workshop builds on the success of prior workshops: the SDP workshop held at NAACL in 2021 and EMNLP in 2020, and the SciNLP workshop held at AKBC 2020 and AKBC 2021. Both workshops received numerous submissions and were well attended, demonstrating that interest in this area seems to be growing rapidly. In addition to having broad appeal within the NLP community, we expect that the SDP workshop will attract researchers from other relevant fields including meta-science, scientometrics, data mining, information retrieval, and digital libraries, bringing together these disparate communities within the ACL. [**Read more.**](https://sdproc.org/2022/) Our detailed schedule can be viewed [**here.**](https://sdproc.org/2022/program.html)

W8 Third Workshop on Scholarly Document Processing (SDP 2022)

[![](https://assets.underline.io/uploads/markdown_image/1/image/81a3c0317d24f663b49b996875024d45.png)](https://aclanthology.org/volumes/2022.coling-1/)



### THE CONFERENCE WE KNOW AND WE WANT.
**COLING**, the International Conference on Computational Linguistics, is one of the premier conferences for the natural language processing and computational linguistics.

First established in 1965, the biennial COLING conference is held in diverse parts of the globe and attracts participants from both top-ranked research centers and emerging countries. Today, the most important developments in our field are taking place not only in universities and academic research institutes but also in industrial research departments including tech-startups. COLING provides opportunities for all these communities to showcase their exciting discovery.

In fall of 2022, COLING will be held in Gyeongju in a hybrid format. All participants can either present at the venue site or join virtually. As more people get vaccinated, we are happy to provide safer environments for our colleagues. We believe that COLING 2022 will be one of the conferences, free from the pandemic. The hybrid format gives presenters and sponsors a valuable opportunity to promote their companies in both an online and in-person venue. For the first time in a long time, customers can interact with their sponsor's products first-hand. The online venue, too, gives sponsors the chance to network with those unable to attend the in-person session.

The hybrid format ultimately lends itself to greater exposure for our sponsors: COLING2022 will let you reach more potential partners and customers than ever before!

To gain access to this event page you are required to register. Find more information and pay the registration fee on event the organizer’s website **[https://coling2022.org/reg](https://coling2022.org/reg)**

COLING 2022

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for the natural language processing and computational linguistics.

Po-Wei Huang

2

9

SHORT BIO

Presentations

Domain Specific Augmentations as Low Cost Teachers for Large Students

Lightweight Contextual Logical Structure Recovery

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES