Language model prompt optimization research has shown that semantically and grammatically well-formed manually crafted prompts are routinely outperformed by automatically generated token sequences with no apparent meaning or syntactic structure, including sequences of vectors from a model's embedding space. We use machine-generated prompts to probe how models respond to input that is not composed of natural language expressions. We study the behavior of models of different sizes in multiple semantic tasks in response to both continuous and discrete machine-generated prompts, and compare it to the behavior in response to human-generated natural-language prompts. Even when producing a similar output, machine-generated and human prompts trigger different response patterns through the network processing pathways, including different perplexities, different attention and output entropy distributions, and different unit activation profiles. We provide preliminary insight into the nature of the units activated by different prompt types, suggesting that only natural language prompts recruit a genuinely linguistic circuit.

Unnatural language processing: How do language models handle machine-generated prompts? | VIDEO

Deep nets are great, and they would be even greater if they could collaborate with each other through a flexible communication protocol. Since many networks come equipped with language model interfaces--that is, they can process and produce tokens in English (or other languages)--it makes sense to look into natural language as a universal neural network communication protocol. The questions I would like to discuss in my talk, then, are the following: 
* What are the challenges we face in developing a universal language interface among deep networks?
* What do we currently know about the way in which deep nets are using language to interact in machine-to-machine communication scenarios?
* Which characteristics of human linguistic communication do we expect or wish machine-to-machine communication to possess? Should it be essentially the same as human-to-human (and human-to-machine) communication?

Machine-to-machine communication: Do we need it? What should it be like? Is it "language"?

**Workshop Organizers:** ‎‎Najoung Kim, Yiding Hao, Jaap Jumelet, Hosein Mohebbi, Yonatan Belinkov and Arya D. McCarthy
 *Coffee Break 10:30 am* 
*Lunch Break 12:30 pm* 
*Coffee Break 3:30 pm* [**Workshop Website**](https://blackboxnlp.github.io/) The goal of this workshop is to bring together researchers focused on interpreting and explaining NLP models by taking inspiration from fields such as machine learning, psychology, linguistics, and neuroscience. We hope the workshop will serve as an interdisciplinary meetup that allows for cross-collaboration. [**Invited Speakers**](https://blackboxnlp.github.io/)
 [**Go to Gather**](https://app.gather.town/app/ROH1myZvp9ba7a3C/EMNLP2023?spawnToken=aK5bTdG4Q_S9rpKXfq1O)

W14: BlackboxNLP 2023: The 6th Workshop on Analysing and Interpreting Neural Networks for NLP

workshop paper

**Welcome to EMNLP 2023!**

On behalf of the EMNLP 2023 Organizing Committee, I extend a warm and heartfelt welcome to all of you to the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP). It is with immense pleasure and excitement that we gather here in Singapore, a vibrant hub of innovation and technological advancement.

The conference program is packed with insightful presentations, thought-provoking workshops, and engaging networking opportunities. In addition to the technical sessions, we have also planned several social events that will provide you with the opportunity to connect with your colleagues.

The conference is held in person at the Resorts World Convention Centre in Singapore, and available on-line with the help of Underline.

For those in Singapore, I hope that you will find time to explore the exciting Sentosa Island, Gardens by the Bay, Singapore Botanic Gardens and the many other attractions unique to Singapore.

Of course, we are grateful to our sponsors and partners for their generous support of EMNLP 2023, whose contributions make it possible for us to host this world-class event.

Yuji Matsumoto (RIKEN AIP) 
EMNLP 2023 General Chair

To access the **EMNLP 2023** event page on Underline, you need to register for the Conference. 
Please follow **[this link](https://2023.emnlp.org/registration/)** for more details.

EMNLP 2023

EMNLP 2023 took place in Singapore from Dec 6th to Dec 10th, 2023.

**Title:** Machine-to-machine communication: Do we need it? What should it be like? Is it "language"? **Chair:** Leo Wanner 
**Description:** Deep nets are great, and they would be even greater if they could collaborate with each other through a flexible communication protocol. Since many networks come equipped with language model interfaces--that is, they can process and produce tokens in English (or other languages)--it makes sense to look into natural language as a universal neural network communication protocol. The questions I would like to discuss in my talk, then, are the following: 
* What are the challenges we face in developing a universal language interface among deep networks?
* What do we currently know about the way in which deep nets are using language to interact in machine-to-machine communication scenarios?
* Which characteristics of human linguistic communication do we expect or wish machine-to-machine communication to possess? Should it be essentially the same as human-to-human (and human-to-machine) communication?

Invited talk 3 - Marco Baroni 

keynote

[![](https://assets.underline.io/uploads/markdown_image/1/image/81a3c0317d24f663b49b996875024d45.png)](https://aclanthology.org/volumes/2022.coling-1/)



### THE CONFERENCE WE KNOW AND WE WANT.
**COLING**, the International Conference on Computational Linguistics, is one of the premier conferences for the natural language processing and computational linguistics.

First established in 1965, the biennial COLING conference is held in diverse parts of the globe and attracts participants from both top-ranked research centers and emerging countries. Today, the most important developments in our field are taking place not only in universities and academic research institutes but also in industrial research departments including tech-startups. COLING provides opportunities for all these communities to showcase their exciting discovery.

In fall of 2022, COLING will be held in Gyeongju in a hybrid format. All participants can either present at the venue site or join virtually. As more people get vaccinated, we are happy to provide safer environments for our colleagues. We believe that COLING 2022 will be one of the conferences, free from the pandemic. The hybrid format gives presenters and sponsors a valuable opportunity to promote their companies in both an online and in-person venue. For the first time in a long time, customers can interact with their sponsor's products first-hand. The online venue, too, gives sponsors the chance to network with those unable to attend the in-person session.

The hybrid format ultimately lends itself to greater exposure for our sponsors: COLING2022 will let you reach more potential partners and customers than ever before!

To gain access to this event page you are required to register. Find more information and pay the registration fee on event the organizer’s website **[https://coling2022.org/reg](https://coling2022.org/reg)**

COLING 2022

COLING, the International Conference on Computational Linguistics, is one of the premier conferences for the natural language processing and computational linguistics.

Marco Baroni

2

20

SHORT BIO

Presentations

Unnatural language processing: How do language models handle machine-generated prompts? | VIDEO

Machine-to-machine communication: Do we need it? What should it be like? Is it "language"?

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES