Russian Federation

A novel approach to automated learning of syntactic rules governing natural languages is proposed, based on using probabilities assigned to sentences (and potentially longer word sequences) by trans-former neural network language models to guide symbolic learning processes like clustering and rule induction. This method exploits the learned linguistic knowledge in transformers, without any reference to their inner representations; hence, the technique is readily adaptable to the continuous appearance of more powerful language models.

AGI-20

Guiding Symbolic Natural Language Grammar Induction via Transformer-Based Sequence Probabilities

grammar induction

unsupervised learning

transformers

## Welcome to NAACL 2022!
The Annual Meeting of the North American Chapter of the Association for Computational Linguistics (NAACL) is taking place July 10-15, 2022 as a hybrid event, in Seattle, WA and online. We are happy to welcome all of you to conference! 
 
The main conference program features oral presentations, in-person and virtual posters and demo sessions, a plenary session for our best paper presentations and awards, keynote presentations, a plenary panel on the place of linguistics and symbolic structures in NLP, and an Industrial Track panel on Careers in NLP.
 
Posters (including Findings of NAACL 2022) and demos are grouped by areas for both the in-person and the virtual sessions. For the virtual component, the talks will be on Zoom and the posters and the demos will be in GatherTown. The Student Research Workshop and will have an oral session and a poster session.
 
The program also features 6 Tutorials and 26 Workshops.
 
 We wish you a wonderful conference!
 
[The NAACL 2022 Organizing Committee](https://2022.naacl.org/committees/organization/)

NAACL 2022

2022 Annual Conference of the North American Chapter of the Association for Computational Linguistics

technical paper

The AGI conference series is the only major conference series devoted wholly and specifically to the creation of AI systems possessing general intelligence at the human level and ultimately beyond. By gathering together active researchers in the field, for presentation of results and discussion of ideas, we accelerate our progress toward our common goal.

Underline hosted the two main days of AGI 2020 on Wednesday June 24th and Thursday June 25th. Both days were **live-streamed** and you can read the full program bellow. All presentations are available for a **asynchronous viewing**. All presenters are grouped into panels. You can also hear guest talks by **Ben Goertzel** (SingularityNET), **Valery Tarasov** (Semenov Institute of Chemical Physics), **Tatiana Shavrina** (Sberbank) and **Joscha Bach** (MIT Media Lab). 

The AGI conference series is the only major conference series devoted wholly and specifically to the creation of AI systems possessing general intelligence at the human level and ultimately beyond. By gathering together active researchers in the field, for presentation of results and discussion of ideas, we accelerate our progress toward our common goal.

"The complex socio-technological debate underlying safety critical and ethically relevant issues pertaining to AI development and deployment extends across heterogeneous research subfields and involves in part conflicting positions. In this context, it seems expedient to generate a minimalistic joint transdisciplinary basis disambiguating the references to specific subtypes of AI properties and risks for an error-correction in the transmission of ideas. In this paper, we introduce a high-level trans-disciplinary system clustering of ethical distinction between antithetical
clusters of Type I and Type II systems which extends a cybersecurity oriented AI safety taxonomy with considerations from psychology. Moreover, we review relevant Type I AI risks, reflect upon possible epistemological origins of hypothetical Type II AI from a cognitive sciences perspective and discuss the related human moral perception. Strikingly, our nuanced transdisciplinary analysis yields the figurative formulation of the so-called AI safety paradox identifying AI control and value alignment as conjugate requirements in AI safety. Against this backdrop, we craft
versatile multidisciplinary recommendations with ethical dimensions tailored to Type II AI safety. Overall, we suggest proactive and importantly corrective instead of prohibitive methods as common basis for both Type I and Type II AI safety."

Error-Correction for AI Safety

The videogame platform Teleport created earlier allows us to study anonymous social interactions among actors of various nature: human and virtual actor, ensuring their indistinguishability, which implies believable behavior of a virtual actor. The present study found a connection between the human player behavior in the Teleport game and her psychological portrait constructed using the sixteen-factor Catell personality test for empathy. Assuming that this connection is extendable to perception of virtual actor behavior, the game sessions data was analyzed to infer behavioral characteristics of virtual actors. Based on this data analysis, we constructed psychological characteristics of models of a virtual actor (a bot). Partner and emotional characteristics of bots were defined, and their psychological portrait was constructed based on the registered bot behavior. Personal characteristics such as courage, sociability, calmness, balance, and loyalty were attributed to bots and compared to analogous characteristics of human players.

Psychological Portrait of a Virtual Agent in the Teleport Game Paradigm

"No fundamental new ideas have appeared in AI for decades because of a deadlocked discussion between the technologists and their philosophical critics. Both sides claim possession of the one (dogmatic) truth: Technologists are committed to writing code, while critics insist that AI bears no resemblance to how humans cope in the world. The book charts a middle course between the critics and practitioners of AI, remaining committed to writing code while maintaining a fixed gaze on the human condition. This is done by reviving a technique long-shunned in cognitive science: Introspection. Introspection was rejected as a scientific method since 1913, but technology is committed to “what works” rather than to science’s “best explanation”. Introspection is shown to be both a legitimate and a promising source of ideas for AI. The book details the development process of AI based on introspection, from the initial introspective descriptions to working code.
This book is unique in that it starts with philosophical (and historical) discussions, and ends with examples of working novel algorithms. The book was originally a PhD thesis. It was edited for book form with two new chapters added."

Report on “AI and Human Thought and Emotion”

Central scholars in AI have argued for extending the search for new AI technology beyond the tried-and-tested biologically and mathematically-inspired algorithms. Following in their footsteps, areas in the humanities are introduced as possible inspirations for novel human-like AI. Topics discussed include play-acting, literature as the field researching both imagination and metaphors, linguistics, music, and hermeneutics. In our ambition to reach general intelligence, we cannot afford to ignore these avenues of research.

AGI Needs the Humaities

Social virtual actors need to interact with users emotionally, convincing them in their ability to understand human minds. For this to happen, an artificial general emotional intelligence is needed, capable of believable behavior in real-life situations. Summarizing recent work of the authors, the present work extends the general state-of-the-art framework of emotional AGI, using the emotional Biologically Inspired Cognitive Architecture (eBICA) as a basis. In addition to appraisals, other kinds of fluents are added to the model, including somatic markers, feelings, emotional biases, moods, etc. Their integration is achieved based on semantic maps and moral schemas. It is anticipated that the proposed new level of artificial general socially emotional intelligence will complement the next-generation AGI, helping it to merge into our society on equal with its human members.

Toward a General Believable Model of Human-Analogous Intelligent Socially Emotional Behavior

The DeepWalk algorithm is used to assign embedding vec- tors to nodes in the Atomspace weighted, labeled hypergraph that is used to represent knowledge in the OpenCog AGI system, in the con- text of an application to probabilistic inference regarding the causes of longevity based on data from biological ontologies and genomic analyses. It is shown that vector difference operations between embedding vectors are, in appropriate conditions, approximately alignable with “intensional difference” operations between the hypergraph nodes corresponding to the embedding vectors. This relationship hints at a broader functorial mapping between uncertain intensional logic and vector arithmetic, and opens the door for using embedding vector algebra to guide intensional inference control.

Embedding Vector Differences Can Be Aligned With Uncertain Intensional Logic Differences

What kind of programming language would be most appropriate to serve the needs of integrative, multi-paradigm, multi-software-system approaches to AGI? This question is broached via exploring the more particular question of how to create a more scalable and usable version of the ”Atomese” programming language that forms a key component of the OpenCog AGI design (an ”Atomese 2.0”) .

What Kind of Programming Language Best Suits Integrative AGI?

A novel computational model (CoDD) utilizing combinatory logic to create higher-order decision trees is presented. A theoretical analysis of general intelligence in terms of the formal theory of pattern recognition and pattern formation is outlined, and shown to take especially natural form in the case where patterns are expressed in CoDD language. Relationships between logical entropy and algorithmic information, and Shannon entropy and runtime complexity, are shown to be elucidated by this approach. Extension to the quantum computing case is also briefly discussed.

Combinatorial Decision Dags: A Natural Computational Model for General Intelligence

While several tools exist for training and evaluating narrow machine learning (ML) algorithms, their design generally does not follow a particular or explicit evaluation methodology or theory. Inversely so for more general learners, where many evaluation methodologies and frameworks have been suggested, but few specific tools exist. In this paper we introduce a new framework for broad evaluation of artificial intelligence (AI) learners, and a new tool that builds on this methodology. The platform, called SAGE (Simulator for Autonomy \& Generality Evaluation), works for training and evaluation of a broad range of systems and allows detailed comparison between narrow and general ML and AI. It provides a variety of tuning and task construction options, allowing isolation of single parameters across complexity dimensions. SAGE is aimed at helping AI researchers map out and compare strengths and weaknesses of divergent approaches. Our hope is that it can help deepen understanding of the various tasks we want AI systems to do and the relationship between their composition, complexity, and difficulty for various AI systems, as well as contribute to building a clearer research road map for the field. This paper provides an overview of the framework and presents results of an early use case.

SAGE: Task-Environment Platform for Evaluating a Broad Range of AI Learners

We introduce the open-ended, modular, self-improving Omega AI unification architecture which is a refinement of Solomonoff's Alpha architecture, as considered from first principles. The architecture embodies several crucial principles of general intelligence including diversity of representations, diversity of data types, integrated memory, modularity, and higher-order cognition. We retain the basic design of a fundamental algorithmic substrate called an ``AI kernel'' for problem solving and basic cognitive functions like memory, and a larger, modular architecture that re-uses the kernel in many ways. Omega includes eight representation languages, which are briefly introduced. We review the broad software architecture, higher-order cognition, self-improvement, modular neural architectures, and intelligent agents.

Guiding Symbolic Natural Language Grammar Induction via Transformer-Based Sequence Probabilities

Downloads

Next from AGI-20

Error-Correction for AI Safety

Similar lecture

Mask and Regenerate: A Classifier-based Approach for Unpaired Sentiment Transformation of Reviews for Electronic Commerce Websites

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Guiding Symbolic Natural Language Grammar Induction via Transformer-Based Sequence Probabilities

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from AGI-20

Error-Correction for AI Safety

Similar lecture

Mask and Regenerate: A Classifier-based Approach for Unpaired Sentiment Transformation of Reviews for Electronic Commerce Websites

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Downloads