Portugal

ICCC&#39;20

Co-Creativity and Support 2

technical paper

Computational creativity is the art, science, philosophy and engineering of computational systems which, by taking on particular responsibilities, exhibit behaviours that unbiased observers would deem to be creative. As a field of research, this area is thriving, with progress in formalising what it means for software to be creative, along with many exciting and valuable applications of creative software in the sciences, the arts, literature, gaming and elsewhere.

The ICCC conference series organized by the Association for Computational Creativity since 2010 is the only scientific conference that focuses on computational creativity alone and also covers all aspects of it.


ICCC'20

The ICCC conference series organized by the Association for Computational Creativity since 2010 is the only scientific conference that focuses on computational creativity alone and also covers all aspects of it.
Computational creativity is the art, science, philosophy and engineering of computational systems which, by taking on particular responsibilities, exhibit behaviors that unbiased observers would deem to be creative. As a field of research, this area is thriving, with progress in formalizing what it means for software to be creative, along with many exciting and valuable applications of creative software in the sciences, the arts, literature, gaming and elsewhere.



From classifying handwritten digits to generating strings of text, the datasets which have received long-time focus from the machine learning community vary greatly in their subject matter. This has motivated a renewed interest in building datasets which are socially and culturally relevant, so that algorithmic research may have a more direct and immediate impact on society. One such area is in history and the humanities, where better and relevant machine learning models can accelerate research across various fields. To this end, newly released benchmarks and models have been proposed for transcribing historical Japanese cursive writing, yet for the field as a whole using machine learning for historical Japanese artworks still remains largely uncharted. To bridge this gap, in this work we propose a new dataset KaoKore which consists of faces extracted from pre-modern Japanese artwork. We demonstrate its value as both a dataset for image classification as well as a creative and artistic dataset, which we explore using generative models. Dataset available at https://github.com/rois-codh/kaokore

KaoKore: A Pre-modern Japanese Art Facial Expression Dataset

In his work “Mere Generation: Essential Barometer or Dated Concept?”, Ventura (Ventura 2016) categorizes creative processes along a spectrum of increasing creativity. While the spectrum provides insight into the dimensions through which creativity can be augmented, it does not of itself provide insights into how to advance a system through these dimensions. In this paper, we present some theoretical and practical insights on advancing along one commonly problematic rung of this ladder, namely from a system that exhibits generalization (i.e., the ability to generalize beyond an inspiring set) to a system that exhibits filtration (i.e., the ability to self-evaluate and filter results). One potential challenge in this transition is that filtration requires having a sufficiently large number of solutions to filter from the generalizing model. We propose that one solution to this problem is achieved not through increasing the size of the inspiring set (an obvious solution that brings additional problems), but rather through amplifying the generalization of the system to produce a greater set of novel artefacts to filter. We compare a new version of a system, NhMMonic, for generating creative mnemonic devices with a new conceptualization model that allows greater generalization. We demonstrate how filtration, which was not possible in the early version of NhMMonic, only becomes feasible with the more generalizable model.

A Leap of Creativity: From Systems that Generalize to Systems that Filter

With its ability to capture, model, and generate real-and-virtual combined environments, Extended Reality (XR) opens unique opportunities for designing creative agents. In this paper, we present HeyLo, a system for generating meaningful, visual conversation cues in XR. HeyLo autonomously analyzes user tweets to identify common interests and visualizes these interests as conversation cues using emoji. We argue that this system demonstrates creativity using four metrics that characterize novelty, value, and intentionality in the domain of conversation cues: specificity, inter- and intra-user variance, and relevance. We discuss several potential research questions that we hope to answer in the future using this system and the broader implications of a creative system that is capable of bridging arbitrary interests to innovate its own creative ideas.

Exploring CC in XR: Visualizing Creative Conversation Topics to Facilitate Meaningful Face-to-Face Interaction

This paper presents a large dataset of drum patterns and compares two different architectures of artificial neural networks that produce latent explorable spaces with some recognizable genre areas. Adversarially constrained autoencoder interpolations (ACAI) show better results in comparison with a standard variational autoencoder. To our knowledge, this is the first application of ACAI to drum-pattern generation.

Drum Beats and Where To Find Them: Sampling Drum Patterns from a Latent Space

"To a human storyteller, a story is more than a textual artifact. Rather, as stories are both generated and generative, each is also a blueprint for performances to come. Tellers must draw on their own bodily affordances – from voice and gesture to
movement around a stage – to bring stories to life, much as a conductor and an orchestra must translate a written score into actual music.
This work explores the creative challenge of translating from a story-text to a story-performance, from words to physical actions and characters to embodied actors. The mapping requires distinct models for gesture, narration, orientation, 
dialogue and stage direction if computer-generated tales are to transcend the limitations of their production process. Using the Scéalability framework, we evaluate the interlocking role of spatial metaphor and pantomime in turning a narrative artifact into a coherent performance."

Show, Don’t (Just) Tell: Embodiment and Spatial Metaphor in Computational Story-Telling

High-quality human-created artifacts are distinguished by cohesion and semantic richness that can be difficult for computational systems to emulate effectively. Certain classes of artifacts feature relationships between their constituent elements (e.g. words in a story) that naturally form a hierarchical structure that underpins the artifact's meaning. We formalize a tractable method for programmatically extracting such artifacts' structures framed in hierarchical Bayesian program learning (HBPL) and present HIEROS, a creative system that uses linguistic and semantic structures---collectively called formats---extracted from human-written six-word stories to guide the creation of novel stories. We describe how HIEROS infers formats from exemplar stories, how those formats inform its selection of words when writing novel stories, and how the system evaluates its stories to search for high-quality output. We present and evaluate stories HIEROS has written and discuss how our format model enhances the system's creativity.

Creating Six-word Stories via Inferred Linguistic and Semantic Formats

We present a methodology to understand and name, from a computational creativity perspective, the agency of algorithm and artists in  interactive processes. It consists in first analysing precisely the algorithm creation and then the back and forth creative loop during the interaction. We focus on a particular inteactive setting and in which a painter and various neural style transfer algorithms interact on a real canvas. We gather a set of paired painting-pictures images and analyse the style transfer  predictivity. Then, in the creative interaction , the algorithm outputs were perceived as a source of inspiration for human painters, portraying the machine as a \textit{computational catalyst}.

Interactive neural style transfer with artists

Modular creative systems employ specialized modules that take on challenging responsibilities. Such modules can be expensive to develop and are often imperfect, leading to uncertainty in whether a system's poor results are due to module imperfection or larger systemic issues. Computational creativity research would benefit from a method for validating the design of creative systems before expending development resources implementing them. We present ideal-module prototyping (IMP), a design validation paradigm that serves these needs by using modules that delegate responsibilities to humans as an ideal against which to compare system expectations and performance. We relate an experiment we conducted in applying IMP to an existing creative system to demonstrate the insights that can be gained from this method. We argue for the widespread adoption of modular creative system design validated by ideal-module prototyping.

Humans in the Black Box: A New Paradigm for Evaluating the Design of Creative Systems

Not all knowledge is created equal. A hierarchical architecture is a method to classify knowledge for use in the field of human cognition and computational creativity. This paper introduces an Insight-Knowledge Object (IKO) model as a framework for Artificial Creative Intelligence (ACI), a step forward in the pursuit of replicating general human intelligence with computing machinery. To achieve ACI, it is hypothesized that a fundamental rethinking of the architecture of human cognition and knowledge processing is required. One possible novel architecture could be the IKO model. The authors include a description of on-going work at Carnegie Mellon University that applies the IKO model in practice with an artificial music improvisation embodiment.

Artificial Creative Intelligence: Breaking the Imitation Barrier

"Neural style transfer is a popular deep learning algorithm to generate images to mimic human artistry. This work applies the psychological method of the two-alternative forced choice (2afc) task to measure aesthetic preferences for neural style generated images.
Portrait photos of three popular celebrities were generated by varying three parameters of neural style transfer in five configuration levels. Participants had to choose the image they preferred aesthetically from all pairwise combinations of con-figurations per style. The rate of being chosen was calculated for each neural style transfer configuration level. The findings show a differentiated picture of aesthetic preferences. On the one side, they indicate that people prefer images rendered with 500 iterations and a learning rate of 2e1, i.e. configurations that allow them to recognize the structure of the portrait image despite the stylization. On the other side, aesthetic preferences peak for two distinctly differ-ent content-to-style weight ratios. Whereas the medium-high configuration (100:100) may be favored by people who like abstract arts, the high configuration (300:100) may be chosen by people who prefer realistic art.
These results indicate that aesthetic preferences for neural style transfer-generated images can be characterized by unique pat-terns, and their optimal configuration levels can be captured by the 2afc task. "

Co-Creativity and Support 2

Downloads

Next from ICCC'20

KaoKore: A Pre-modern Japanese Art Facial Expression Dataset

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Co-Creativity and Support 2

.css-70qvj9{display:-webkit-box;display:-webkit-flex;display:-ms-flexbox;display:flex;-webkit-align-items:center;-webkit-box-align:center;-ms-flex-align:center;align-items:center;}Downloads

Next from ICCC'20

KaoKore: A Pre-modern Japanese Art Facial Expression Dataset

Stay up to date with the latest Underline news!

PRESENTATIONS

CONFERENCES

COMPANY

RESOURCES

Downloads