• Skip to main content

CentreForMedicalHumanities.org

  • Home
  • Telehealth Analysis
  • Research Translations
  • Evidence Reviews
  • Blog
  • About

Affect Formations: Musical performance with live animations shaped by emotional online survey

posted on February 17, 2025

The Affect Formations project with the Music Department of Durham University explores the relationship between our emotional response to drawings and musical features through several public performances in the North East. Artist Adinda van ’t Klooster is inviting people to complete an online survey and in doing so contribute to an innovative artwork merging music, science and visual art.

International artist Adinda van ‘t Klooster is artist in residence at the Durham University Music Department until April 2015. She is collaborating on two artistic research projects, culminating in two live performances.

Within the first project, the artist creates novel electronic soundscapes designed to evoke emotion, and explore the relationship between sound and emotional affect. Professor Tuomas Eerola, leader in the field of emotion and music, will evaluate the emotional response to these soundscapes. In most previous investigations of music and emotion, Western classical music has dominated, so the use of electronic music is a novelty.

The second project involves the creation of two live audiovisual interfaces with Dr. Nick Collins, Reader in Composition. For the ‘In a State’ performance, a computer captures live audio from an improvising pianist and analyses the emotions expressed in the music. As the emotions change, so do projected abstract animated graphics, based on drawings by the artist. The pianist is accompanied by a computer agent generating its own music in response and the computer’s music is also visualized with further animated graphics. A second piece uses sensors that record physiological responses like heart rate, brainwaves and perspiration. The artist says: “I will then use this data to estimate what the musicians feel: whether they are tense or calm, happy or sad. Then I visualise these emotions through animated drawings. The aim of this work is to provide innovative ways for the computer and human musicians to improvise together in new emotive ways.”

A research survey that looks at how people rate the emotional expression in abstract graphics, created by the artist, is being used to help determine the choice of visual elements in the performances. Please participate in this online survey here.

Two innovative concerts will take place in the North East, one at Durham University on the 27th of February and a second at the Sage Gateshead on the 19th March 2015. More information on the project can be found here.

This residency is made possible by a Leverhulme Trust Artist in Residence grant and a small grant for the arts from the Arts Council England. You can Follow the project for updates and the regular blog on Twitter @AffectFormation and on Facebook at Affect Formations.

Filed Under: Uncategorized

CentreForMedicalHumanities.org is an independent health evidence publication. This site is not a medical practice, healthcare provider, academic institution, or research organization. Nothing on this site constitutes medical advice. Consult a qualified healthcare provider before making decisions about supplements, medications, or health interventions. This website is not affiliated with Durham University, the Institute for Medical Humanities, or any academic or medical institution. The domain name reflects previous ownership history and does not indicate institutional affiliation, academic authority, or endorsement. The Durham Institute for Medical Humanities is an active research institute at Durham University — visit their official page for information about their programs and research. Some content on this site contains affiliate links. Purchases made through these links may generate a commission for this publication at no cost to the reader. See our Evidence Standards page for full disclosure details. Content produced by the CMH Evidence Review editorial team. © 2026 CentreForMedicalHumanities.org. All rights reserved. | About | Our Evidence Standards | Non-Affiliation Notice | Privacy Policy