Local Binaries vs Chromophone

Every person you meet holds a world inside them, what does yours look like? This was the question artist Lauren Moffatt asked nine female-identifying individuals originating from across the world in order to define the blueprints for the universe inside Local Binaries. Drawing inspiration from meditation and art therapy techniques that encourage embodied mindfulness – like body scanning and body mapping – participants were asked to focus on their inner state and interpret it as a landscape. They imagined geological forms, sounds, plant-life, weather systems and architectures to delineate the physiological and psychological sensations they felt. They then relayed the scene to the artist as if describing physical surroundings. The artist recreated elements from each testimonial using a game engine, interweaving them into a sprawling landscape that can be accessed and interacted with via smartphones and other handheld devices. Local Binaries is an augmented reality world that explores the way people experience psychological, physiological and emotional states in a spatial way, as if they were miniature landscapes inside of us. If we search deeply through our experience, is it possible to see our natural and built human world reflected in the cycles and processes of our thoughts and feelings? We could encounter this as a psychological journey into the geography of the mind, but inversely we could also use this thought experiment as an opportunity to look for the parts of the world around us that reflect our inner states – for better or for worse. Following the extended periods of staggered lockdowns seen all over the world over the past 24 months, with the menace of more to come in the future, it seems an appropriate time to look for a vocabulary for describing these tiny worlds we carry around with us, which have grown so much bigger in solitude, and to find a meeting point where we can experience and describe them collectively. Local Binaries was conceived as such a place. Here, on empty roads and pathways we see strange tiny shapes roaming, as we approach with our device we recognize that they are little characters. They may stop and look at us, as we draw closer we may hear them speaking, describing their surroundings, we may see them try to hide, see them engulfed in a tornado or surrounded by sea creatures or swimming through the air. We see them occupying a strange hybrid place built using an eclectic mix of handmade and digitally constructed elements, paint strokes overlaying textures generated by a neural networks. This collaged fantastical space reflects the panorama of human emotion as well as the eclectic nature of our accumulated experiences that color our internal lives, full of contrasting textures, rhythms, and contradictory movements. Visitors are free to roam in Local Binaries. As in nature, there is no beginning and end, no preordained path to be followed. They only need the curiosity and observational skills required to explore its corners to find all of its hidden details: a voyage that will take them on a parallel journey into the colours and contours of their own inner universes. By Lauren Moffatt A project of Stiftung Kunstfonds and Risk Change : MMSU Rijeka Developed with the support of CPH:LAB. Sound Design: Mads Michelsen Interaction Programming: Mohsen Hazrati Sculpting Assistant: Marion Serclérat

Chromophone turns whatever is playing in the room into a living psychedelic picture. Play, sing, or put a record on: the visuals follow the sound as it happens. Every frame is built from the sound arriving right now. Low frequencies swing the whole shape, mids and highs cut the detail, sharp hits snap the pattern into a new one, and the mood of the music slowly steers color and scale. When the room falls quiet, the picture fades to black. Nothing is prepared in advance and no video file is playing behind the screen. The picture is generated on the device from what it hears at that moment, so what you see belongs to that moment in the room. WHERE PEOPLE USE IT Watching sound become picture. Put the phone down while music plays and let the room draw itself. On stage. Mirror the screen to a projector or a TV and let the visuals run through the whole set; the screen stays awake while it plays. In a stream. Keep a live backdrop moving behind a set instead of a looping clip that ignores the music. While you play. Point it at an amp, a piano or your own voice and watch what you are playing take shape. TWO THINGS TO KNOW BEFORE YOU START It makes no sound of its own. It listens, and the music comes from wherever you already play it: your playing, your voice, or a speaker across the room. It takes the system audio input, so a line from an external interface arrives exactly as a microphone does. In a silent room the screen goes dark, because nothing is ever faked. It draws for the moment, not for later. There is no export and no rendering: this is a live picture while the music is happening, not a clip to publish afterwards. NOTHING LEAVES THE DEVICE The app contains no networking code at all. Audio is analyzed on the device, frame by frame, and is never recorded, never stored and never sent anywhere. Switch on Airplane Mode and everything still works exactly the same. FOR PEOPLE WHO SEE SOUND If you have ever wanted music to look like the way synesthetes describe it, or watched sand jump into patterns on a Chladni plate, this is that idea driven live by the room around you.