Showing posts with label Geographic Sound Mapping. Show all posts
Showing posts with label Geographic Sound Mapping. Show all posts

Wednesday, 18 January 2012

Psychotransitionary datamoshing on parade, with MC John Cage (apologia)

nb: If you are not trained in the interpretation of psychogeographic metering I recommend you start the video and let it play while reading the notes below. It is not meant to be entertaining.



Technical Notes


I AM SO SORRY

It is often said that a film or video should stand up on its own, unsupported by the post-rationalisations of its progenitor. I don’t necessarily agree with that, but anyway in this case the movie is a mistake and I feel I owe you an explanation.

COMPRESSING/DECOMPRESSING EMOTIONAL VALUES

Last week I set out to edit our short film of the Nexus Art CafĂ© float at the Manchester Day Parade 2011. The footage had been shot on Super 8 film and transferred, out-of-house, to digital, and I had watched it back in the latter format without any problems. However, when I then imported the same digital file into the Institute’s post-production engines for editing, I was confronted with the images you see in the above video. Something had gone wrong. I assumed it was me.

My first instinct was to delete the file. But since a lot of my work here at the Institute involves the recovery of lost films, I took pity on whatever future-me might have the job of reconstituting the canon of ‘unintentionally datamoshed parade movies of the early twenty-first century’. I saved him or her a job by saving the corrupted file. Anyway, when one ‘deletes’ a digital file it is not actually erased, but only marked for overwriting - and so, if data-energy is never truly destroyed but only restructured, might I not learn more from my mistakes by taking responsibility for restructuring the file's raw information myself?

I set about charting the binary ruins of the video, and it was not long before I began to notice a familiar pattern. Having seen the uncorrupted rushes of the parade, I recognised amongst the rearranged pixels a visual echo of the route we took. There, through the luminous video-fog, could be made out the streets and buildings and the dancers and even some of their moves. But, in addition, the newly fragmented pattern seemed to channel the conflicting feelings I felt on the day:
  • The pride I felt in representing with my Nexus comrades and celebrating my adopted city, shattered by self-consciousness and crowded-room loneliness into neat rectangular shards.
  • The particular dismal brand of existential emptiness I’ve only previously felt during extended periods of inactivity while playing left-back for the GM Hurricanes, punctuated by the giddy euphoria of eye contact with this old friend or that sworn enemy in the crowd.
  • The desire to dance and the fear of falling over, expressed through neurotic video jitter.

Somewhere between committing the images of that day to film, and translating it into a digitally manipulatable form, it seemed that the movie had become corrupted moment-for-moment by the emotions I felt on parade. How?

You will remember (and it doesn’t matter if you don’t) that for three months over the summer of 2010 we were asked to vacate the Institute while one of the major search engine companies mapped the dynamic emotionality of the premises for its latest online cartography resource: a (still) unnamed(*1) psychogeographic atlas of the known universe. It so happened that, as they worked in our absence, several expensive pieces of their psychocartographic machinery were irreparably blown due to incompatibility issues with the Institute’s wiring. The workmen dumped the remains in the Institute’s gardens before they left, and since that summer our IT manager(*2) has frequently raided this abandoned equipment for spares. I asked him: was it possible that some kind of ghost codec had hijacked the parade file and decompressed its latent emotionality? Some frustrated algorithm designed for compressing psychogeographically-metered video, now released from its silicon purgatory by the integration of its motherboard into the Institute’s hardware infrastructure?

He told me No, it was not possible, but that as emotion is a matter for the heart and meaning is created in the mind - and if it would make me feel better - I could certainly ‘read’ the video as some kind of pseudo-scientific videograph of the emotions I felt on parade. This did in fact make me feel a bit better. Then he pointed out that nobody else was going to see the corrupted video anyway, which made me feel worse again - yet more determined to salvage the thing.

PIANO HACK

The moving images were saved by mere fact of their re-contextualisation. By considering the broken video from a psycho-transitionary angle, it had meaning again, without even needing to be ‘restructured’. But it still wasn’t much fun to watch, and it needed some sound. It would be dishonest to create and sync up a psychogeographic soundmap after the matter, and besides I didn’t have the processing power to facilitate such an endeavour. Instead, I thought about a song.

The idea of chance discovery and the turning of unfavourable circumstances to one’s creative advantage called to mind John Cage’s invention of the hacked piano, or ‘prepared piano’ as it was known at the time. It is a story that he recounts on Indeterminacy, a recording of 90 one-minute tales ranging from composer-clique gossip to Zen parable. Cage was the most important composer of the twentieth century but he died without hearing the word ‘Pro Tools’. So I decided to rip/sample/steal this most pertinent anecdote of his and add a beat: time, rather than tone, being the fundamental index of music; and beat music being an instant fix for unwatchable movies.

In the original recording of the story, Cage solves a technical problem - how to create percussive music in a room where there is only a piano - by opening up the piano and attaching objects (a pie plate, a nail) to its strings. I decided to hack the narrative so that in the remake he solves the initial problem but creates a new one, accidentally inventing Dance Music (rather than music for a dance) and being unable to un-invent it. This unhappy ending, this punchline of undesired creative productivity, brought the anecdote closer to my own experience.

The audio facilities at the Institute are less than ideal. The track was put together using Audacity 1.2.6 on an iMac with a 600 MHz G3 processor and 256MB RAM for your listening pleasure, though it might have been easier to use tape and scissors. Bring on the interface city where a gesturally operated Protools XI will be embedded in the ambience of bus shelters! In addition to the Cage number, The John Cage Bounce (as the new song was christened) samples The Rose by Nine Circles and Martin Denny’s March of the Siamese Children. There is no original sound.

TRASH BIN

(*1) I suggested they brand it [search engine company name]Hurt. But by the time they read my email, they had apparently lost interest in building a personal rapport with the Institute’s staff and the series of cold but suggestive replies I received seemed to have been generated by a bot or similar
(*2) whom I detest

Monday, 19 December 2011

Destructural Sound

An entry in the Glossary project

Perhaps inspired by the way a flying trapezist orients himself in the 3-dimensional space of the big top using the balancing mechanisms of his semi-circular canals, it was Nanneman’s belief that movie audiences could be guided through the hidden substructures of a movie by their ears, although in this case through the use of structural sound mapping* rather than endolymphatic stimulation. With every last component of a Redestructivish film chosen from the finite (if massive) selection listed in the Catalogue, it was possible to assign each component (be it a character, a costume, a feeling or whatever) a more or less noticeable sound identity quite aside from any specific functional sound it might be associated with on a narrative level. Thus, an audience member should be able to position himself in relation to a Redestructivish movie’s invisible moral or sartorial or emotional framework at any point during a screening, by triangulating the sound identities of each activated component. It was Nanneman’s claim that, much like the trapezist (or man on the street) whose sense of balance is essentially an automatic process (with conscious attention demanded by the tricky bits), the audience would rarely have to work at recognising these sonically-highlighted substructures, although Hanni suggested that was a slightly optimistic view of how the human mind works.

Nanneman coined the term ‘Destructural Sound’ to refer to a recurring technical fault within this system whereby sounds intended to be ‘structural’ would leak between the materials of a film’s architecture, warping or even demolishing that movie’s substructures even as it unfolded.

For the most part, when this inexplicable glitch occurred, sound identities would jump between components, even between those components that did not feature together in the same scenes; some would become completely detached from their intended components and float freely through a movie without becoming attached to other components; still other sound identities would spontaneously begin to mimic adjacent components creating meshes of unintended meaning, exposing oversimplified versions of unintended undercurrents to anyone who was listening carefully. Hanni reassured Nanneman that such audience members would be few and far between, and that to the casual viewer of these early test movies the Destructural Sound - if noticed at all - would probably be attributed to faulty speakers. Still, Nanneman could only hear these distortions as structural damage and, when a remedy was not forthcoming, he instead opted to recast the defect in a positive light.

Nanneman’s suggestion that a filmmaker using the Catalogue to create a Redestructivish movie might "encourage" the phenomenon of Destructural Sound merely by the (non)-act of not correcting it when it occurred might seem disingenuous. Rather than taking the blame, wasn’t Nanneman attempting to take credit, as conceiver and craftsman, for what was essentially a major fault in the Redestructivish system? Was not his capitalisation of the very term Destructural Sound the equivalent of a car manufacturer trademarking the phrase "break down"?

In fact, the period that Nanneman spent developing sounds and sound systems for the Catalogue was, for him, a deeply troubling time, in which he lost faith in himself as a facilitator and an engineer. He had designed himself into a corner, considered himself professionally stranded and, despite his stated goal of facilitating films that would reassure the nation’s unsettled populace, he perhaps saw in the phenomenon of Destructural Sound an apt and personally comforting structural/aesthetic analogy for his own condition - and by extension a valid artistic mechanism. An audience member trying too hard to navigate the hidden substructures of a Redestructivish movie could now become literally ‘lost’ in it.

Of course, Nanneman eventually worked his way through his sound issues, variously fixing or explaining away or forgetting about the Catalogue’s audio shortcomings, the plain passing of time allowing him to look back on that period as what he might characteristically have called a "forest/trees" situation. All the same, once in the clear Nanneman never returned to confront the "forest" of sound in which he had become so lost: the flaws and their euphemistic labels remained integral to the Redestructivish package. The turmoil that Destructural Sound would have made on the cinema sound system repairs industry had the Catalogue ever progressed beyond the test stage can only be imagined.

*(not to be confused with geographic sound mapping in the films of Francis Dove, whose ever diminishing budgets saw an increasing reliance on sets built from light, fog and upturned boxes and who therefore oriented audiences in his characters’ surroundings through the use of consistent and aggressive soundscaping)

See also: Foley Bleed