One of the ways in which the film work of avant garde and moving image artists differs from narrative-based filmmaking is how sound and music is used. In rejecting concerns of story or character development, filmmakers operating in this interdisciplinary region between cinema (film), performance (expanded cinema) and gallery exhibition (video installation) free themselves to examine the medium inside and outside the confines of linear time. *

*The Movement of People Working* [2003] dir. Phil Niblock (2 stills from DVD version)

An elastic approach to the temporal arrangement of moving images and sounds opens up opportunities for interesting and unusual audiovisual juxtapositions. The use of contrapuntal sound in this way can have the effect of registering a floating, dream-like atmosphere that departs from the grounded, synchronous interaction of image and sound. Located within such a dreamscape lies the mind of the filmmaker who, in the expressive stream of consciousness, is capable of achieving a highly personal sensibility to filmmaking. In this space images and sounds drift in and out of focus like fading memories, fragments of a passing life. Here the expressive diarist work of Jonas Mekas comes to mind.

With the freeing up of time and the relinquishing of synchronous image-sound relationships, the conventional distinctions between diegetic/non-diegetic, music/sound, signal/noise begin to unravel and blur. Operating in this sonic territory - one that historically covers video art, sound art and experimental music - we locate moving image artists and filmmakers, many of whom arrive at film with a background in fine art or contemporary and experimental music. In some cases respective film and music activities co-exist (e.g. Phil Niblock), while for others, an interest in sound and music is a starting point in a trajectory that moves them further towards moving image and video installation (e.g. Bill Viola).

*The* *Birds* [1963] dir. Alfred Hitchcock • *The* *Red Desert* [1964] dir. Michelangelo Antonioni

The electronic film score belongs to any discussion concerning alternative and experimental approaches to working with film sound and music. Amongst some of the most famous examples of commercial films that deploy a purely electronic palette of sounds is Alfred Hitchcock’s horror classic The Birds from 1963. Utilising the Mixtur-Trautonium electronic synthesizer, composers Oskar Sala and Remi Gassmann were commissioned to produce the eery, atonal textures that would score the birds fluttering and cawing. In her book The Silent Scream: Alfred Hitchcock's Sound Track Elisabeth Weis writes about the relationship between the film’s atmosphere of fear and the uncanny quality of the electronic sounds:

"The Birds deals abstractly with fear; thus it is especially dependent on sound because of the non-specific quality of sound effects."

We find the “non-specific quality” of electronic noises and tones put to novel use in other films of the time, such as Forbidden Planet (1956), considered the first completely electronic film score, Michelangelo Antonioni’s The Red Desert (1964) and Andrei Tarkovsky’s Solaris (1972).

In Jack Clayton’s gothic psychological drama The Innocents (1961), electronic feedback and delay effects are put to great effect in a memorably tense and atmospheric sequence midway into the film. Described as the sound of the governess’ encroaching madness, "…what really disturbs us, at the very moments when the film is at its most disturbing” writes Robert Barry,

“are the eerie electronic noises that creep around the edges of Auric’s lush impressionistic score. These noises, though unmentioned in the film’s credits, were created by Daphne Oram.”

Oram (1925-2003) was a pioneering British electronic composer, inventor of the Oramics Machine and co‑founder of the highly influential BBC Radiophonic Workshop.

Often where experimental and electronic music interacts with film we might find the use of continuous sustained sounds. Whether such soundtracks are considered music, sound or noise is prone to subjective standards and an unimportant here. Instead, what remains significant in this context is the non-diegetic, sound or music, dimension of what's being heard and how this correspondingly relates to what is being seen.

How does the image and soundtrack synthesise in film to express something - a meaning or a sensorial experience - for the spectator? Consider the use of sustained, layered drones in Phil Niblock's video work The Movement of People Working (2003). This ia an extended 16mm piece in which the camera records the repetitive manual work of labourers working in fields. Faces cropped, location sound mute, silent moving limbs set to the sounds of shimmering microtonal drones. (Or perhaps the other way round). What is this experience? +

Film Selection:

Tectonic Plate [2016] dir. Mika Taanila
The Movement of People Working [2003] dir. Phil Niblock
In Absentia [2000] dir. Quay Brothers
The Black Glove [1996] dir. Maria Beatty
Solaris [1972] dir. Andrei Tarkovsky
Entrance to Exit [1965] dir. George Brecht
The Red Desert [1964] dir. Michelangelo Antonioni
The Birds [1963] dir. Alfred Hitchcock
Ai [1962] dir. Takahiko Iimura
Speak {1962} dir. John Latham

Notes:

* Hitting the 'non-linear button' in film school was often an indication that it was time to depart from script and begin experimenting temporally in an attempt to uncover new ideas in the material.

+ Additional Thoughts: In some sense continuous sound has the uncanny effect of delineating the soundtrack from the image, setting up independent streams of sensory information; a return to a more primitive state in which film sound and image are decoupled from one another. In such instances, the absence of any significant points of audiovisual synchronisation can perceptually suggest a flattening of a sequence of moving images. The image lacks a kind of acoustic depth. Consequently, it seemingly lacks a three-dimensional presence (an inability to conform to realism) in the listening space of the cinema. Perhaps the sum effect of this is to establish a soundtrack that acts as a spatio-temporal frame through which the changing images are performed.

Between points there necessarily yawns an empitness, an empty interval in which nothing happens, in which no sensation takes place. In mythical and historical time, by contrast, no emptiness emerges, because neither picture nor line is interrupted by intervals; both of these form a narrative continuum. Only points allow empty in-between spaces to appear. These intervals in which nothing happens cause boredom. Or they appear threatening, because where nothing happens and where intentionality can find no object, there is death […] Point-time does not permit any contemplative lingering. (The Scent of Time, Byung Chul Han, 2017)

Film is a visucentric medium. But sounds do indeed affect the way we read its imagery. What one hears and how one listens is ultimately shaped by what the filmmaker chooses to reveal or conceal from the spectator.

*Two Years at Sea* [2011] dir. Ben Rivers

This dynamic interplay between presence and absence is achieved visually through choices of camera framing, composition, movement, choreography and mise-en-scène. In this way the spectator’s film listening only ever begins with what they first experience visually. And what is shown and correspondingly seen is always temporally framed.

Editing interrupts the flow of time in a given film shot. Classical continuity editing unifies images and sounds into a continuous and consistent sense of time and space. The synchronous pairing of sounds with images suggests a temporal realism that feels consistent with our perceptual experience of everyday reality.

In contrast to the rhythm and pace of conventional film editing, the long take provides a continuous, uninterrupted experience of time. Often demanding precise blocking and complex camera choreography, the long take remains one of film’s most enthralling showpiece moments. Perhaps its allure for audienes is twofold: First, the expressive temporal quality of the long take to further heighten the spectator’s sense of immersion - of actually feeling like one physically inhabits a place in the film - through the experience of unfolding, continous real time (notably when the camera suggests a pseudo first-person perspective). Second, a sudden or gradual awareness of a shift in visual language, marked by the dizzying flair of an athletic camera that invites the viewer into hiterto unimaginable visual perspectives.

This sense of uninterupted, unfolding time is tested at its extremity in so-called “Slow Cinema” - what Jonathan Romney, writing in Sight and Sound, has characterised as a "varied strain of austere minimalist cinema".

In a 2012 Guardian article on the subject, author Sukhdev Sandhu writes:

“the cinema that Romney describes in terms of austerity can also be seen as a form of cultural resistance. What links otherwise distinct films such as Jia Zhang-ke's Still Life (2006), Carlos Reygadas's Silent Light (2007), and Apichatpong Weerasethakul's Palme D'Or-winning Uncle Boonmee Who Can Recall His Past Lives (2010) is the extent to which they opt for ambient noises or field recordings rather than bombastic sound design, embrace subdued visual schemes that require the viewer's eye to do more work, and evoke a sense of mystery that springs from the landscapes and local customs they depict more than it does from generic convention.”

*The Passenger* [1975] dir. Michelangelo Antonioni

Consider the opening of Orson Welle’s Touch of Evil (1958) * (refer to audio excerpt above and notes below) or the famous crane shot in Mikhail Kalatozov’s Soy Cuba (1964), the camera seemingly floating to unprecedented elevations. The penultimate shot in Michelangelo Antonioni’s The Passenger [1975] is seven-minute, seemingly impossible, long tracking shot that moves from Lock's hotel room through the iron railings and outside into the road, before returning back to the hotel.

As with the use of the long take by directors like Tarkovsky, Tarr and Weerasethakul, time here acts as a container for sound: time articulated through what is seen, heard and subsequently felt - the framing, composition and movement of the camera. Wind, voices, car engines, distant music, birds, footsteps on gravel, all precise sonic elements organised into a cohesive soundtrack, that still have the semblance of a “symphony of the sound of life” in which “the rhythmic cadence is not predictable, there is no search for a rhyme” (Chion). These techniques of uninterrupted spatio-temporal development would lead to further innovations with the emergence of Steadicam, Gopro and Drone camera technology.

Within the confines of the frame, the long take does more than reveal a smoothly changing visual landscape. It widens the scope for a continuously changing acoustic environment both inside and outside what is visibly present.

*Memoria* [2021] dir. Apichatpong Weerasethakul

The camera, like a painting or still photograph, appears to contain a world within its frame. This world within implies a world outside, one unseen and existing beyond the film frame. At any given moment sound exists both inside and outside what we see. Michel Chion has described how the audiovisual medium of film actively explores the visualised and acousmatic sound through an interplay of tension and resolution of meaning. This forms the fundamental basis of the offscreen sound space, underpinning its interpretive ambiguity.

Consider sound as an expression of time. Film time therefore functions as a container for sound, the emergent space of an audible world and the invitation to attend to it. Andrei Tarkvosky wrote extensively on the unique temporal qualities of film:

“No other art can compare with cinema in the force, precision, and starkness with which it conveys awareness of facts and aesthetic structures existing and changing within time.”

Always we listen to what time permits.

Film Selection:

Memoria [2021] dir. Apichatpong Weerasethakul
Two Years at Sea [2011] dir. Ben Rivers
Sweetgrass [2009] dir. Ilisa Barbash and Lucien Castaing-Taylor
Enter the Void [2009] dir. Gaspar Noé
Werckmeister harmóniák [2000] dir. Béla Tarr
The Sacrifice [1986] dir. Andrei Tarkovsky
Stalker [1979] dir. Andrei Tarkovsky
From the East [1993] dir. Chantal Akerman
Le Dormeur [1974] dir. Pascal Aubier
Wavelength [1967] dir. Michael Snow

Notes:

*Touch of Evil (1958): Different genres of music are heard from multiple sources, each treated differently according to the playback device or acoustic location of the sound source relative to the moving camera position. Walter Murch would later explore this kind of complex treatment of multiple diegetic music sources in George Lucas’ American Graffiti (1973), coining the phrase worldizing to describe the process of “playing back existing recordings through a speaker or speakers in real-world acoustic situations, and recording that playback with microphones so that the new recording takes on the acoustic characteristics of the place it was "re-recorded."

The initial studio-release version of Touch of Evil employed a music score that departed from Welle’s original direction. He outlines his diegetic design for this opening scene in the famous 1957 response notes addressed to Edward I. Muhl, Vice-President in charge of production Universal-International Pictures at the time:

“I assume that the music now backing the opening sequence of the picture is temporary...As the camera roves through the streets of the Mexican bordertown, the plan was to feature a succession of different and contrasting Latin American musical numbers - the effect, that is, of our passing one cabaret orchestra after another. In honky-tonk districts on the border, loudspeakers are over the entrance of every joint, large or small, each blasting out it's own tune by way of a "come-on" or "pitch" for the tourists. The fact that the streets are invariably loud with this music was planned as a basic device throughout the entire picture…”