Hannibal: This is my sound design

This is a translation of an article that I wrote in 2014. If you speak Spanish, you can find the original article at Makimono.

Nowadays, there is a television series that stands out in terms of sound design: Hannibal. Its special attention to sound is glaringly obvious from the first scene, in which for almost two minutes without dialogue we listen to a disturbing mix of field recordings, electronic music, pulses, glitches, static, etc. that introduces us to the mind of the main character: Will Graham.

During these first minutes, the soundtrack oscillates between the real and the hallucinatory, echoing the ghostly influence of John Cage and Morton Feldman, of whom Brian Reitzell, composer and musical supervisor of Hannibal, says: “I’m a big fan of John Cage and Morton Feldman. I love when you have big washes of sound that come out of nowhere and leave tons of space behind them.” [Film Music Magazine].

Hannibal makes it clear from the first scene that here you are not going to find a classical orchestral soundtrack. The soundtrack knowingly confuses diegetic and non-diegetic sound using drones, dark ambient, and industrial music. “Reitzell’s work unmoors the viewer subliminally, forgoing the classical bombast of Shore or Zimmer’s Lecter scores for ambient clashes of sustained tones.” [A.V. Club].

This attention extends also to images. From the beginning, the directors decided that they wanted the audience to be “totally immersed in the world of the show: sound and vision.” [Minnesota Public Radio]. The Guardian said a few months ago that “it’s unlike anything else on TV. The camerawork is stunning … Colours are muted or oversaturated, characters appear shrouded in shadow, or even in silhouette. It’s also a treat for the ear, with Brian Reitzell’s score blurring the line between music and sound effects. The sound design here is better than most movies.”

However, the most interesting thing is that this treat for the ear is not just about aesthetics. The first personal trait that we know about Will Graham—a somewhat asocial professor who collaborates as an analyst with the FBI—comes from a conversation about the power of listening. When Jack Crawford—an FBI agent—points out that it is funny that someone as asocial as him works as a teacher, Will answers, “Well, I’m just talking at them. I’m not listening to them. It’s not social.”

When, minutes later, we meet Hannibal Lecter, we hear classical music for the first time, a piano that takes us to a more structured, elegant, and clean world than the criminal madness of the FBI and Will’s mental instability. The music is not any piano piece, it is the “Aria” from the Goldberg Variations. I don’t know if what we hear is Glenn Gould, but he is Hannibal’s favourite pianist, and also an obsessive-compulsive maniac as perfectionist as he is.

The two main characters are presented through sound, contrasting intricated sound textures with the impeccable control of the Goldberg Variations. Although the sound surrounding Will is complex, dark, and closer to noise than music, it is never chaotic. Will himself says a few episodes later that spaces speak to him “with noise and clarity”. This apparently contradictory description defines well the soundtrack of the series, a structured noise that relates to the idea that chaos does not imply disorder, but an order that we do not understand.

When Hannibal enters Will’s house for the first time without him being present, he plays the piano, as if he was trying to take over Will with his own music. What he plays are the first notes of Igor Stravinsky’s The Rite of Spring, a piece related to the form and content of the series. On one hand, it is a work that received adverse criticism for its games of tonality and dissonance. On the other hand, it focuses on primitive rituals that include the choice of a sacrificial victim.

Will’s dissonance… Hannibal’s sacrificial victims… Stravinsky himself said that his piece was about “the mystery and great surge of the creative power of Spring” [Wikipedia]. As we will see later, the relationship between Will and Hannibal will lead to a great tension that involves the creative power of Hannibal and the ‘blooming’ of Will.

Will and Hannibal come closer when they share a secret related to an FBI case. This introduction of Will to something ‘fishy’ is underlined using the soundtrack. The scene opens with Hannibal listening to opera in his office, when Will enters the room accusing him of withholding information, the opera mixes with the abstract sounds that always accompany Will. As Will’s anger increases, the opera disappears, we only hear ‘sound’. When Hannibal begins to convince him that it is better to keep the secret, the opera reappears, eventually triumphing over the ‘noise’.

Reitzell states that “There are many layers in the soundscape and very little sound design in the show.” [Film Music Magazine]. He means that, despite the complexity of the sound, they did not want to be dramatic, but to add meaning. “I’m interested in music psychology and applying that to the score as much as possible.” [Minnesota Public Radio]. Bryan Fuller, the creator of the series, says that “so much of what Brian Reitzell does isn’t scoring; it is sound design. It is psychological sound design” [A.V. Club].

The opening credits are the first element that plays with the viewer’s subconscious, using a short piece that musicologist Tim Storhoff describes as a mixture of “dissonance, distortion, and non-Western percussion instruments.” [T-Stor]. The richness of the atmosphere of this and other sound pieces has levels of complexity and low-pitched audio frequencies impossible to hear using standard television speakers. The series’ soundtrack is as elusive as Will and Hannibal.

In the seventh episode, there is a series of shots that take us from the vibration of the vocal cords of an opera singer to Hannibal’s inner ear. Hanibal is almost crying. Sensitivity, what moves us, enters through the ear. But not only what moves us, but also what sustains our reality and our life. When Will begins to confuse imagination and reality, he says “I can see and hear better afraid. I just can’t speak as concisely.” He is opening up, the problem is that the more he opens up, the more difficult it is for him to express with words what he feels.

In Hannibal, mind and life always pass through the ear. Will says to a disturbed woman, “If you can hear me, you’re alive.” This sentence is later related to the ear of Abigail Hobbs, an ambiguous character—victim and executioner—with whom Will and Hannibal develop a parental relationship. When Hannibal supposedly sacrifices Abigail, all that is found of her is an ear—Lynchian overtones. If Abigail has no ear, she cannot hear. If she cannot hear, she must be dead.

Abigail’s ear also represents an epiphany, it is linked to Will’s awakening, to the awareness of what is really inside Hannibal. The awakening/ear relationship is evident. Hannibal inserts Abigail’s ear into Will’s throat while he is unconscious. When Will comes to his senses, he throws up the ear, an ear that then appears again and again in his hallucinations.

When the ear motif reappears in the second season, it does so as a link to life. Will, accused of crimes he did not commit, sees an opportunity to save himself from the death penalty when someone sends the court an ear that indicates that the real killer is still free. “This ear you were sent is an opportunity,” says Hannibal. In the same episode, the tabloid journalist Freddie Lounds claims at the trial that Abigail died because she did not listen to her, “I should’ve listened to her”.

Non-listening kills, but also amplified or misdirected listening. When Will feels guilty about the death of one of the characters, he says, “Beverly died because of me. Because she listened to me”. Also, when psychopath Abel Gideon tells Dr. Alana Bloom that Will is not a murderer, but that he could soon be one, she is not concerned because it is impossible for him to kill anyone while locked up. Gideon replies, “Not with his own hands, but if he only had a little birdie to whisper ‘murder’ into a sympathetic ear…” The adjective sympathetic is used in the musical field to speak of ‘sympathetic vibrations’, resonance, an issue to which I will return later.

When Will whispers to a little birdie to murder Hannibal, Hannibal’s reaction after being saved is to compose a piece for harpsichord. “I’m metabolizing the experience by composing a new piece of music.” The harpsichord means control over his space and circumstances, he is recovering his structure. Hannibal is not able to finish his composition until he regains control over his life and his game.

And then, they both eat the little birdie. The bird is not Will accomplice, it is an ortolan that he and Hannibal eat after drowning it alive in Armagnac. This is another scene that uses the Goldberg Variations, this time mixed with the crunching of the bird bones. Now both are in control.

The amount of dialogues that refer in one way or another to sound is fascinating, perhaps because sound is formless and ethereal, two conditions related to the enigmas of the human mind. Will usually explains his feelings using terms related to sound, “I can feel my nerves clicking” or “All I heard was my heart, dim but fast, like footsteps fleeing into silence.”

Sound references are even used as a humorous resource. In one of the first episodes, when Alana shows up at Will’s isolated house by surprise, Will says that he has not heard her car. She answers, “Hybrid. Great car for stalking.” Noise reveals, silence observes.

This metaphorical discourse on sound reaches another level in the eighth episode. The murderer of the week is a musician and the whole episode is full of sound references. It is an episode that talks about music and its relation to control, death, and the mind. Play means to perform music on a musical instrument, but also to be involved in a game. Hannibal reflects: “Every life is a piece of music. Like music, we are finite events, unique arrangements. Sometimes harmonious, sometimes dissonant. Sometimes events not worth hearing again.” The victim as an instrument, life as a score.

In this episode, we discover that Hannibal is a theremin virtuoso. If the harpsichord has to do with control over oneself, the theremin has to do with control over others, functioning as a simile of how Hannibal handles everyone who comes into his range. Hannibal states that with the theremin one does not compose, but discovers, because you “can’t impose traditional composition on an instrument that is inherently free form”.

In this same episode, we see an unexpected fight to the death between Hannibal and the killer musician. When Hannibal kills his rival, he plays a few notes of “Aria” on the harpsichord, a sound detail that represents his extreme dependence on refinement and control. Hannibal is a killer, but his modus operandi is never improvised or dirty, all his movements are calculated, he cannot stand improvised, rough or sloppy things.

When the theremin reappears in episode 10 of the second season, a much clearer relationship is established between sound, vibration, and control. Hannibal and Alana speak, “A theremin is an instrument that can create exquisite music without ever needing to be touch, but it requires the rare gift of perfect pitch to play properly … Feel the vibration moving through you. … It’s like composing in thin air. Thin air is the musician’s canvas. … It’s a very psychological instrument … We work with people the same way. Never touching … but guiding them from dissonance toward composition.”

Alana stresses to Hannibal that people are not instruments: “Whatever it is you’re playing (playing, with the double meaning of playing music and playing a game), Hannibal, you have to listen very carefully to what you are creating.” Hannibal’s response is a direct reference to the haptic and vibratory power of sound: “You and I went so long in our friendship without ever touching, yet I always felt attuned to you. ‘Attuned’, a term that means ‘in resonance’ or ‘on the same wavelength’.

‘Attuned’ refers to the notion of ‘sympathetic’, already mentioned, and relates to two Eastern concepts, the Japanese ki ga au and the Chinese ganying, which have much to do with the interaction between Will and Hannibal.

Ganying (‘resonance’) means stimulus and response, in the sense of an interaction that transcends the limits of time, space, and ordinary linear causality. Resonance implies a stimulus that generates a simultaneous effect on another element without direct contact. According to The Huainanzi, this connection is related to qi, energy, and is never arbitrary, because elements are more sensitive to the resonance of other elements that share the same form of qi. It is exactly the same phenomenon of musical resonance, which causes one guitar string to vibrate when another is played, for example.

Ki ga au is a Japanese expression that means to get along, but its literal translation would be more similar to ‘our qi match’, that is, ‘we resonate’, or ‘we vibrate on the same wavelength’. Hannibal and Will share a common wavelength, but while one allows himself to vibrate and resonate, creating perfect music, the other tries to conform to the score written by society, morals, and laws, living in constant dissonance.

The second season of the series opens with an episode in which Will is already fully aware of this resonance: “I used to hear my thoughts inside my skull with the same tone, timbre, accent, as if the words were coming out of my mouth … Now my inner voice sounds like you [Hannibal].

This resonance is not only evident through words, Will and Hannibal’s soundtracks are beginning to blur. When they have a first dinner more or less frank about what they are playing at, Will’s dissonance drifts into the “Adagietto” of Gustav Mahler’s Symphony No. 5 in C sharp minor, a love song that ends on a disturbing shot, again with dissonances, in which their identities are confused using a simple audiovisual trick that points in more than one sense to Ingmar Bergman’s Persona.

In this second season, not only does the resonance between Will and Hannibal become more evident, but also the identification of silence with death and noise with life. In the same episode in which Jack’s wife, who is sick with cancer, describes death as an inevitable silence, one of the FBI’s forensic scientists mentions that drone—the bee—ejaculations are so explosive that they are audible to the human ear. Here we find the idea suggested by Jacques Attali in Noise: The Political Economy of Music, “life is full of noise … death alone is silent … Nothing essential happens in the absence of noise”.

If in life nothing happens in the absence of noise, neither does in Hannibal. The soundtrack is there even when you’re not hearing it, with low frequencies lurking in the darkness beyond the frequency range of your speakers. Hannibal is a feast for the ears, a morbid fascination, a feeling that dances on the sublime… and, I insist again, on the ear.

Soundies

Soundies were musical films produced in several American cities between 1940 and 1947. They were short films of songs, dances, or orchestra performances. They were shown on a coin-operated machine, a kind of film jukebox that you could use in nightclubs, bars, restaurants, and other public places. Some soundies were later reused as fillers for television.

The soundie was the precursor of the music video. The films, about three minutes long, were mounted on reels with several performances projected in a loop. As the intention was to reach a wide audience, the range of musical genres was diverse, from country to swing, jazz, gospel, folk, and even opera. In some cases, they included shots of women in swimsuits or other slightly erotic sequences to attract the sailors on leave, which led one senator to threaten to investigate the production and distribution of soundies, believing that these were lewd films that should not be shown in any decent public space.

Although some conservative politicians tried to turn soundies into films for sex shops, these were not low-budget films with erotic performers. Soundies were a launching pad for dancers, actors, musicians, and singers like Cyd Charisse, Doris Day, Ricardo Montalbán or Louis Armstrong. And more important, during the few years that they were in vogue, they were one of the few mediums in which artists of colour were free to produce their own films.

The first soundies were shot in 1940, but were not distributed until the following year, when the projection machine, called Panoram, was optimised. A Panoram cost about $600 (almost $12,000 today). Despite its high price, in just three years there were more than 10,000 Panorams throughout the United States. Although more than 1,800 soundies were produced and distributed in that short time, by 1946 the number of Panoram machines had dropped to just 2,000, presumably due to the restrictions of wartime.

Soundies were shot in 35mm and distributed in 16mm so that they could be projected on the Panoram, which as you can see in the following video was a bit of a mix between a jukebox and a television. It was a complex device, with a rear-projection system built with mirrors and a 45x50cm screen. Since each reel contained eight soundies that were projected in a loop, you could not choose which one to watch. To keep the audience interested, they changed the film reels every week.

Due to the technological limitations of the time, all the performers did playback, in some cases awful playback. However, perhaps the most curious thing is that soundies used the same tricks that contemporary music videos: absurd plots, half-naked girls, weird sets, and crazy choreographies. I’m sure some MTV executive has gotten ideas from this.

Gerald McBoing-Boing, the boy who speaks through sound effects

Gerald McBoing-Boing (1950) is an animated short film about a boy, Gerald McCloy, who speaks through sound effects. The film is based on an audio story by Dr. Seuss originally published as a record for children.

The film was created for cinemas, moving away from the realistic animation style popularised by Walt Disney. The main concept was that cartoons don’t have to obey the rules of the real world. This, besides being original, reduced costs, because they didn’t need realistic drawings, but something more creative and expressive.

The animation studio behind Gerald McBoing-Boing was United Productions of America (UPA). The UPA had been founded after a strike by Disney workers in 1941. During its years of existence, which spanned the 1940s to the 1970s, its biggest success was Mr. Magoo.

As I said before, Gerald McBoing-Boing’s plot focuses on Gerald McCloy, a 2-year-old boy that, when he begins to speak, uses sound effects rather than words. The first thing that comes out of his mouth is “boing boing”, the sound of a spring bouncing.

Doctors can’t find a solution, and the other children make fun of him, leading his family to despair. Then a radio talent scout discovers Gerald and hires him as a foley artist—the person who creates sound effects for film and radio.

The short was so successful, even winning an Oscar, that the UPA produced three sequels. Years later, in 2005, Cartoon Network launched a cartoon TV show based on the same characters. In this show, Gerald still speaks through sound effects, but he has two friends that use standard words.

Some notes about the production

Gerald McBoing-Boing’s creator, Bobe Cannon, and its designer, Bill Hurtz, wanted to create a minimalist cartoon with little dialogue. For the original film, first, they sketched the actions. Then, they composed the soundtrack and they animated all the actions using the sound as a guide. Finally, they added flat and flashy colours.

The style is far from the realism of other cartoons of the time. The backgrounds have only a few lines, some of them are almost abstract. These drawings are influenced by modern painters like Picasso and Matisse. The composition uses forced perspectives and extreme angles, achieving striking shots reminiscent of German expressionist cinema.

Cannon had started his career working with well-known characters, such as Bugs Bunny and Daffy Duck. He was one of the founders of the UPA and vice president of the studio from 1949 to 1957, a job that he combined with collaborations with Disney and Tex Avery.

Cannon loved ballet and he saw cartoons as a form of dance. When he designed his films, he thought of animation as if it were choreography. Maybe that’s where the idea of creating a character who expresses himself through sounds, rather than words, came from.

Which was the first flicker film?

My favourite film genre is the flicker film. In case you’re not very familiar with experimental film, a flicker film is a film with fast changes between light and dark frames. That creates a strobing effect.

If you need something more visual to understand what I’m talking about, this is Arnulf Rainer (1960) by Peter Kubelka, my favourite flicker film.

I’ve read a lot of times that Arnulf Rainer was the first flicker film, but that’s not true. I believed it for some time because that’s what most books say, but years ago I discovered Color Sequence (1943) by Dwinell Grant.

Some parts of Color Sequence are too slow to be considered a flicker, but other parts are definitely flickering. Anyway, this isn’t the first flicker film either.

The first flicker film, at least that I know of, is An Expression by Shigeji Ogino (you can watch the film on the link).

Shigeji Ogino was a Japanese filmmaker who started making movies in the 1920s. His filmography is really diverse. He made home movies, travel diaries, animation, and experimental films.

An Expression is a 4-minute long silent film. It’s an abstract film, we only see shapes. However, it’s also a narrative film. Ogino tells the story of a meeting between a man from the city—the triangle—and a woman from the countryside—the circle.

Ogino shot the film in black and white using alternating red and green filters. One frame is red and the next is green (complementary colours), which generates entoptic phenomena. Entoptic phenomena are images whose source is within the eyes themselves. This means that sometimes you see colours, spots, shapes, etc. that are not really in the film.

I love doing research, so maybe one day I’ll find an oldest flicker film, or maybe someone will talk me about another one. Who knows…

Beyond her Frequency Spectrum

I’ve made a new year album. Last year I made one, so I thought that I should make another one this year.

Happy 2019 to everyone!