City 17 Soundscape (2.50 min) with annotations on Soundcloud (sorry, embedding doesn't work on Gamasutra).
I made this short recording of a walk through City 17 in order to more closely examine the impact of the soundscape on the game environment. Put on some headphones, close your eyes, and enjoy the atmosphere.
Just as the mis-en-scène of a game is everything in front of the camera, including the HUD and held weapon, a soundscape in a game is the total combination of everything the player hears, from footsteps to achievement notifications. It can be predicted to a degree, but will never really be known until one is immersed in it. This is because a soundscape is constructed out of, among other things, dynamic sounds and the mobile player's constantly changing distance to 3D sound sources. I like to call this soundscape possibility space the level's acoustic ecology. The acoustic ecology is a fundamental part of what transforms the abstract space composed of physical relationships between objects into a place that communicates context for narrative meaning to be derived from.
In the Source engine a “Soundscape” is the name given to a script that takes a bunch of .wav files and mixes them together on top of a looping base track, to be played when the player is inside a certain volume of space. Sound effects are divided into logical groups (distant trucks, alarms, aircraft, etc), and every few seconds (within varying random ranges) a sound in each group is played in a random location with a random volume. The resulting “soundscape” is a unique drone of city activity on the edge of hearing. It’s background noise in not just an acoustic sense, but a spatial one as well.
This background drone is to the acoustic ecology of the level as the 3D skybox is to level geometry (The Source engine’s 3D skybox is a 1/16th scale set of buildings that is “projected” outside of the actual level geometry). The sound effects in these scripts are randomly positioned within a volume of space the player occupies, but filtered and at low volume so that they seem to be originating from beyond the level’s façade, outside of the geometry. This background noise, like the skybox, is an illusion designed to make the player believe they are in a place with depth, and not an enclosed, constructed level. Layered on top of this are the local sounds, generated from entities inside the level and much more sensitive to the positioning and actions of the player.
R. Murray Schafer identified three elements of the soundscape: Keynote sounds, sound signals, and soundmarks. They’re a good place to start thinking about acoustic ecologies from a level design perspective, and I’ll walk through each of them in turn.
The keynote sound is so ubiquitous that it often doesn’t consciously register, and because of this ubiquity it more or less accurately represents the character of the environment and people who inhabit it. In modern cities traffic is the dominant keynote sound, as it is in the exterior portion of this City 17 recording. There is, however, an additional local keynote sound: the flying, shutterbug City Scanners. I was surprised to hear the warbling, beeping, clicking scanners almost constantly throughout the soundscape I recorded. I definitely saw a lot of scanners when I played through, but I never realized how often I could hear them.
This is a perfect example of an implementation of a keynote sound to support the themes of the game. It’s a common but sometimes only subconsciously perceptible sound that represents the character of the environment: a police state without privacy. Consider if there was only one scanner that took your photo when you got off the train, and some mounted cameras like the one you can hear snapping a series of photos halfway through the recording. Or even if the scanners moved silently. The same point would have been made visually, perhaps, but the player would have been a lot more comfortable moving around City 17. There would be areas of surveillance and areas of privacy the player could consciously recognize. But with the scanners providing a keynote sound, the unsettling sense of being watched etches itself in the subconscious and never really goes away.
Sound signals are the sounds that punctuate the soundscape. They’re listened to consciously, and therefore have a large impact on the acoustic ecology of a level. What players probably remember most about this part of City 17, other than the Citadel and Breen, is the Combine chatter and introduction to the stomping Strider. They’re visually interesting too, but the sounds are free from line of sight restrictions and contribute to that lasting impact. The Strider is heard before and after it’s seen, and you don’t need to be looking at a Combine patrol to hear the familiar radio barks. A sound signal, as the name implies, is used to communicate something directly to the player—they are meant to be listened to. In terms of level design, sound signals can be used to guide the player to points of interest, hint at the location of enemies, and so on. I think this aspect of sound design is fairly well understood already.
Soundmarks are Schafer’s term for sounds that are, like landmarks, unique to an area. Breen’s broadcast would be a soundmark in this recording. However, because it loops indefinitely, players probably try to ignore it after having heard enough. It fades into the background, becoming more or less a keynote sound. Making Breen’s words heard almost everywhere in this level, but maybe only subconsciously absorbed by the player (and presumably residents of City 17), is a kind of perfect, if unplanned, acoustic design that emphasizes the Big Brother theme.
It also appears to be good practice to tie the soundmark and landmark together, but this probably isn’t a hard rule. The landmark of this area is the Citadel. When the Citadel is first viewed, Breen’s display is right there, hanging on a nicely juxtaposed obelisk. The ultimate destination and ultimate enemy—the landmark and soundmark source—are elegantly connected to one another. A few minutes later we'll find out Breen is also inside the Citadel. There are many other cases where this type of connection would make sense: Church spire and ringing bells, castle wall and cannon fire, lighthouse and crashing waves, and so on.
I’ll end with a note on playground_memory.wav. It’s what first intrigued me aboutHalf-Life 2’s soundscape and inspired me to delve deeper. You can hear it near the end of the recording. While walking through a dilapidated playground the sounds of children playing can be heard fairly clearly for a moment. This is non-diegetic in that it does not exist in the fiction of the world. Yet it clearly exists in the fiction of the game. The filename hints at its nature: Gordon Freeman’s memory of a lively playground, in happier times. There’s a lot going on in this recorded soundscape. Give it another listen and try to picture the possibility space of sounds that it was created from.
Stay a while and listen | Ben Abraham writes about "off-screen" wind chimes inHalf-Life 2, and the musicality of sound effects.
http://www.urbansoundecology.org/ | The inspiration for this digital soundwalk. Lots of great links to other sound studies resources.
The Soundscape: Our Sonic Environment and the Tuning of the World | R. Murray Schafer's seminal work.
Soundscape - Valve Developer Wiki | Technical description of the soundscape scripts used by the Source engine.