Storytelling and Sound Illusions

Storytelling and Sound Illusions

We humans are easily fooled by sound. It sneaks into the side door to the brain, and in almost all cases, outside of music theory classes, we tend to resist analyzing it. We just feel it, and this is the case with sound effects too, not just “music.”

This fact makes sound for film/video/games storytelling very powerful. Sad to say that power doesn’t translate into big budgets, partly because movie and game producers are no more analytical about the creative power of sound than they are about the sounds themselves. They feel it, but they can’t rationalize funding it, because they don’t understand it.

One story involving a sound illusion that I like to tell happened during the mix of the second Star Wars film “The Empire Strikes Back.” The Director was sitting in the back of the mix room and noticed a moment where he thought there should be a change in the mix. He mentioned it to the mixers, who added it to their list of changes to be done. The Director got distracted by a phone call for maybe thirty minutes and wasn’t paying attention to what was going on at the mixing console. When he returned, the mixers happened to be playing through the area where he had asked for the change. He complimented them on having addressed his concern, and said that it sounded much better now. One problem … they had not gotten to that item on the list yet. We are highly suggestible when it comes to sound. If we have some reason to think a sound has changed, then it will sound to us like it has changed.

​... when you see a ceiling fan and hear a helicopter...


Situations like the one I just described can be interpersonally delicate. Should the mixers tell the Director that in fact no change was made, and thereby risk embarrassing him? Or perhaps let him think the change has happened, then surreptitiously actually make the change when he isn’t around? Or not make the change at all? In this case they were honest with him about what had happened. The best response is usually the one tailored to the personality of the Director. There are lots of those tricky decisions in mixing.

It would be wrong for me to end this piece without talking about the great storytelling advantages of sound’s ambiguity, especially in its relation to moving visual images. As audience members our tendency is to accept what is presented in terms of sound, sometimes having done quite a bit of unconscious rationalizing to justify the acceptance. A classic example is Captain Willard in “Apocalypse Now” seeing a ceiling fan spinning, but hearing a helicopter instead.

The ambiguities of sound are actually what make it such a strong tool in my opinion. When a sound feels ambiguous or even slightly out of place in a given dramatic situation, it forces us in the audience to bring our own history and experience into the process of interpretation. That is the ideal response, because it means the listener/viewer is fully engaged and actually helping to tell the story themselves. Obviously, it’s possible to go completely off the rails with creative ambiguity, resulting in complete confusion in the audience. Best to avoid that!

How to Pick the Perfect Music for Your Video Projects

How to Pick the Perfect Music for Your Video Projects

Your title here

Click here to add and customize your text. What do you want to tell your contacts? You can format your text a few different ways - try bolding, underlining or writing in italics to emphasize what you want to say.

Your title here

Click here to add and customize your text. What do you want to tell your contacts? You can format your text a few different ways - try bolding, underlining or writing in italics to emphasize what you want to say.

Your title here

Click here to add and customize your text. What do you want to tell your contacts? You can format your text a few different ways - try bolding, underlining or writing in italics to emphasize what you want to say. You can even add a link that your contacts can directly click on. Just don't forget to highlight the text you want to link. Or try using Merge Tags to personalize your email. Once you're done adding and editing your text, remember to click 'Update' to save your changes.

Add your title here. Get their attention by bolding your title or formatting your text differently.

Click here to add and customize your text. What do you want to tell your contacts? You can format your text a few different ways - try bolding, underlining or writing in italics to emphasize what you want to say. You can even add a link that your contacts can directly click on.

This is a new Block from the admin

My new block style with the same style as the previous blocks. This is a new line

Add your title here. Get their attention by bolding your title or formatting your text differently.

Click here to add and customize your text. What do you want to tell your contacts? You can format your text a few different ways - try bolding, underlining or writing in italics to emphasize what you want to say. You can even add a link that your contacts can directly click on.