Sound as a character: native dialogue, voice, score and effects
In 2026 sound stopped being the last step: the main generators return ambience, effects and speech together with the image. This forces you to decide, shot by shot, what is born with the video and what comes in later, like the score and the narration. This lesson settles that decision in a sound map.
1Split the sound into layers: ambience, effect, line, score and silence
2Decide what comes out with the video and what goes in at the edit
3Choose score and voice with a clear license and your own voice
4Mix with the voice in front and the music underneath
Goal: decide, shot by shot, what is heard and what comes out with the video or separately, and build the scene's sound map.
01 · The sound layers of a shot
Five layers. Click each one and see where it usually comes from.
Click each block of the diagram to see what it does.
Rule of thumb: what comes from the action of the shot can come out with the video; what crosses shots goes into the edit.
02 · How to decide the sound, step by step
In the scene "The first batch", using the sound column of the shot list from course 0.
1. Native or separate
Native audio became the standard in 2026 in the main generators (dated examples, Oct/2026: Veo 3.1, Kling 3.0, Seedance 2.x, Runway Gen-4.5). Seedance 2.5 accepts up to 10 reference audios per generation.
Use native for what comes from the shot: ambience, the effect of the action, a short line. Keep separate what crosses shots, what has to sound the same in all of them, and what will change language.
In the batchWind and knocks on the door: native. Score and opening narration: separate, in the edit.
2. Layers and silence
Diegetic sound exists in the scene and the character hears it; non-diegetic sound only the audience hears, like the score. A well-resolved shot has ambience and the effect of the action.
Silence is a choice too: cut the music before the turning point, leave one shot with only the ambience, a breath after the impact. If you can show it, don't narrate it.
3. Licensed score and voice
Music generators change fast: Suno released v5.5 on 03/26/2026; a v6 and ElevenLabs' Eleven v3 appear only as reported, not confirmed by an official source. Read each tool's license of use before you publish.
Synthetic or cloned voice: only your own, or from someone who authorized it in writing (lesson 7). Free, local route: Concat cleans and levels the voice and has an AI voice.
4. Mix with a hierarchy
The voice dominates; the music stays atmospheric, underneath; the effect appears at the moment of the action. The most common mistake is leaving the music at the same volume as the voice.
Starting point: lower the score until the line is clear without effort, then check with headphones. Leave a few extra seconds of score for the exit fade.
03 · Templates to copy
The format the page checks, and a request for the AI assistant to draft the map from the shot list.
mapa-som.txt (template)
Scene: <name> (<duration> s)
Score: <style, where it comes in and where it goes out; with or without vocals>
# n | what you hear | origin
1 | ambience: <...>; effect: <...> | origin: <native or separate>
2 | line: "<short sentence>" | origin: <native or separate>
Request to the AI assistant (draft of the sound map)
You are a film sound editor. Read the shot list below and propose a sound map, one line per shot, in this format:
n | what you hear (ambience, effect, line, score or silence) | origin: native or separate
Rules:
- native = comes out with the generated video (ambience, effect of the action, short line);
- separate = goes in the edit (score, long narration, sound that repeats the same across several shots);
- only one origin per shot;
- leave at least one shot with only ambience before a line;
- on the first line, describe the score: style, where it comes in and where it goes out, no vocals under the line.
Shot list: <paste your shot list here>
04 · Check your sound map
Paste the file (or upload the .txt). Test first with the example that passes and the example with errors.
mapa-som.txt
05 · Optional: check in the terminal
Only for people who already use a terminal. In the folder of the course downloaded from GitHub; for your own file, replace --exemplo with its name (mapa-som.txt).
Terminal (in the course folder)
python3 conferir.py som --exemplo; echo "saída: $?"
python3 conferir.py som --errado; echo "saída: $?"
Example from the repository
$ python3 conferir.py som --exemplo; echo "saída: $?"
OK: 6 planos com camada de som e origem decidida
saída: 0
$ python3 conferir.py som --errado; echo "saída: $?"
Ainda não. O que falta:
- Falta a linha Trilha: com a descrição (pelo menos 8 letras).
- Plano 2: 2 escolhas de origem; fique com uma só.
- Plano 3: falta camada de som.
- Plano 4: falta camada de som.
- Plano 4: falta origem.
saída: 1
06 · Practice
The sound map of your scene, built from the sound column of your shot list.
Sound map · your scene
20 min
Write the Trilha line and one line per shot, with what you hear and the origin (nativo or separado). Paste it into "Check your sound map" and download the mapa-som.txt to the project folder.
Done when: the page answers OK: [n] planos com camada de som e origem decidida and the mapa-som.txt file is in the project folder.
Silence · a breathing shot
10 min
Pick the shot before the turning point of your scene and leave only ambience or silence in it, with no score and no line. Check again.
Done when: the page keeps answering OK: … and the shot before the turning point has only ambience or silence in your list.
07 · Quick quiz
Four questions. The explanation appears after each answer.
Question 1 of 4
The score of your film runs across all six shots. Where should it come from?
Correct
What runs across shots goes into the edit. Asking for the same music in six generations gives you six different pieces of music, cut at every shot.
Not this one
What runs across shots goes into the edit. Asking for the same music in six generations gives you six different pieces of music, cut at every shot.Review: The sound layers of a shot
Question 2 of 4
Which of these layers usually comes out well as native sound, together with the video?
Correct
Ambience and effect come from the action in the shot and sync on their own. Long narration, score and language swaps run across shots or change later: they stay separate.
Not this one
Ambience and effect come from the action in the shot and sync on their own. Long narration, score and language swaps run across shots or change later: they stay separate.Review: How to decide the sound, step by step
Question 3 of 4
Your mix is ready and the line disappears when the score rises. What should you fix?
Correct
Hierarchy: the voice dominates and the music stays underneath. Raising everything causes distortion; swapping the music without lowering the volume repeats the problem.
Not this one
Hierarchy: the voice dominates and the music stays underneath. Raising everything causes distortion; swapping the music without lowering the volume repeats the problem.Review: How to decide the sound, step by step
Question 4 of 4
You want to use a cloned voice in the narration. Which voice can it be?
Correct
Voice is a personal trait: cloning someone else's without authorization is imitation, with or without a label and with or without charging for it. Lesson 7 covers image and voice rights.
Not this one
Voice is a personal trait: cloning someone else's without authorization is imitation, with or without a label and with or without charging for it. Lesson 7 covers image and voice rights.Review: How to decide the sound, step by step
Quiz complete
You got {a} of {n} right. Get them all right and the lesson is marked as complete.
Choose an answer. The explanation appears after you try.
08 · To keep
Native or separateWhat comes from the shot goes out with it; what runs across shots goes into the edit.
Silence is soundA shot with only ambience before the turning point gives it weight.
The voice up frontMusic underneath, a spot effect, a check with headphones. Cloned voice: only yours or an authorized one.