PTENES
INEMA.CLUB
0 of 5 read

Module 3.5 · Track 3 · AI Filmmaking Workflow

Integration Luma and Runway

The finishing touch, directed through conversation. Luma (with Uni-1) is no longer an image or video generator—it’s a filmmaking environment where you speak as you would with a human collaborator. The system remembers the project context, and you direct instead of typing commands.

Reading now ~18 min · full module 5 sections

What you will understand

  • Why Luma (Uni-1) is a cinematic environment, and not a generator—is what Unified Intelligence does for coherence.
  • The difference between write commands and direct by talking — and why speaking naturally helps AI understand intent.
  • The practical workflow in three steps: create the character, direct the cinematic shot, animate.
  • How compare outputs (Kling x Ray) and choosing the one that serves the vision — refining through natural language.
Section 1 of 5·The environment

1.A cinematic environment, not a generator

The key shift in this lesson is in one sentence: Luma, with the model Uni-1, it’s not “just another image or video generator”—it’s a cinematic creative environment where you act as a director, not a prompt engineer.1 The difference isn’t cosmetic. A generator treats each request as an isolated event; a cinematic environment understands that you’re building a film, with continuity between the parts.

What makes this possible is the Unified Intelligence: the system remember the project context, so the film remains visually and narratively coherent. According to the source, this has three practical consequences: you no longer need to keep switching tools at every step; the characters remain consistent between shots; and the the lighting, style, and tone stay consistent. Everything that took manual effort in earlier stages— keeping the same face, the same palette—is now remembered by the environment itself.

Why this solves the pipeline problem

The previous lessons taught you to enforce continuity by force: reference the character in Freepik, repeat the physics in Seedance, justify each movement in Kling. Uni-1 changes the nature of the work by carrying the context for you. You still direct — but you direct a memory, not a blank page with every request. That’s why the lesson treats Luma as the refinement of the pipeline: it is where the pieces built earlier gain the coherence of a film without you needing to recreate the context for every shot.

Fig. 1 · Standalone generator x environment with memory project
ISOLATED GENERATOR each isolated request — disconnected ENVIRONMENT WITH MEMORY PROJECT CONTEXT same character · same light · same tone

Stop and predict

In previous lessons, keeping the same face across shots required manually referencing the character shot by shot. What changes when the environment “remembers the project context”?

See one possible answer

Continuity stops being your task becomes environment ownership. Instead of reattaching the character reference to every request, you direct from a persistent memory: Uni-1 already knows who the character is, what the lighting is like, and what the tone is. You spend less energy maintaining consistency and more energy making directing decisions.

Section 2 of 5·Directing

2.Direct by talking, not commanding

The second shift is in the way of speaking. You don’t write technical commands—you speaks, describes, and directs, as you would with a human collaborator. Ask, describe the scene, adjust. This shift in register is not a minor interface detail: it changes what the AI can do with your request.2

The source explains why this works. When you speak naturally, three things happen: the AI understands the intention, not just keywords; it remember the context between the steps; and you stays in a creative mindset, instead of slipping into technical mode. The synthesis is elegant: you're not giving a prompt — you're directing your creative partner. Natural language is what keeps you in the director’s chair.

Refinement is also a conversation

The refinement follows the same approach. Instead of rewriting an entire prompt, you have a conversation: “keep everything the same, just add a cowboy on the left,” “make the jump more realistic,” “improve the cinematic flow.” Because the environment carries the context, these incremental requests work—it knows what “everything” means when you say “keep everything the same.” Iterating stops being redoing; it becomes engage in dialogue.

The same intention, written as a blunt command and as conversational direction— the version below is what Uni-1 expects:

# Bare command vs. conversational direction # A) command style (avoid) — treated as isolated keywords cmd: cowboy, golden hills, drone, gallop, jump, cinematic, 16:9 # B) direction style (use) — natural language, intent + context say: "Hey — let's open on an ultra-wide drone shot, top-down over the golden hills at dawn. Then flip down to our cowboy riding at full gallop, jumping between the cliffs. Keep it cinematic and photorealistic, 16:9." # refine by talking: "keep everything the same, just add a cowboy on the left."
Fig. 2 · Keyword becomes just a word; conversation becomes intention + context
KEYWORDS cowboy drone jump loose fragments without intention CONVERSATION “open on a wide drone shot...” intention context creativity you direct a partner — you don’t prompt
▸ Going deeper: attaching images as references optional

Optional layer, useful when you already have frames from previous lessons.

The conversational workflow accepts images as a starting point—you don't need to start from scratch. To direct from an image, just attach it and describe the camera, the action, and the feeling you want; if there are several (three in the source example), select them all at once. This completes the pipeline: the final frames that you built in Freepik (Module 3.2) and animated in Seedance (Module 3.3) come in here as references, and Uni-1 uses them to maintain identity while directing the shot. Refinement literally becomes a conversation about the material you already have.

Section 3 of 5·Character

3.Step 1: create the character

The practical workflow for the lesson has three stages, each entirely in conversational language. The first is create the character — and it exists for a continuity reason: asking for a complete character sheet (character sheet) locks in the face, outfit, and proportions for the entire film. Without this anchor, each shot risks a slightly different character; with it, the identity is fixed from the start.3

The request is phrased as a conversation, with a character description and an explicit request for front, side, and back views — all with the same face, same outfit, same proportions. A practical warning the source repeats throughout the whole track: AI may start by generating just one view; guide step by step; iteration is key. You don’t get the complete sheet in one request — you build it through conversation, adjusting until the three views line up.

The natural-language request for a character sheet, locking in consistency — ready for Luma:

# Luma (Uni-1) — Step 1: character sheet (locks face, wardrobe, proportions) say: "Hey, let's create our main character. I need a cinematic, photorealistic cowboy in his early 40s — rugged, broad shoulders, strong build. Dressed in a fringed suede jacket, denim, worn leather boots and a classic cowboy hat. Please generate a full-body character sheet with front, side and back views. All three must share the SAME face, SAME outfit, SAME proportions. Straight, relaxed posture, clean clothes, natural lighting, subtle film grain, clean background. Make it look like a real film still, 16:9." # tip: the AI may start with one view — guide it step by step, iteration is key. # keep the character generic — do not replicate any real identifiable person.
Fig. 3 · A character sheet locks the identity for the entire film
front side back SAME FACE · SAME WARDROBE identity anchor the same in every shot

Stop and predict

Why is the first step in the workflow a character sheet with three views, and isn’t that already the first shot of the scene? What does this sheet prevent later on?

See one possible answer

It prevents the identity drift. The sheet locks the face, wardrobe, and output proportions, giving the setting a stable reference for all the following shots. If you started with the first shot, each new shot would risk a slightly different character—and inconsistency between shots is exactly what gives away an AI film. Locking the identity first is what keeps the film believable.

Section 4 of 5·Directing + animating

4.Stages 2 and 3: directing and animating

With the character locked in, the Stage 2 is directing a cinematic shot — now thinking like a director. You describe the shot in natural language and control the four levers you already know from previous lessons: camera movement, composition, light, and emotion. In the source example, an ultra-wide drone shot, looking down over golden hills, dives toward the cowboy galloping and jumping between cliffs. Refining follows the logic of conversation: “keep everything the same, just add a cowboy on the left”.4

A Stage 3 is bringing the shot to life — animate. Here you describe the movement you want: “make the camera feel like a fast drone, sweeping around the rider, high energy, realistic movement”. Then you refine it through conversation: “make the jump more realistic”, “improve the cinematic flow”. Notice that the three stages—create, direct, animate—are the same arc as the entire pipeline (image → direction → motion), condensed into a single conversational environment. What changed wasn’t the grammar; it was the interface, which now carries the context for you.

The prompts for steps 2 and 3, in sequence—direct the shot and then animate it, both through conversation:

# Luma (Uni-1) — Step 2: direct the shot (camera, composition, lighting, emotion) say: "Give me an ultra-wide drone shot, top-down over the golden hills at dawn. Then flip the camera down to the cowboy riding at full gallop, jumping between the cliffs. Cinematic, photorealistic, dramatic low sun, wide negative space." refine: "Keep everything the same, just add a cowboy on the left." # Step 3: animate the shot (describe the movement, then adjust) say: "Make the camera feel like a fast drone sweeping around the rider — high energy, realistic motion." refine: "Make the jump more realistic." / "Improve the cinematic flow."
Fig. 4 · Create, direct, animate — the entire pipeline condensed into a conversation
1 · create character sheet 2 · direct camera, light, emotion 3 · animate movement + flow REFINE THROUGH CONVERSATION AT EVERY STAGE image → direction → movement — the same arc, now in a single environment

Notice how each step has its refinement loop: you never have to get it right on the first try. Create → adjust the sheet; direct → adjust the composition; animate → adjust the movement. Conversational iteration drives the workflow — and because the environment remembers the context, each adjustment preserves what was already right instead of starting over.

Section 5 of 5·Compare

5.Compare outputs and choose

A practical differentiator wraps up the lesson: you can compare outputs of different models — for example, Kling versus Ray (3.14) — and choose the one that best serves your vision.5 This brings back, at the shot level, the routing logic from Module 3.1: the right tool isn't the “best” in the abstract, but the one that delivers what this precise scene. One model may give you smoother movement; another, more believable texture. You judge by the result, not the brand.

This habit of comparing and choosing is what connects Luma and Runway in the pipeline. Runway, as we saw in the map, brings precise control, motion editing, and VFX-style workflows — and shines precisely where you need to adjust a movement detail with more control. Luma brings the conversational environment and atmospheric motion. Used together, they cover the refinement of the pipeline: Luma directs and generates; Runway penalizes and edits. The choice between them — and between the outputs each produces — is the final directing decision before editing.

The end of the workshop—and what comes next

The source assignment summarizes the workflow: do three things with the assistant—create the character sheet, generate a cinematic shot, and animate the shot. It’s the entire track pipeline, in miniature, inside a conversational environment. Sum up the module in one sentence: in Luma, you don't write commands — you direct a partner that remembers the context, and compare outputs to choose the one that serves the scene. That wraps up the Trilha 3 workshop: you now know how to build a scene, add movement, direct the camera, and refine by talking it through. The next track explores camera language — the grammar that turns these streams into real cinema.

Fig. 5 · Compare and choose — the right tool is the one that serves this scene
direction output · Kling output · Ray the vision choose MONTAGE →

Notice how the arc closes: Track 3 opened with the map— image, motion, refinement, editing—and ends exactly where refinement hands the chosen shot over to editing. You’ve worked through the whole workshop: Freepik built it, Seedance moved it, Kling directed the camera, Luma and Runway refined it. What held it all together, from the first module to the last, was the same thesis: the tool executes your direction — it doesn't invent it.

Before moving on: four quick checks

No grades, no score. Answer from memory, then reveal the answer to compare.

01What does Uni-1’s Unified Intelligence change about the work?Reveal

It remember the project context, so the character, lighting, style, and tone stay consistent across shots. Continuity stops being a manual task for you and becomes a property of the environment—you direct a memory, not a blank slate with every request.

02Why does natural language work better than giving commands?Reveal

Because AI understands the intention (not just keywords), remembers the context between steps and keeps you in a creative mindset. You're not prompting—you're directing a creative partner, including during refinement (“keep everything the same, just...”).

03What are the three stages of the workflow, and why start with the character?Reveal

Create the character → direct the shot → animate. Start with the character sheet (three views, same face/outfit/proportions) because it locks the identity for the entire film—prevents the shot-to-shot drift that gives away an AI film.

04Why compare outputs (Kling x Ray), and why do Luma and Runway complement each other?Reveal

Because the right tool is the one that serves this scene, not the “best” in the abstract — you judge by the result. Luma brings a conversational environment and atmospheric movement; Runway brings precise control and VFX-style motion editing. Together, they cover the refinement of the pipeline.

❧ My journey

In this module
0 of 5 sections read
In track 3
0 of 24 topics
In the course
0 of 138 covered
Continue — next track
Module 4.1 — Cinematography (Camera Language)
Next →