--- name: Video Production slug: video-production category: AI Engineering description: Video Production composes gflow into a finished video with continuity, audio, captions, and clip assembly. Use it when you need scripted scenes, consistent characters or locations, or to fix drift, sync, or generation failures. github: "https://github.com/ffroliva/gflow-cli/tree/develop/skills/video-production" language: Python stars: 173 forks: 47 install: "npx degit https://github.com/ffroliva/gflow-cli/tree/develop/skills/video-production ~/.claude/skills/video-production" installs_to: ~/.claude/skills/video-production source_path: skills/video-production/SKILL.md collection_size: 18 category_size: 3670 collection_url: "https://dirskills.com/collections/ffroliva/gflow-cli" added: 2026-09-08T05:33:30.044Z last_synced: 2026-09-08T05:33:30.044Z canonical_url: "https://dirskills.com/skills/video-production" --- # Video Production Video Production composes gflow into a finished video with continuity, audio, captions, and clip assembly. Use it when you need scripted scenes, consistent characters or locations, or to fix drift, sync, or generation failures. **Install:** ```bash npx degit https://github.com/ffroliva/gflow-cli/tree/develop/skills/video-production ~/.claude/skills/video-production ``` ## README # video-production **Core principle: control is everything.** Every guard-rail you put in front of the engine is drift you do not pay for later. Lock the shape, the cast, the location and the words before spending, then gate every clip on evidence rather than impression. This skill covers **composing gflow into a finished video**. It does not restate the command surface — that is the [`gflow-cli` skill](../gflow-cli/SKILL.md), which owns per-command syntax, flags and single-shot recipes. Load that one for "how do I call `t2v`", this one for "how do I turn a script into a film that holds together". ## How to read the claims in this skill Every non-obvious statement is tagged. **This is one calibrated approach, not the only one.** Other people drive this engine with techniques not tracked here; absence from this document means untested, never forbidden. | Tag | Meaning | You may | |---|---|---| | **[CONSTRAINT]** | the engine refuses, fails, or silently drops the request | not deviate | | **[CALIBRATED]** | measured here, sample size and conditions stated | deviate with evidence | | **[CONVENTION]** | one shape that works; alternatives exist | deviate freely | | **[UNEXPLORED]** | known to exist, not tested here | try it, then add a task | ## When NOT to use this skill A single clip with no continuity requirement, one image, or a pure command-syntax question — use the `gflow-cli` skill. Editing or grading existing footage — this is generation, not post. Any engine that is not Flow. ## Prerequisites **Everything gflow** — Python 3.11+, `uv`, an installed `gflow`, Playwright Chromium, a signed-in profile, Flow access — belongs to the [`gflow-cli` skill](../gflow-cli/SKILL.md)'s Prerequisites. Run its checks; do not restate them. This skill adds three: 1. **`ffmpeg` and `ffprobe` on PATH, 5.0 or newer** — `ffmpeg -version`. The assembly step uses `-fps_mode`, which does not exist before 5.0. 2. **An ffmpeg carrying `libass` and `libfreetype`** — the same banner lists enabled libraries. Burned subtitles (`subtitles`) and title cards (`drawtext`) are absent from minimal or "essentials" builds. Usual Windows trip. 3. **`faster-whisper`, only if you want the transcript gate** — `python -c "import faster_whisper"`. **Nothing in gflow installs it.** First run pulls `base.en`, ~75 MB, once. Without it you lose the word-hit check and keep every other gate. `clip_qa.py`, beside this file, needs **only ffmpeg, ffprobe and the standard library** — so the fluidity, lip-sync and A/V-drift gates still run where the transcript gate cannot. ## Step 1 — intake, before anything else The plan changes completely with the answers. Ask, or read them from the brief; do not assume. | Question | Why it changes the plan | |---|---| | What is the deliverable, and who watches it? | a rehearsal reference tolerates flaws a client cut does not | | Does anyone speak **on camera**? | decides dialogue budgeting, lip-sync gating, and i2v-vs-r2v | | Is audio generated, added later, or discarded? | Veo always generates audio **[CONSTRAINT]** — see below | | Captions: none, burned-in, or a sidecar file? | burned-in needs `libass` and a timing source | | One location or several? How many camera angles each? | drives the plate-chaining work in `consistency.md` | | Recurring people? How many in frame at once? | one face-bearing reference per generation **[CONSTRAINT]** | | A prop that must not change? | needs its own sheet with a scale anchor | | Aspect, total length, credit ceiling | 16:9 or 9:16; clips are 4/6/8, or 10 on omni-flash | | One-off, or a repeatable pipeline? | decides the production shape in `composition.md` | **Veo always generates audio [CONSTRAINT].** There is no silent mode and omitting sound from the prompt does not produce silence. A "silent" montage returns invented room tone under every shot. If the audio is unwanted, strip it at assembly (`-an`) rather than hoping for a quiet clip. ## Step 2 — check the host, or the whole plan is dead Load `https://labs.google/fx/tools/flow/project/` in the profile's Chrome and read the **final** URL. | Lands on | Lane | What runs there | |---|---|---| | `labs.google/fx/…` | **A, full** | everything | | `flow.google.com/project/…` | **B, partial** | `video t2v --project`, `video i2v --initial-frame --project`, and **`video r2v --ref --project`** (ported in v0.70.0, #683). Everything else — `image`, `character create`, `extend`, `scene create`, `movie run`, r2v by `@Name` or `--reference-entity`, and i2v by media UUID / `@Name` or with `--end-frame` — exits 36 **[CONSTRAINT]** | Lane B grows as forms are ported, so **confirm the row rather than trusting it**: the maintained list is [CONFIGURATION § `GFLOW_CLI_FLOW_HOST`](../../docs/CONFIGURATION.md#gflow_cli_flow_host) and the [#639 entry in KNOWN_ISSUES](../../KNOWN_ISSUES.md). Exit 36 on a form the table says is ported is a regression worth filing, not the environment. An unported command on lane B exits **36**, non-retryable, with a message naming the migration. A `RecaptchaError` instead means one of two other things: on gflow ≤ 0.68.0 the migration guard ran *after* the reCAPTCHA mint on the image path, so image commands died as exit 1 there (gflow-cli#673, fixed); on any build, a `RecaptchaError` right after `gflow auth login` is the cookie harvest keyed on the old host (gflow-cli#644). Either way the first move is the same: **read the final host URL before anything else.** Do not plan entities or plates before this check. **There is a `gflow project create` [CONSTRAINT].** `gflow project create --name --json > out.json`, redirected to a file, never piped through `head`, which truncates the process before the JSON prints. Do not mint a project by burning a placeholder generation, and do not scrape the id from a browser URL. ## Step 3 — the production shape Pick one; each has a worked command chain in **[`composition.md`](composition.md)**. | Shape | When | Driver | |---|---|---| | One-off sequence | a scene, an audition, a montage | shell, clip per beat | | Manifest-driven | a script that will be re-run as it is edited | `movie run` with a stable scene id per slot | | Continuous shot | one camera move longer than 8 s | `video extend` | | Deliberate cut with continuity | a new angle that must match the last frame | `video chain` | | Assembly only | clips already exist | `scene create` (free) | ## Step 4 — lock the assets before spending ### 4a. The identity resolution ladder — deterministic, and you record the rung A person in a shot is anchored by exactly one of these. **Take the highest rung the host and path allow, and write down which rung you used and what blocked the one above.** This is not a preference order, it is the production record: a film whose log does not say how each shot was anchored cannot be debugged when a face drifts. | # | Anchor | What it carries | Use when | |---|---|---|---| | **1** | **Character entity** — `@Name` or `--reference-entity ` | face **and** wardrobe **and** voice, server-side, durable | always, unless a rung-1 blocker is recorded | | **2** | **That entity's own generated plate** — `--ref ` | face and wardrobe, as a flat image | rung 1 refused by the host/path | | **3** | **A plate cut from an approved take** — `--ref ` | face, plus that take's grade, light and artefacts | no entity exists | | **4** | **Prose canon only** | a *type*, never an identity | nothing else is available | **Rung 4 does not hold a person.** Each generation invents someone new who merely matches the description. Two shots on rung 4 are two different actors. Never plan a multi-shot piece on it and never let it be the silent default. **Rung 3 carries contamination.** v1's opening take came back with 72 px letterbox bars and its plate carried those bars into every shot that referenced it. A rung-2 plate is generated clean by the character editor; a rung-3 plate is only as clean as the take it was cut from. **Descending a rung is a decision that gets written down**, in `production.json` next to the shot, naming the blocker. "I used an image" is not a record; "rung 2, because `--reference-entity` exits 36 on this host (#639)" is. > **Written from a run that skipped its own ladder.** On 2026-09-07 a five-shot film created > two real character entities and then anchored every shot on rung 2, because gflow refuses > entity references on the migrated host. The refusal was never questioned — and a $0 probe > the same day showed the host takes an entity mention perfectly well > (`data-reference-type="entity"` with the real `entity_id`); it is gflow that has not ported > the gesture. The run went a rung lower than it had to and recorded it only in passing. ### 4b. Entity beats media when a name matches both [CONSTRAINT] Flow's `@` picker offers **character entities and media assets in one list**, and a query matching both can resolve to either — measured 2026-09-07: the same `@Kael` returned `reference_type="entity"` on one gesture and `reference_type="media"` (a JPEG that happened to be named after him) on another. **Flow does not rank them.** So you rank them. When a name matches a character and a file, the **character wins**, and if you meant the file, reference it by path (`--ref `) rather than by name. A shot that silently binds a still image where you asked for a character produces footage that looks right and drifts on the next cut. ### 4b-bis. A cast with VOICES — the whole recipe, end to end A character entity is the only thing that carries a **voice**. A plate does not: it carries face and wardrobe as pixels, and the engine invents a new voice for every clip. Measured 2026-09-07 on one character across three plate-bound takes: **88 Hz, 103 Hz, 118 Hz** — three different actors — against an engine noise floor of **4.3 Hz** on an identical prompt repeated three times. No re-shoot fixes that, because nothing in a plate was ever carrying the voice. So if anyone speaks more than once, you need rung 1. Here is the whole path. **1 — pick the voice before you create anyone.** `gflow character voices` lists 29 presets. Each has a public sample you can actually listen to, so audition rather than trust the descriptor — five of the 29 descriptors disagree with the measured pitch of their own sample: ```bash gflow character voices --json # every voice has: https://gstatic.com/aitestkitchen/voices/samples/.wav ``` **2 — create the character with the voice bound.** Face, body and voice in one call: ```bash gflow character create --project "$PROJECT" \ --name "" \ --face-prompt "a man, " \ --body-prompt "" \ --voice "" \ --personality "" \ --json > cast_.json ``` Three traps, each measured: - **The name must collide with nothing in the media library.** Flow's `@` picker searches characters and media together and does not rank them (4b), so an uploaded `kael_ref.jpg` wins the query `@Kael` and your character becomes unreachable by name. **Never name a plate after a character**; `plate_a.png`, not `_ref.jpg`. - **A face prompt with no gender word gets a gender chosen for it.** This fires on the prose canon too, not just on `character create` — a two-hander whose unbound actor is described without one renders the wrong person. - **Keep the `entity_id` yourself.** Read it from `--json` at creation. Do not plan on recovering it from the catalog afterwards. **3 — attach the character to every shot they appear in.** ```bash gflow video t2v "" --project "$PROJECT" \ --reference-entity "" \ --reference-entity-name "" \ --aspect 16:9 --duration 8 ``` One face-bearing reference per generation **[CONSTRAINT]** — so in a two-hander, bind the person who **speaks** and carry the other in prose. Getting that backwards is what produced the 88 Hz stranger above: the beat bound the silent actor, so the speaker fell to rung 4. **4 — expect the submit to outlive your patience, and do not read a timeout as a failure.** Flow allows **five concurrent generations** and throttles per-minute throughput after heavy daily use, so a queued job routinely outlives gflow's submit-reply budget. An entity-bound run can exit **9 `TransportTimeoutError`** while the video is rendering normally — the job is in Flow's queue and will finish. Check the project before you re-submit, or you will double-spend on a generation you already have. (gflow-cli #723, #741.) **5 — verify the voice actually landed, relatively.** Never assert an absolute band: a character legitimately speaks differently in an action beat than in a quiet one, and the pitch follows the performance. The two sound comparisons are: - **the same character across comparably-staged shots** — the medians should sit close - **a bound take against that voice's own public sample** — the same neighbourhood And stage every dialogue beat in **still air**. An energy gate is not a voicing gate: on this production's own wordless clips the detector reported a confident 145 Hz and 280 Hz with no speech present at all, and periodicity did not separate them either. A beat shot in wind cannot be checked. ### 4c. A costume is part of the identity, so a costume change is a NEW entity [CONSTRAINT] A Flow character entity bundles face **and** wardrobe — the body reference fixes the outfit. There is no wardrobe axis inside one entity. So a character who changes clothes is **two entities sharing a face prompt**, with different body prompts, named for the costume state: ``` Kael_ridge face_prompt= body_prompt= Kael_coat face_prompt= body_prompt= ``` The face prompt must be **byte-identical** across costume states; only the body prompt moves. Then every scene names the costume-state entity, not the character, and continuity becomes a lookup instead of a hope. **This is not what `movie.toml` does today [CONSTRAINT].** `Character.variants` is a `Mapping[str, str]` and `resolve_variant()` appends a text delta to the prose appearance (`composition.py:67-80`), while the runner creates exactly **one entity per character name** (`cli_movie.py:589-597`). On an `identity = "entity"` character a variant therefore changes the *words* while the entity's body plate keeps the original outfit, and the two argue inside one generation. Until that is fixed, express costume states as **separate entries in the manifest's characters array**, each with `identity = "entity"` and a shared face prompt — not as `variants`. See [MOVIE.md](../../docs/MOVIE.md) for the TOML. Full method in **[`consistency.md`](consistency.md)**. The rest of the short form: - **People** are Flow CHARACTER entities, attached with `--reference-entity` or `@Name`. Identity. - **Locations and props** have no entity type **[CONSTRAINT]** — they are images attached per shot with `--ref`. Look. - **One face-bearing reference per generation [CONSTRAINT].** A second entity, or an entity plus a portrait, returns HTTP 400 reported as a wire-format error. Carry other people as role nouns in prose. - **Multi-angle locations must be chained, not generated in parallel [CALIBRATED]** — anchor angle by `t2i`, every other angle by `i2i --ref `. Independent calls from the same paragraph produce different rooms. - **The reference count picks the model, before quality does [CONSTRAINT].** Caps are per model and the entity counts against the same pool: `omni-flash` 7, `veo-lite` / `veo-fast` / `veo-lite-lp` 3, **`veo-quality` 0 — it accepts no references at all**. So a shot carrying any `--ref` or entity cannot use `veo-quality` however much you want its quality. For a **single** generation needing references and quality together, that makes `omni-flash` the pick; a `veo-lite` variant when 3 refs is enough. **`video chain` is the exception [CONSTRAINT]** — it refuses `omni-flash` outright (its i2v is wire-verified for single generations only) and exits with a model/mode incompatibility, so chained links take a Veo 3.1 model and its cap of 3. Full table, image models included: [`consistency.md`](consistency.md). - Attaching by media UUID buys asset identity, never scene coherence. ## Step 5 — beat sheet One row per clip: id, camera setup, action, lines with delivery, duration, model, references. - **Durations are 4/6/8, plus 10 on omni-flash [CONSTRAINT].** `--duration` requires an explicit `--model`; omitted, it binds `veo-lite`, which renders no duration control, and exits 2. - **≤ 2.5 spoken words per second [CALIBRATED, 25 clips, one model]** — 8 s ≈ 18 words, 10 s ≈ 24. Above it, delivery rushes and the last sentence is cut. - **Never rewrite the script to fit.** Split a long speech across beats; the words are the deliverable. - Two speakers per beat is fine with the order explicit; three is where sync breaks **[CALIBRATED]**. - One moment per clip. A beat with a second of action inside eight seconds invents material to fill the rest **[CALIBRATED]**. - Named camera setups and a declared 180° axis: see `consistency.md`. ## Step 6 — prompt shape `style → setting → geometry → cast → setup → action → dialogue → avoid`. - **Never name a film format** — "35mm", "IMAX", "film grain" draw a sprocket-hole border or change the medium **[CALIBRATED]**. Say "full-frame 16:9 image edge to edge" and put border, letterbox and vignette in the avoid list. - **That avoid-list entry is not sufficient on its own [CALIBRATED, 4 clips, veo-quality].** A shot opening "Cinematic close portrait…" returned 72 px letterbox bars top and bottom *while* carrying "full-frame 16:9 image edge to edge" and "letterbox bars" first in its avoid list. The word **cinematic** appears to be enough on its own; no format was named. Restating it positively and explicitly — **"full-frame 16:9 image filling the entire frame edge to edge, no bars, no border"** — returned three consecutive bar-free shots with everything else held constant. Measure it, do not eyeball it: `cropdetect` reported nothing on the bar-carrying clip, so check the frame's own dark-row extents instead. A plate cut from a barred clip carries the bars into every shot that references it. - **No age words near a person [CONSTRAINT].** One age phrasing failed eight generations running; a relational or role noun passed immediately with everything else held constant. Minors are refused outright. - Dialogue as prose with the delivery **before** the words: `NAME says, weary: …`. Levers, most to least reliable: volume, emotional state, pace, register, physical condition, accent. - The avoid list holds artefacts only. **Negations that name an action do not suppress it** — restate positively. - ~1,100–1,400 characters **[CALIBRATED]**; longer prompts have returned 400. - Nothing in frame carries text unless you have a glyph master. Whatever carries text invents text. ## Step 7 — trial one beat, then batch in pairs Generate **one** clip, run the gates, fix the template, then continue **two beats per foreground call** **[CALIBRATED]**. A detached background run lost a clip mid-poll and a template bug repeats once per clip at full price. Never loop a retry into a refusal. ## Step 8 — gates Nothing is accepted on impression. Run `clip_qa.py`; add the transcript check when speech matters. ```bash python clip_qa.py # fluidity, lip sync, A/V drift, per clip python clip_qa.py final.mp4 # the assembled cut python clip_qa.py --selftest # prove the detector before believing it ``` Directory mode matches **exactly** `[a-z]{2}\d{2}.mp4` — two letters then two digits, e.g. `ka01.mp4`. Descriptive names and `0100.mp4` both silently match nothing and report "no clips matched", which reads like a pat