---
name: Music Intelligence
slug: music-intelligence
category: Automation
description: Inspects cached local music analysis (BPM, beats, sections, tags) to plan and apply beat-synced video cuts for rhythm edits or musical structure questions.
github: "https://github.com/0xsline/OpenChatCut/tree/main/src/agent/skills/music-intelligence"
language: TypeScript
stars: 935
forks: 124
install: "npx degit https://github.com/0xsline/OpenChatCut/tree/main/src/agent/skills/music-intelligence ~/.claude/skills/music-intelligence"
installs_to: ~/.claude/skills/music-intelligence
source_path: src/agent/skills/music-intelligence/SKILL.md
collection_size: 27
category_size: 1523
collection_url: "https://dirskills.com/collections/0xsline/OpenChatCut"
added: 2026-08-11T07:20:15.901Z
last_synced: 2026-08-11T07:20:15.901Z
canonical_url: "https://dirskills.com/skills/music-intelligence"
---

# Music Intelligence

Inspects cached local music analysis (BPM, beats, sections, tags) to plan and apply beat-synced video cuts for rhythm edits or musical structure questions.

**Install:**

```bash
npx degit https://github.com/0xsline/OpenChatCut/tree/main/src/agent/skills/music-intelligence ~/.claude/skills/music-intelligence
```

## README

# Music Intelligence

1. Call `inspect_music` first. It only reads an existing local Beat This + CLAP cache; it never downloads models or starts analysis.
2. Before editing, call `music_edit_plan` and show its bounded cut/target summary. Prefer `timing:auto`; choose sparse, medium, or dense from the requested pace.
3. Only after the plan is accepted, call `sync_cuts_to_music` with the returned `analysisRef`. It recomputes the plan, rejects stale analysis, skips locked video tracks, and applies all splits as one undo step.
4. If analysis is missing, tell the user to install `rhythm-lite` and `music-semantics-lite` locally if needed, analyze the media-pool asset in the UI, then retry. Never trigger heavy analysis from an Agent tool call.
5. Never request, return, quote, summarize, or place the CLAP embedding in model context. Use tags, sections, confidence, and the opaque `analysisRef` only.

## Preconditions

- Analysis is opt-in and on-device. The media-pool asset must already have a cache for its current `sourceRevision`.
- `rhythm-lite` supplies Beat This rhythm data; `music-semantics-lite` supplies CLAP tags and the private similarity vector.
- An Agent call must never install a pack, download a model, decode media, or start inference. Direct the user to Settings and the media-card analysis action when the cache is unavailable.

## Inspect

- Identify the BGM by `itemId`, `assetId`, or an unambiguous name. Prefer the timeline item when the user intends to edit, because returned points are then mapped to timeline frames through the clip trim and playback rate.
- `inspect_music` returns BPM, meter, confidence, tags, sections, counts, and bounded point lists. Lists are capped at 48 beats, 24 downbeats, 16 sections, and 12 tags; use a narrower range when `truncated` is true.
- Treat `analysisRef` as opaque. It binds later planning and execution to the exact cached analysis without exposing the 512-value CLAP embedding.

## Plan

- `timing:auto` chooses section → downbeat → beat for sparse edits, downbeat → beat → section for medium edits, and beat → downbeat → section for dense edits.
- Density samples every fourth, second, or first candidate for sparse, medium, or dense respectively.
- Plans are bounded to 96 cut frames and 64 overlapping video targets. Report the returned summary and any cap or locked-target warning before applying.
- A plan targets video clips that overlap the selected BGM range. It must never include or mutate the BGM item itself.

## Apply and recover

- Pass the same `itemId`, timing, density, range, target ids, and `analysisRef` to `sync_cuts_to_music`. Execution recomputes the plan from current state; do not replay an old list of frames.
- A missing or stale ref means the project or analysis changed. Call `inspect_music`, then `music_edit_plan`, and ask for acceptance again.
- Locked video tracks are skipped and reported. Never unlock a track implicitly.
- Successful splits are submitted as one `EditorCommands.batch`, so the whole rhythm edit is one undo step.