music-to-storyboard

Compare original and translation side by side

🇺🇸

Original

English
🇨🇳

Translation

Chinese

/music-to-storyboard — Music → Storyboard

/music-to-storyboard — 音乐 → 分镜脚本

Generate a shot-by-shot storyboard from music analysis, with shot types, camera movements, visual descriptions, mood, and transitions. Output is compatible with pull-film's storyboard-generator format.
通过音乐分析生成逐镜头分镜脚本,包含镜头类型、摄影机运动、视觉描述、氛围以及转场效果。输出格式兼容pull-film的storyboard-generator。

Usage

使用方法

/music-to-storyboard <audio_file_or_analysis_json>
Accepts either an audio file (runs analysis first) or a previously saved analysis JSON.
/music-to-storyboard <audio_file_or_analysis_json>
支持传入音频文件(会先执行分析)或已保存的分析结果JSON文件。

Steps

步骤

  1. Validate input (audio file or JSON)
  2. Generate storyboard:
bash
python3 -m music_analyzer storyboard "<input_path>"
  1. Present storyboard as a table or sequence:
    • Shot # with section label and time range
    • Shot type: wide, medium, close-up, etc.
    • Camera movement: static, dolly, orbit, etc.
    • Visual description (Chinese + English)
    • Transition to next shot: cut, dissolve, fade
    • Energy level and mood
  2. Suggest using
    /storyboard-generator
    from pull-film to create the visual storyboard
  1. 验证输入(音频文件或JSON)
  2. 生成分镜脚本:
bash
python3 -m music_analyzer storyboard "<input_path>"
  1. 以表格或序列形式展示分镜脚本:
    • 镜头编号:包含段落标签和时间范围
    • 镜头类型:全景、中景、特写等
    • 摄影机运动:静止、推轨、环绕等
    • 视觉描述(中英双语)
    • 转场至下一个镜头:切镜、溶解、淡入淡出
    • 能量等级和氛围
  2. 建议使用pull-film的
    /storyboard-generator
    来创建可视化分镜脚本

Section → Shot Mapping

段落→镜头映射

SectionDefault ShotCameraVisual Treatment
IntroWide → MediumSlow dolly inEnvironment establishing
VerseMedium, Close-upStatic, slow panNarrative focus
ChorusWide, Close-upOrbit, fast pushVisual climax
BridgeClose-up, WideSlow dolly outContrast, reflection
OutroWideSlow pull-outClosure, fade
段落默认镜头摄影机视觉处理
开场全景→中景缓慢推轨入环境铺垫
主歌中景、特写静止、缓慢摇镜叙事聚焦
副歌全景、特写环绕、快速推镜视觉高潮
桥段特写、全景缓慢推轨出对比、反思
结尾全景缓慢拉远收尾、淡入淡出

Output Format

输出格式

Compatible with pull-film's storyboard-generator:
json
{
  "song_title": "example.mp3",
  "total_duration": 240.5,
  "bpm": 128.0,
  "shots": [
    {
      "shot_number": 1,
      "section": "intro",
      "time_range": {"start": 0, "end": 15.5},
      "shot_type": "wide",
      "camera_movement": "slow dolly in",
      "visual_description_zh": "...",
      "visual_description_en": "...",
      "transition": "fade",
      "energy_level": 0.3
    }
  ]
}
兼容pull-film的storyboard-generator:
json
{
  "song_title": "example.mp3",
  "total_duration": 240.5,
  "bpm": 128.0,
  "shots": [
    {
      "shot_number": 1,
      "section": "intro",
      "time_range": {"start": 0, "end": 15.5},
      "shot_type": "wide",
      "camera_movement": "slow dolly in",
      "visual_description_zh": "...",
      "visual_description_en": "...",
      "transition": "fade",
      "energy_level": 0.3
    }
  ]
}