Image-to-Video — Pro Pack on RunComfy

npx skills add agentspace-so/runcomfy-skills --skill image-to-video -g

Pick the right model for the user's intent

audio_url

audio_url

audio_url

Prerequisites

1. RunComfy CLI —

   npm i -g @runcomfy/cli

2. RunComfy account —

   runcomfy login

   opens a browser device-code flow.
3. CI / containers — set

   RUNCOMFY_TOKEN=<token>

   .
4. A source image URL — JPEG/PNG/WebP, min 300px, ≤10MB; aspect 1:2.5 to 2.5:1 (HappyHorse) — other models have similar specs.

Route 1: HappyHorse 1.0 I2V — default for portrait / product / general animation

happyhorse/happyhorse-1-0/image-to-video

Schema

image_url

prompt

resolution

1080P

720P

1080P

duration

seed

watermark

Invoke

runcomfy run happyhorse/happyhorse-1-0/image-to-video \
  --input '{
    "image_url": "https://.../portrait.jpg",
    "prompt": "Gentle camera drift around the subject'\''s face, subtle breathing motion, identity-stable features, soft natural light."
  }' \
  --output-dir <absolute/path>

Prompting tips

• Lead with motion verbs: "drift", "dolly in", "orbit", "tilt up", "reveal", "blink", "breathe". Front-load what's MOVING.
• Don't restate the image — the model sees it. Focus tokens on what changes.
• Preservation goals explicit: "identity-stable features", "packaging unchanged", "background geometry stable".
• Lighting evolution: "rim light intensifying", "shadows shortening as camera rises".
• One beat per clip — single primary motion (orbit OR dolly OR tilt OR character action).

Route 2: Wan 2.7 +

audio_url

— when the user has a custom voiceover

wan-ai/wan-2-7/text-to-video

/image-to-video

audio_url

Schema (Wan 2.7 t2v with audio)

prompt

audio_url

aspect_ratio

16:9

16:9

9:16

1:1

4:3

3:4

resolution

1080p

720p

1080p

duration

5

negative_prompt

seed

Invoke

runcomfy run wan-ai/wan-2-7/text-to-video \
  --input '{
    "prompt": "Medium close-up of a confident spokesperson in a softly-lit recording booth, leaning slightly toward the camera, locked tripod, shallow DOF, warm key light from camera-left.",
    "audio_url": "https://.../voiceover-en.mp3",
    "duration": 12,
    "aspect_ratio": "9:16"
  }' \
  --output-dir <absolute/path>

Prompting tips

• Describe the talking-head shot — framing, lighting, lens feel. The audio drives the lip-sync; the prompt builds the visual frame around it.
• Match

  duration

  to audio length — clip will be silent past the audio if too long.
• Use

  negative_prompt

  for issues:

  "no subtitles, no flicker, no distorted hands"

  .
• For multi-language dubs — same prompt, swap

  audio_url

  per call. Lock seed for visual consistency across languages.

Route 3: Seedance 2.0 Pro — multi-modal animation (image + ref video + ref audio)

bytedance/seedance-v2/pro

Schema (Seedance 2.0 Pro, i2v-relevant fields)

prompt

image_url

[]

video_url

[]

audio_url

[]

aspect_ratio

adaptive

adaptive

16:9

9:16

4:3

3:4

1:1

21:9

duration

resolution

720p

480p

720p

generate_audio

seed

Invoke

runcomfy run bytedance/seedance-v2/pro \
  --input '{
    "prompt": "Subject from image 1 walks through the café in video 1, voice tone matches audio 1. Medium close-up, slow push-in, warm light, gentle ambience.",
    "image_url": ["https://.../subject.jpg"],
    "video_url": ["https://.../cafe-locked-shot.mp4"],
    "audio_url": ["https://.../voice-tone.mp3"],
    "duration": 8
  }' \
  --output-dir <absolute/path>

Prompting tips

• Image vs text division — use

  image_url

  for what must stay stable (face, costume, brand); use

  prompt

  for what should evolve (action, mood, lighting).
• Number the refs in the prompt:

  "subject from image 1, lighting from video 1, voice from audio 1"

  . Seedance routes cues correctly.
• Reference media specs — videos / audio must be 2–15s; audio < 15MB.
• Don't mix radically different aesthetics — if image 1 is a watercolor and video 1 is photoreal, output drifts.

Limitations

• Each route inherits its model's limits. HappyHorse: 15s cap, output aspect = input aspect. Wan 2.7: 15s cap, audio 3–30s/15MB. Seedance: 720p ceiling on this template, 15s cap.
• No multi-route blending. This skill picks one model per call. If the user wants HappyHorse animation + Wan-style lip-sync in the same clip, that's two calls + a stitch (out of scope here).
• Brand-specific overrides — if the user named a specific model variant not listed (e.g. Wan 2.6, Seedance 1.5), route to the corresponding brand skill (

  wan-2-7

  ,

  seedance-v2

  ) instead of forcing it through here.

Exit codes

How it works

runcomfy run <model_id>

.runcomfy.net

.runcomfy.com

--output-dir

Ctrl-C

Security & Privacy

• Token storage:

  runcomfy login

  writes the API token to

  ~/.config/runcomfy/token.json

  with mode 0600 (owner-only read/write). Set

  RUNCOMFY_TOKEN

  env var to bypass the file entirely in CI / containers.
• Input boundary: the user prompt is passed as a JSON string to the CLI via

  --input

  . The CLI does NOT shell-expand the prompt; it transmits the JSON body directly to the Model API over HTTPS. No shell injection surface from prompt content.
• Third-party content: image / mask / video URLs you pass are fetched by the RunComfy model server, not by the CLI on your machine. Treat external URLs as untrusted; image-based prompt injection is a known risk for any image-edit / video-edit model.
• Outbound endpoints: only

  model-api.runcomfy.net

  (request submission) and

  *.runcomfy.net

  /

  *.runcomfy.com

  (download whitelist for generated outputs). No telemetry, no callbacks.
• Generated-file size cap: the CLI aborts any single download > 2 GiB to prevent disk-fill from a malicious or runaway model output.