scenario-runway

Compare original and translation side by side

🇺🇸

Original

English

🇨🇳

Translation

Chinese

Scenario Runway Video

Scenario Runway 视频

Overview

概述

Runway's family on Scenario splits by direction: Gen4.5 generates new clips from text or a first-frame image; Aleph 2 rewrites existing footage, changing what the prompt names while motion, audio, and structure carry over. Discover both with

search

;

model_schema_get

is the contract.

Connection and the core loop: the

scenario

skill; model-agnostic video work: the

scenario-video

skill. If a sibling skill named here is missing from your available skills, ask the user to install it (

npx skills add scenario-labs/skills --skill <name>

); unattended, proceed from tool schemas and flag the gap.

Scenario上的Runway模型系列按功能方向划分：Gen4.5可通过文本或首帧图像生成新片段；Aleph 2可重写现有素材，仅修改提示词指定的内容，同时保留运动、音频和结构。可通过

search

查找这两类模型；

model_schema_get

是接口约定。

连接与核心循环由

scenario

skill提供支持；通用视频处理功能由

scenario-video

skill提供。如果你的可用skill中缺少此处提到的同类skill，请让用户安装（命令：

npx skills add scenario-labs/skills --skill <name>

）；若处于无人值守模式，可基于工具schema继续操作并标记缺失项。

Quick reference

快速参考

Mode follows from the inputs (names and caps from the live schema):

Mode	Inputs	Behavior
Text (Gen4.5)	`prompt`	`aspectRatio` honored; `duration` 2 to 10 seconds
First frame (Gen4.5)	`image` + `prompt`	opens on that frame; same `duration` ; `aspectRatio` ignored
Edit (Aleph 2)	`video` + `prompt`	rewrites visuals; motion, audio, structure persist

At authoring time Aleph capped sources at 30 seconds and 16 MB, separate limits: high-bitrate clips hit the size cap first. Its median cost ran six times Gen4.5's, a fifteen-fold spread following the source video:

dry_run

the exact payload first. Median latency neared six minutes, so

jobs_wait

will time out mid-job; re-call it with

pending_job_ids

模式由输入参数决定（参数名称和限制以实时schema为准）：

模式	输入参数	功能说明
文本 (Gen4.5)	`prompt`	`aspectRatio` 生效； `duration` 为2到10秒
首帧 (Gen4.5)	`image` + `prompt`	从该帧开始生成； `duration` 同上； `aspectRatio` 无效
编辑 (Aleph 2)	`video` + `prompt`	重写视觉内容；保留运动、音频、结构

在本文撰写时，Aleph对源素材的限制为30秒时长和16MB大小，两个限制独立生效：高码率片段会先触达大小上限。它的中位成本是Gen4.5的6倍，根据源视频不同最高可达15倍差距：请先使用

dry_run

传入完整参数进行试算。中位延迟接近6分钟，因此

jobs_wait

会在任务执行中途超时；请使用

pending_job_ids

重新调用该接口。

Gen4.5 prompts follow the mode

Gen4.5 提示词需匹配模式

Text mode needs both the visuals and the motion described. A first frame fixes subject, composition, and palette: spend the whole prompt on motion, camera, and atmosphere. Order beats explicitly ("kneels, then rises, camera cranes up") and give multi-beat prompts 8 to 10 seconds of

duration

. Name camera moves plainly (locked camera, pan, dolly, tracking, orbit, crane), one or two per clip, in present-tense prose.

aspectRatio

takes pixel pairs (

"1280:720"

"960:960"

), and text mode honored only the 16:9 and 9:16 pairs at authoring time; get other shapes (1:1, 4:3, 3:4, 21:9) from a first frame with that geometry instead.

文本模式需要同时描述视觉效果和运动。首帧模式下，首帧已经确定了主体、构图和调色：请将提示词全部用于描述运动、镜头和氛围。明确按顺序列出动作节点（如"跪下，然后起身，镜头向上摇移"），多动作节点的提示词请设置8到10秒的

duration

。用直白的名称描述镜头运动（固定镜头、摇镜、推拉镜、跟拍、环绕、升降），每个片段使用1到2种，用现在时的散文体书写。

aspectRatio

接受像素对格式（如

"1280:720"

、

"960:960"

），在本文撰写时文本模式仅支持16:9和9:16的比例；如需其他比例（1:1、4:3、3:4、21:9），请使用对应比例的首帧图像生成。

Aleph changes what you name

Aleph 仅修改你指定的内容

An Aleph prompt states the edit: remove, swap, restyle, relight. Everything unnamed persists, along with motion and audio: Aleph cannot re-choreograph or add camera moves; when motion must change, generate with Gen4.5. To steer the edit, pin up to 5 reference images:

keyframes

places each image (

uri

) by

seconds

at

(a 0 to 1 fraction);

promptImage

positionType

plus

timestampSeconds

positionPercentage

. The arrays are alternatives, never combined.

Aleph的提示词需明确编辑操作：移除、替换、重设风格、重新打光。所有未提及的内容都会保留，包括运动和音频：Aleph无法重新编排动作或添加镜头运动；如果需要修改运动，请使用Gen4.5生成。如需引导编辑，最多可固定5张参考图：

keyframes

通过

seconds

或

at

（0到1的小数）指定每张图片（

uri

）的位置；

promptImage

通过

positionType

加

timestampSeconds

或

positionPercentage

指定。这两个数组是二选一的关系，不可同时使用。

Worked example: swap a product in real footage

实操示例：替换实拍素材中的产品

```
search
```
with
```
target="models"
```
,
```
query="runway"
```
,
```
public=true
```
, e.g.
```
model_runway-aleph-2
```
for editing,
```
model_runway-gen4-5
```
for generation (live hits at authoring time: re-discover each session).
```
model_schema_get
```
with the Aleph id before anything else.
Trim or compress a source over the caps (see
```
scenario-video
```
);
```
upload_asset
```
the clip and product still (see the
```
scenario
```
skill).

model_run

with

dry_run=true

and the exact

parameters={"prompt": "Replace the soda can with the bottle from the reference image. Keep everything else unchanged.", "video": "asset_clip", "keyframes": [{"uri": "asset_bottle", "at": 0}]}

; re-estimate after any trim.

Repeat with
```
wait=false
```
, then
```
jobs_wait
```
the returned job id, re-calling with
```
pending_job_ids
```
; a timeout is not a failure and never justifies a second
```
model_run
```
.
```
asset_display
```
the output; check the swap holds in every shot.

调用
```
search
```
，设置
```
target="models"
```
、
```
query="runway"
```
、
```
public=true
```
，例如编辑用
```
model_runway-aleph-2
```
，生成用
```
model_runway-gen4-5
```
（本文撰写时的有效结果：每次会话都需重新查找）。
先调用
```
model_schema_get
```
传入Aleph的模型ID，再进行其他操作。
对超出限制的源素材进行裁剪或压缩（参见
```
scenario-video
```
）；调用
```
upload_asset
```
上传视频片段和产品静态图（参见
```
scenario
```
skill）。

调用

model_run

，设置

dry_run=true

并传入完整参数：

parameters={"prompt": "Replace the soda can with the bottle from the reference image. Keep everything else unchanged.", "video": "asset_clip", "keyframes": [{"uri": "asset_bottle", "at": 0}]}

；裁剪后需重新试算。

重新调用
```
model_run
```
并设置
```
wait=false
```
，然后使用返回的任务ID调用
```
jobs_wait
```
，若超时则传入
```
pending_job_ids
```
重新调用；超时并非失败，绝不可因此发起第二次
```
model_run
```
调用。
调用
```
asset_display
```
查看输出结果；检查每个镜头中的替换效果是否稳定。

Common mistakes

常见错误

Sending both
```
keyframes
```
and
```
promptImage
```
: exclusive alternatives; pick one.
Restating the first frame in an image-mode prompt: prompt motion and camera instead.
Passing
```
aspectRatio
```
as
```
"16:9"
```
or alongside
```
image
```
: pixel pairs only, and a first frame overrides it.
Asking Aleph for new motion or camera moves: the source's motion persists by design.

同时传入
```
keyframes
```
和
```
promptImage
```
：二者是互斥选项，只能选其一。
在图生模式的提示词中重复描述首帧内容：应转而描述运动和镜头。
传入
```
"16:9"
```
格式的
```
aspectRatio
```
或在传入
```
image
```
时同时传入该参数：仅支持像素对格式，且首帧会覆盖该参数。
要求Aleph生成新的运动或镜头运动：设计上源素材的运动会被保留。