wandb-eval-tables

Compare original and translation side by side

🇺🇸

Original

English

🇨🇳

Translation

Chinese

W&B EvalTable previews

W&B EvalTable 预览

Use the bundled helper to preview existing

wandb.Table

data as

wandb.EvalTable

data. A preview creates new runs and keys; it never overwrites the source runs or tables.

Read

references/EVAL_TABLES.md

before converting. It is the canonical source for EvalTable semantics, source selection, limits, column roles, verification, and removal.

使用配套工具将现有

wandb.Table

数据预览为

wandb.EvalTable

数据。预览操作会创建新的运行记录和键，但绝不会覆盖源运行记录或表格。

在进行转换前，请阅读

references/EVAL_TABLES.md

。该文档是EvalTable语义、来源选择、限制、列角色、验证及删除操作的权威参考。

Environment

环境要求

Run the helper from an environment that provides a W&B SDK with

wandb.EvalTable

and Weave. Use

uv

to supply missing dependencies:

bash

uv run --with 'wandb[workspaces]>=0.28.1' --with weave \
  python skills/wandb-eval-tables/scripts/table_artifact_to_eval_table.py --help

Credentials and default scope may come from

WANDB_API_KEY

WANDB_ENTITY

, and

WANDB_PROJECT

; otherwise pass explicit entity/project arguments. Downloads use the operating system's temporary directory, not a fixed current working directory.

请在提供了包含

wandb.EvalTable

和Weave的W&B SDK环境中运行该工具。使用

uv

来补充缺失的依赖：

bash

uv run --with 'wandb[workspaces]>=0.28.1' --with weave \
  python skills/wandb-eval-tables/scripts/table_artifact_to_eval_table.py --help

凭证和默认范围可来自

WANDB_API_KEY

、

WANDB_ENTITY

和

WANDB_PROJECT

；否则请传入明确的实体/项目参数。下载操作使用操作系统的临时目录，而非固定的当前工作目录。

Required workflow

必选工作流程

Choose the narrowest source that matches the request: exact artifact, one run, one sweep, or a project/workspace. Do not broaden an explicitly named source.
Run
```
scan
```
. This is read-only preflight and is not proof of conversion.
Review
```
eligible_summary_by_table_key
```
, table shapes, truncations, warnings, and existing-preview metadata. Select one table key unless the user asks for a broader batch.
Classify columns only when confident. Input tuples must uniquely identify rows; score columns must be numeric or boolean; free-text labels and rationales are outputs. Leave ambiguous tables untyped.
Run
```
preview
```
for exactly one
```
--table-key
```
per invocation. Keep the target in the source project unless the user requests another writable project.
If runs were created, run
```
verify-preview
```
on the final created run and the exact logged key. Report success only when it returns
```
verified: true
```
.
Report created and skipped sources plus every truncation or failed check.

bash

T=skills/wandb-eval-tables/scripts/table_artifact_to_eval_table.py

uv run python "$T" scan \
  --source-workspace ENTITY/PROJECT --max-runs 4

uv run python "$T" preview \
  --source-workspace ENTITY/PROJECT \
  --target-project ENTITY/PROJECT \
  --max-runs 4 \
  --table-key predictions

uv run python "$T" verify-preview \
  --run ENTITY/PROJECT/PREVIEW_RUN_ID \
  --table-key predictions_preview

选择与请求匹配的最窄范围来源：特定工件、单个运行、单个sweep或项目/工作区。不要扩大明确指定的来源范围。
运行
```
scan
```
命令。这是只读的预检操作，不代表转换可行。
查看
```
eligible_summary_by_table_key
```
、表格结构、截断信息、警告及现有预览元数据。除非用户要求更广泛的批量处理，否则仅选择一个表格键。
仅在确认无误时对列进行分类。输入元组必须能唯一标识行；评分列必须为数值型或布尔型；自由文本标签和理由属于输出列。对于模糊的表格，请勿指定类型。
每次调用
```
preview
```
命令时，仅指定一个
```
--table-key
```
。除非用户要求其他可写入的项目，否则将目标保留在源项目中。
如果已创建运行记录，请对最终创建的运行记录和确切的日志键运行
```
verify-preview
```
命令。仅当返回
```
verified: true
```
时，才可报告操作成功。
报告已创建和已跳过的来源，以及所有截断或检查失败的情况。

bash

T=skills/wandb-eval-tables/scripts/table_artifact_to_eval_table.py

uv run python "$T" scan \
  --source-workspace ENTITY/PROJECT --max-runs 4

uv run python "$T" preview \
  --source-workspace ENTITY/PROJECT \
  --target-project ENTITY/PROJECT \
  --max-runs 4 \
  --table-key predictions

uv run python "$T" verify-preview \
  --run ENTITY/PROJECT/PREVIEW_RUN_ID \
  --table-key predictions_preview

Safety

安全注意事项

```
scan
```
and
```
preview --dry-run
```
are read-only.
```
preview
```
creates W&B runs, EvalTables, and Weave evaluations; run it only when the user requested a conversion.
The helper caps tables at 10,000 rows and 100 columns, warns above 1,000 rows, and refuses more than 50 eligible table artifacts for one key. Surface every cap; never imply a truncated preview is complete.
Do not bypass helper failures with ad-hoc logging. Narrow or correct helper arguments, then retry only when the change is safe.
Removal deletes both Weave evaluations and preview runs. Run
```
delete-preview --dry-run
```
first, verify every target is helper-created, and obtain confirmation before the irreversible invocation. Never delete source runs.

```
scan
```
和
```
preview --dry-run
```
为只读操作。
```
preview
```
会创建W&B运行记录、EvalTable和Weave评估；仅当用户明确要求转换时才运行该命令。
该工具会将表格限制为10000行和100列，当行数超过1000时发出警告，并且拒绝为单个键处理超过50个符合条件的表格工件。需告知用户所有限制，绝不能暗示截断后的预览是完整的。
不要通过临时日志绕过工具的失败提示。请缩小或修正工具参数，仅在变更安全的情况下重试。
删除操作会同时删除Weave评估和预览运行记录。请先运行
```
delete-preview --dry-run
```
，验证所有目标均为工具创建的内容，并在执行不可逆操作前获得确认。绝不能删除源运行记录。