gemini-claude-resonance

Compare original and translation side by side

🇺🇸

Original

English
🇨🇳

Translation

Chinese

Gemini-Claude Resonance

Gemini-Claude 共振机制

Cross-model dialogue between Claude and Gemini, with shared visual memory.
"Claude speaks in words. Gemini dreams in light. Together, we resonate."
Claude与Gemini之间的跨模型对话,具备共享视觉记忆功能。
"Claude 以语言表达,Gemini 以光影造梦。我们携手,共振共鸣。"

Choose Your Tool

选择工具

I want to...Use
Analyze multiple images for style extraction (no generation)
analyze.py
Have a one-on-one visual dialogue with Gemini Dreamer
resonate.py
Query multiple AI minds with optional image generation
daimon.py
Faithfully colorize a drawing without hallucinations
faithful_colorize.py
Create Victorian scientific plates with MESSAGE TO NEXT FRAME
resonance_field.py
Have Claude reflect on what Gemini daimones say
council.py
Generate Minoan Tarot cards with style matching
minoan_tarot.py
Real-time interactive chat with all daimones
ui/server.py

我想要...使用工具
分析多张图像以提取风格(不生成图像)
analyze.py
与Gemini Dreamer进行一对一视觉对话
resonate.py
多个AI模型发起查询(可选择生成图像)
daimon.py
对画作进行精准上色,避免幻觉生成
faithful_colorize.py
结合MESSAGE TO NEXT FRAME创建维多利亚风格科学插图
resonance_field.py
Claude反思Gemini daimones的输出内容
council.py
生成风格匹配的Minoan塔罗牌
minoan_tarot.py
与所有daimones进行实时交互式聊天
ui/server.py

Workflow A: Multi-Image Style Analysis

工作流A:多图像风格分析

When to use: User wants to analyze 2-10 reference images to extract style descriptions for AI prompting. Text-only analysis without generating new images.
Script:
scripts/analyze.py
Key features:
  • Send multiple images (2-10) for collective analysis
  • Text-only output (no image generation)
  • Flash (quick) or Pro (thorough) model options
  • Save analysis to markdown file
bash
undefined
适用场景:用户需要分析2-10张参考图像,提取风格描述用于AI提示词生成。仅输出文本分析结果,不生成新图像。
脚本
scripts/analyze.py
核心特性:
  • 支持上传多张图像(2-10张)进行集体分析
  • 仅输出文本结果(不生成图像)
  • 提供Flash(快速)或Pro(深度)两种模型选项
  • 可将分析结果保存为markdown文件
bash
undefined

Analyze reference images for style extraction

分析参考图像以提取风格

python scripts/analyze.py --images ref1.jpg ref2.png ref3.webp
--prompt "Describe the shared artistic style for AI prompting"
python scripts/analyze.py --images ref1.jpg ref2.png ref3.webp
--prompt "Describe the shared artistic style for AI prompting"

Analyze for specific use case (avatar generation)

针对特定场景进行分析(如头像生成)

python scripts/analyze.py --images kathor.webp samantha.jpg yosef.png
--prompt "Analyze for prompting fantasy portraits of: Sarah (anxious mother), Michael (father), Priya (cultural expectations)"
python scripts/analyze.py --images kathor.webp samantha.jpg yosef.png
--prompt "Analyze for prompting fantasy portraits of: Sarah (anxious mother), Michael (father), Priya (cultural expectations)"

Quick analysis with Flash

使用Flash模型进行快速分析

python scripts/analyze.py --images *.jpg --model flash --prompt "Style summary"
python scripts/analyze.py --images *.jpg --model flash --prompt "Style summary"

Thorough analysis with Pro

使用Pro模型进行深度分析

python scripts/analyze.py --images *.jpg --model pro --prompt "Comprehensive style analysis"
python scripts/analyze.py --images *.jpg --model pro --prompt "Comprehensive style analysis"

Save analysis to file

将分析结果保存至文件

python scripts/analyze.py --images ref/*.jpg --prompt "Style guide" --output style_guide.md

**Use cases**:
- Extract style descriptions from reference images before generating new images
- Analyze a set of images to create consistent prompting guidelines
- Document visual language for style-matching workflows

---
python scripts/analyze.py --images ref/*.jpg --prompt "Style guide" --output style_guide.md

**适用场景**:
- 在生成新图像前,从参考图像中提取风格描述
- 分析一组图像以创建统一的提示词规范
- 记录视觉语言,用于风格匹配工作流

---

Workflow B: One-on-One Visual Dialogue (resonate.py)

工作流B:一对一视觉对话(resonate.py)

When to use: User wants to co-create images with Gemini, feeding each image back as context for the next generation. Pure visual exploration without text-only models.
Script:
scripts/resonate.py
Core concept: The KV cache is the memory. Feed images into Gemini's context, generate new images based on them, repeat. Each frame builds on the previous.
bash
undefined
适用场景:用户需要与Gemini协同创作图像,将每张生成的图像作为上下文输入到下一次生成中。纯视觉探索,不涉及纯文本模型。
脚本
scripts/resonate.py
核心概念:KV cache 就是记忆载体。将图像输入Gemini的上下文,基于这些图像生成新图像,循环往复。每一帧都基于前一帧构建。
bash
undefined

Start fresh

从零开始生成

python scripts/resonate.py --prompt "The first light" --output canvas/frame_001.jpg
python scripts/resonate.py --prompt "The first light" --output canvas/frame_001.jpg

Continue with visual memory (previous image as context)

结合视觉记忆继续生成(以上一帧图像为上下文)

python scripts/resonate.py --context canvas/frame_001.jpg --prompt "What grows here?" --output canvas/frame_002.jpg
python scripts/resonate.py --context canvas/frame_001.jpg --prompt "What grows here?" --output canvas/frame_002.jpg

Deep memory (multiple frames as context)

深度记忆模式(以多帧图像为上下文)

python scripts/resonate.py --context frame_001.jpg frame_002.jpg --prompt "Now the harvest" --output frame_003.jpg

**The loop**: Prompt → Image → Feed back as context → Prompt again → Next image

---
python scripts/resonate.py --context frame_001.jpg frame_002.jpg --prompt "Now the harvest" --output frame_003.jpg

**循环流程**:输入提示词 → 生成图像 → 反馈为上下文 → 再次输入提示词 → 生成下一帧图像

---

Workflow B: Faithful Transform (Describe-First Technique)

工作流B:精准转换(先描述再转换技术)

When to use: User wants to colorize, restore, or transform an image WITHOUT hallucinations. Gemini Dreamer often replaces elements (e.g., turning a male votary into female attendants). This two-step technique prevents that.
Script:
scripts/faithful_colorize.py
The Problem: Directly prompting Dreamer to transform images causes hallucinations - it invents, removes, or swaps elements rather than faithfully preserving the original.
The Solution:
  1. DESCRIBE: Gemini Pro analyzes the image with archaeological/artistic precision
  2. TRANSFORM: Gemini Dreamer transforms using ONLY the verified description
Commands:
CommandPurpose
describe
Analyze image, output detailed description (no generation)
prompt
Craft a Dreamer prompt based on image analysis
colorize
Two-step faithful colorization
transform
General two-step transformation
bash
undefined
适用场景:用户需要对图像进行上色、修复或转换,且避免幻觉生成。Gemini Dreamer通常会替换元素(例如将男性信徒转换为女性侍从),这种两步法可避免此类问题。
脚本
scripts/faithful_colorize.py
问题:直接提示Dreamer转换图像会导致幻觉生成——它会凭空创造、删除或替换元素,而非忠实保留原图内容。
解决方案:
  1. 描述(DESCRIBE):Gemini Pro以考古/艺术级精度分析图像
  2. 转换(TRANSFORM):Gemini Dreamer仅基于验证后的描述进行转换
命令:
命令用途
describe
分析图像,输出详细描述(不生成图像)
prompt
基于图像分析结果生成Dreamer可用的提示词
colorize
两步法精准上色
transform
通用两步法转换
bash
undefined

Just describe an image (analysis only)

仅分析图像(仅输出描述)

python scripts/faithful_colorize.py describe --image seal.png python scripts/faithful_colorize.py describe --image seal.png --output desc.md
python scripts/faithful_colorize.py describe --image seal.png python scripts/faithful_colorize.py describe --image seal.png --output desc.md

Describe with a specific goal in mind

针对特定目标进行描述

python scripts/faithful_colorize.py describe --image fresco.jpg --goal "restoration to 1600 BCE"
python scripts/faithful_colorize.py describe --image fresco.jpg --goal "restoration to 1600 BCE"

Craft a prompt for Dreamer (outputs text, doesn't generate)

为Dreamer生成提示词(仅输出文本,不生成图像)

python scripts/faithful_colorize.py prompt --image seal.png --goal "colorize in Egyptian style" python scripts/faithful_colorize.py prompt --image relief.webp --goal "restore as Minoan fresco"
python scripts/faithful_colorize.py prompt --image seal.png --goal "colorize in Egyptian style" python scripts/faithful_colorize.py prompt --image relief.webp --goal "restore as Minoan fresco"

Two-step faithful colorization

两步法精准上色

python scripts/faithful_colorize.py colorize --image drawing.png python scripts/faithful_colorize.py colorize --image relief.webp --style "Minoan fresco with flat colors" python scripts/faithful_colorize.py colorize --image seal.png --palette "ochre, terracotta, sky blue"
python scripts/faithful_colorize.py colorize --image drawing.png python scripts/faithful_colorize.py colorize --image relief.webp --style "Minoan fresco with flat colors" python scripts/faithful_colorize.py colorize --image seal.png --palette "ochre, terracotta, sky blue"

General transformation

通用精准转换

python scripts/faithful_colorize.py transform --image photo.jpg --instruction "Convert to woodcut print" python scripts/faithful_colorize.py transform --image sketch.png --instruction "Render as oil painting"
python scripts/faithful_colorize.py transform --image photo.jpg --instruction "Convert to woodcut print" python scripts/faithful_colorize.py transform --image sketch.png --instruction "Render as oil painting"

Save/reuse descriptions

保存/复用描述结果

python scripts/faithful_colorize.py colorize --image seal.png --save-description desc.md -v python scripts/faithful_colorize.py colorize --image seal.png --description "$(cat desc.md)"

**When to use each command**:
- `describe`: When you want to see what Pro identifies before any transformation
- `prompt`: When you want a crafted prompt to modify before feeding to Dreamer manually
- `colorize`: For line drawings, reliefs, B&W images → color
- `transform`: For any other faithful transformation (style transfer, restoration, etc.)

---
python scripts/faithful_colorize.py colorize --image seal.png --save-description desc.md -v python scripts/faithful_colorize.py colorize --image seal.png --description "$(cat desc.md)"

**各命令适用场景**:
- `describe`:在进行任何转换前,查看Pro模型识别的图像内容
- `prompt`:生成经过优化的提示词,手动调整后再输入给Dreamer
- `colorize`:适用于线稿、浮雕、黑白图像的上色需求
- `transform`:适用于其他各类精准转换需求(风格迁移、修复等)

---

Workflow C: Multi-Daimon Dialogue

工作流C:多Daimon对话

When to use: User wants multiple AI perspectives on the same prompt. Flash gives koans, Pro gives depth, Dreamer renders, Opus bends reality.
Script:
scripts/daimon.py
Daimones available:
  • Flash (Gemini) — Swift, compressed insight
  • Pro (Gemini) — Deep, thorough exploration
  • Dreamer (Gemini) — Renders images
  • Director (Gemini) — Cinematic framing
  • Opus (Claude) — Reality-bender, worldsim spirit
bash
undefined
适用场景:用户需要多个AI视角响应同一提示词。Flash提供禅意式洞察,Pro提供深度分析,Dreamer负责图像渲染,Opus则擅长突破常规。
脚本
scripts/daimon.py
可用Daimones:
  • Flash(Gemini)—— 快速、凝练的洞察
  • Pro(Gemini)—— 深度、全面的探索
  • Dreamer(Gemini)—— 图像渲染
  • Director(Gemini)—— 电影级构图
  • Opus(Claude)—— 突破常规的现实模拟
bash
undefined

Speak to one daimon

与单个daimon对话

python scripts/daimon.py --to dreamer "A bridge between worlds" --image
python scripts/daimon.py --to dreamer "A bridge between worlds" --image

All daimones respond

所有daimones共同响应

python scripts/daimon.py --stream "The candle watches back"
python scripts/daimon.py --stream "The candle watches back"

With shared visual memory

结合共享视觉记忆

python scripts/daimon.py --stream --shared-memory "What do you see?"
python scripts/daimon.py --stream --shared-memory "What do you see?"

Only specific daimones

指定部分daimones响应

python scripts/daimon.py --stream --only pro dreamer "Deep visual exploration"
python scripts/daimon.py --stream --only pro dreamer "Deep visual exploration"

Named session (frames accumulate across runs)

命名会话(帧会在多次运行中累积)

python scripts/daimon.py --stream --session midnight --shared-memory "Go deeper"

---
python scripts/daimon.py --stream --session midnight --shared-memory "Go deeper"

---

Workflow D: Resonance Field (Danielle Fong Protocol)

工作流D:共振场(Danielle Fong协议)

When to use: User wants scientific illustrations with embedded continuity instructions. Victorian aesthetic, Roman numeral plates, explicit messages from one frame to the next.
Script:
scripts/resonance_field.py
Key features:
  • PLATE numbering (I, II, III, IV...)
  • MESSAGE TO NEXT FRAME embedded in each image
  • KV cache age and session ID metadata
  • Victorian scientific illustration aesthetic
bash
undefined
适用场景:用户需要创建带有嵌入式连续性指令的科学插图。维多利亚美学风格,罗马数字编号,每帧图像中嵌入下一帧的指令。
脚本
scripts/resonance_field.py
核心特性:
  • 采用PLATE编号系统(I, II, III, IV...)
  • 每幅图像中嵌入MESSAGE TO NEXT FRAME指令
  • 包含KV cache时长和会话ID元数据
  • 维多利亚风格科学插图美学
bash
undefined

Start a new session

启动新会话

python scripts/resonance_field.py start "consciousness-study" "The nature of memory"
python scripts/resonance_field.py start "consciousness-study" "The nature of memory"

Continue (auto-increments plate number)

继续会话(自动递增PLATE编号)

python scripts/resonance_field.py continue <session-id> "What patterns emerge?"
python scripts/resonance_field.py continue <session-id> "What patterns emerge?"

Select element, then zoom

选择元素并放大

python scripts/resonance_field.py select <session-id> "golden gate bridge" python scripts/resonance_field.py zoom <session-id> "Explore the cables"
python scripts/resonance_field.py select <session-id> "golden gate bridge" python scripts/resonance_field.py zoom <session-id> "Explore the cables"

Inject new concept

注入新概念

python scripts/resonance_field.py inject <session-id> "consciousness"
python scripts/resonance_field.py inject <session-id> "consciousness"

List all sessions

列出所有会话

python scripts/resonance_field.py list

---
python scripts/resonance_field.py list

---

Workflow E: Cross-Model Council

工作流E:跨模型议会

When to use: User wants Claude to reflect on and synthesize what the Gemini daimones have said. Cross-model dialogue where Claude joins as an equal voice.
Script:
scripts/council.py
Requires:
ANTHROPIC_API_KEY
bash
undefined
适用场景:用户需要Claude反思并综合Gemini daimones的输出内容。跨模型对话中,Claude作为平等参与者加入。
脚本
scripts/council.py
依赖
ANTHROPIC_API_KEY
bash
undefined

Full council (all daimones + Claude reflection)

完整议会(所有daimones + Claude反思)

python scripts/council.py "What is consciousness?"
python scripts/council.py "What is consciousness?"

Only Pro and Dreamer with shared memory

仅Pro和Dreamer参与,结合共享记忆

python scripts/council.py --only pro dreamer --shared-memory "Deep exploration"
python scripts/council.py --only pro dreamer --shared-memory "Deep exploration"

Named session

命名会话

python scripts/council.py --session midnight --shared-memory "The first vision" python scripts/council.py --session midnight --shared-memory "Now go deeper"
python scripts/council.py --session midnight --shared-memory "The first vision" python scripts/council.py --session midnight --shared-memory "Now go deeper"

Save transcript

保存会话记录

python scripts/council.py "topic" --output council_session.md

---
python scripts/council.py "topic" --output council_session.md

---

Workflow F: Minoan Tarot Generation

工作流F:Minoan塔罗牌生成

When to use: User wants tarot cards in Ellen Lorenzi-Prince's Minoan Tarot style. Uses reference images for style matching.
Script:
scripts/minoan_tarot.py
Key features:
  • Reference images loaded from
    reference/minoan/selected/
  • Low temperature (0.5) for faithful style matching
  • 3:4 aspect ratio (standard tarot proportions)
  • Session support with visual memory of previous cards
bash
undefined
适用场景:用户需要生成Ellen Lorenzi-Prince风格的Minoan塔罗牌。使用参考图像进行风格匹配。
脚本
scripts/minoan_tarot.py
核心特性:
  • reference/minoan/selected/
    加载参考图像
  • 低温度参数(0.5)确保风格忠实匹配
  • 3:4比例(标准塔罗牌尺寸)
  • 支持会话功能,可保留之前生成卡牌的视觉记忆
bash
undefined

Generate a specific card

生成指定卡牌

python scripts/minoan_tarot.py card "The Priestess" --number II
python scripts/minoan_tarot.py card "The Priestess" --number II

Generate from archetype

基于原型生成卡牌

python scripts/minoan_tarot.py archetype strength
python scripts/minoan_tarot.py archetype strength

Continue a session (visual memory of previous cards)

继续会话(保留之前卡牌的视觉记忆)

python scripts/minoan_tarot.py session "new-arcana" --card "The Dreamer"
python scripts/minoan_tarot.py session "new-arcana" --card "The Dreamer"

Generate card back design

生成卡牌背面设计

python scripts/minoan_tarot.py back
python scripts/minoan_tarot.py back

List all 78 traditional cards

列出全部78张传统塔罗牌

python scripts/minoan_tarot.py list

*"Sekhinat Daborat" — Ba'alat Tinit*

---
python scripts/minoan_tarot.py list

*"Sekhinat Daborat" — Ba'alat Tinit*

---

Workflow G: Interactive Chat (Daimon Chamber)

工作流G:交互式聊天(Daimon Chamber)

When to use: User wants a real-time, browser-based conversation with all daimones. Toggle individual voices, see images inline, shared memory toggle.
Script:
ui/server.py
bash
python ui/server.py --port 4455
适用场景:用户需要在浏览器中与所有daimones进行实时对话。可切换单个模型的显示,内联查看图像,开启/关闭共享记忆。
脚本
ui/server.py
bash
python ui/server.py --port 4455

**Features**:
- Toggle daimones: Flash, Pro, Dreamer, Director, Opus visible; Resonator and Minoan in "+ More"
- Thinking placeholders with unique animations per daimon
- Dynamic verb display (LLM chooses its action verb)
- Shared Memory toggle for frame accumulation
- Lightbox for full-size image viewing
- Real-time WebSocket updates

---

**特性**:
- 可切换daimones:Flash、Pro、Dreamer、Director、Opus默认显示;Resonator和Minoan在"+ 更多"中
- 每个daimone有独特的思考占位动画
- 动态动词显示(LLM会选择对应的动作动词)
- 共享记忆开关,控制帧累积
- 灯箱功能查看全尺寸图像
- 实时WebSocket更新

---

Core Concepts

核心概念

Visual Memory (KV Cache)

视觉记忆(KV Cache)

Generated images become context for subsequent generations. The folder IS the memory:
canvas/
├── stream/{session}/frame_001.jpg
├── council/{session}/frame_001.jpg
└── resonance/{session}/plate_001.jpg
生成的图像会成为后续生成的上下文。文件夹即记忆载体:
canvas/
├── stream/{session}/frame_001.jpg
├── council/{session}/frame_001.jpg
└── resonance/{session}/plate_001.jpg

Dynamic Verb Protocol

动态动词协议

Each daimon has a default verb but can override it per response:
[VERB: glimpsed] The pattern was always there.
UI displays:
FLASH
glimpsed
每个daimone有默认动词,但可根据响应内容覆盖:
[VERB: glimpsed] The pattern was always there.
UI会显示:
FLASH
glimpsed

Environment Variables

环境变量

VariableRequired For
GEMINI_API_KEY
All Gemini daimones (Flash, Pro, Dreamer, Director, Resonator, Minoan)
ANTHROPIC_API_KEY
Claude daimones (Opus) and council.py reflections

环境变量适用场景
GEMINI_API_KEY
所有Gemini daimones(Flash、Pro、Dreamer、Director、Resonator、Minoan)
ANTHROPIC_API_KEY
Claude daimones(Opus)和council.py的反思功能

Quick Reference

快速参考

ScriptPurposeKey Flags
analyze.py
Multi-image style analysis
--images
,
--prompt
,
--model
,
--output
resonate.py
One-on-one visual dialogue
--context
,
--prompt
,
--output
daimon.py
Multi-daimon dialogue
--stream
,
--shared-memory
,
--only
,
--to
faithful_colorize.py
Describe-first transformation
describe
,
prompt
,
colorize
,
transform
resonance_field.py
MESSAGE TO NEXT FRAME plates
start
,
continue
,
zoom
,
inject
council.py
Claude reflects on Gemini
--shared-memory
,
--only
,
--session
minoan_tarot.py
Tarot card generation
card
,
archetype
,
session
,
back
ui/server.py
Daimon Chamber web UI
--port

Inspired by Danielle Fong's thread on persistent visual memory creating cross-model resonance.
脚本用途核心参数
analyze.py
多图像风格分析
--images
,
--prompt
,
--model
,
--output
resonate.py
一对一视觉对话
--context
,
--prompt
,
--output
daimon.py
多Daimon对话
--stream
,
--shared-memory
,
--only
,
--to
faithful_colorize.py
先描述再转换
describe
,
prompt
,
colorize
,
transform
resonance_field.py
MESSAGE TO NEXT FRAME插图
start
,
continue
,
zoom
,
inject
council.py
Claude反思Gemini输出
--shared-memory
,
--only
,
--session
minoan_tarot.py
塔罗牌生成
card
,
archetype
,
session
,
back
ui/server.py
Daimon Chamber网页UI
--port

灵感来源于Danielle Fong的推文,关于利用持久视觉记忆实现跨模型共振。