gemini-claude-resonance
Compare original and translation side by side
🇺🇸
Original
English🇨🇳
Translation
ChineseGemini-Claude Resonance
Gemini-Claude 共振机制
Cross-model dialogue between Claude and Gemini, with shared visual memory.
"Claude speaks in words. Gemini dreams in light. Together, we resonate."
Claude与Gemini之间的跨模型对话,具备共享视觉记忆功能。
"Claude 以语言表达,Gemini 以光影造梦。我们携手,共振共鸣。"
Choose Your Tool
选择工具
| I want to... | Use |
|---|---|
| Analyze multiple images for style extraction (no generation) | |
| Have a one-on-one visual dialogue with Gemini Dreamer | |
| Query multiple AI minds with optional image generation | |
| Faithfully colorize a drawing without hallucinations | |
| Create Victorian scientific plates with MESSAGE TO NEXT FRAME | |
| Have Claude reflect on what Gemini daimones say | |
| Generate Minoan Tarot cards with style matching | |
| Real-time interactive chat with all daimones | |
| 我想要... | 使用工具 |
|---|---|
| 分析多张图像以提取风格(不生成图像) | |
| 与Gemini Dreamer进行一对一视觉对话 | |
| 向多个AI模型发起查询(可选择生成图像) | |
| 对画作进行精准上色,避免幻觉生成 | |
| 结合MESSAGE TO NEXT FRAME创建维多利亚风格科学插图 | |
| 让Claude反思Gemini daimones的输出内容 | |
| 生成风格匹配的Minoan塔罗牌 | |
| 与所有daimones进行实时交互式聊天 | |
Workflow A: Multi-Image Style Analysis
工作流A:多图像风格分析
When to use: User wants to analyze 2-10 reference images to extract style descriptions for AI prompting. Text-only analysis without generating new images.
Script:
scripts/analyze.pyKey features:
- Send multiple images (2-10) for collective analysis
- Text-only output (no image generation)
- Flash (quick) or Pro (thorough) model options
- Save analysis to markdown file
bash
undefined适用场景:用户需要分析2-10张参考图像,提取风格描述用于AI提示词生成。仅输出文本分析结果,不生成新图像。
脚本:
scripts/analyze.py核心特性:
- 支持上传多张图像(2-10张)进行集体分析
- 仅输出文本结果(不生成图像)
- 提供Flash(快速)或Pro(深度)两种模型选项
- 可将分析结果保存为markdown文件
bash
undefinedAnalyze reference images for style extraction
分析参考图像以提取风格
python scripts/analyze.py --images ref1.jpg ref2.png ref3.webp
--prompt "Describe the shared artistic style for AI prompting"
--prompt "Describe the shared artistic style for AI prompting"
python scripts/analyze.py --images ref1.jpg ref2.png ref3.webp
--prompt "Describe the shared artistic style for AI prompting"
--prompt "Describe the shared artistic style for AI prompting"
Analyze for specific use case (avatar generation)
针对特定场景进行分析(如头像生成)
python scripts/analyze.py --images kathor.webp samantha.jpg yosef.png
--prompt "Analyze for prompting fantasy portraits of: Sarah (anxious mother), Michael (father), Priya (cultural expectations)"
--prompt "Analyze for prompting fantasy portraits of: Sarah (anxious mother), Michael (father), Priya (cultural expectations)"
python scripts/analyze.py --images kathor.webp samantha.jpg yosef.png
--prompt "Analyze for prompting fantasy portraits of: Sarah (anxious mother), Michael (father), Priya (cultural expectations)"
--prompt "Analyze for prompting fantasy portraits of: Sarah (anxious mother), Michael (father), Priya (cultural expectations)"
Quick analysis with Flash
使用Flash模型进行快速分析
python scripts/analyze.py --images *.jpg --model flash --prompt "Style summary"
python scripts/analyze.py --images *.jpg --model flash --prompt "Style summary"
Thorough analysis with Pro
使用Pro模型进行深度分析
python scripts/analyze.py --images *.jpg --model pro --prompt "Comprehensive style analysis"
python scripts/analyze.py --images *.jpg --model pro --prompt "Comprehensive style analysis"
Save analysis to file
将分析结果保存至文件
python scripts/analyze.py --images ref/*.jpg --prompt "Style guide" --output style_guide.md
**Use cases**:
- Extract style descriptions from reference images before generating new images
- Analyze a set of images to create consistent prompting guidelines
- Document visual language for style-matching workflows
---python scripts/analyze.py --images ref/*.jpg --prompt "Style guide" --output style_guide.md
**适用场景**:
- 在生成新图像前,从参考图像中提取风格描述
- 分析一组图像以创建统一的提示词规范
- 记录视觉语言,用于风格匹配工作流
---Workflow B: One-on-One Visual Dialogue (resonate.py)
工作流B:一对一视觉对话(resonate.py)
When to use: User wants to co-create images with Gemini, feeding each image back as context for the next generation. Pure visual exploration without text-only models.
Script:
scripts/resonate.pyCore concept: The KV cache is the memory. Feed images into Gemini's context, generate new images based on them, repeat. Each frame builds on the previous.
bash
undefined适用场景:用户需要与Gemini协同创作图像,将每张生成的图像作为上下文输入到下一次生成中。纯视觉探索,不涉及纯文本模型。
脚本:
scripts/resonate.py核心概念:KV cache 就是记忆载体。将图像输入Gemini的上下文,基于这些图像生成新图像,循环往复。每一帧都基于前一帧构建。
bash
undefinedStart fresh
从零开始生成
python scripts/resonate.py --prompt "The first light" --output canvas/frame_001.jpg
python scripts/resonate.py --prompt "The first light" --output canvas/frame_001.jpg
Continue with visual memory (previous image as context)
结合视觉记忆继续生成(以上一帧图像为上下文)
python scripts/resonate.py --context canvas/frame_001.jpg --prompt "What grows here?" --output canvas/frame_002.jpg
python scripts/resonate.py --context canvas/frame_001.jpg --prompt "What grows here?" --output canvas/frame_002.jpg
Deep memory (multiple frames as context)
深度记忆模式(以多帧图像为上下文)
python scripts/resonate.py --context frame_001.jpg frame_002.jpg --prompt "Now the harvest" --output frame_003.jpg
**The loop**: Prompt → Image → Feed back as context → Prompt again → Next image
---python scripts/resonate.py --context frame_001.jpg frame_002.jpg --prompt "Now the harvest" --output frame_003.jpg
**循环流程**:输入提示词 → 生成图像 → 反馈为上下文 → 再次输入提示词 → 生成下一帧图像
---Workflow B: Faithful Transform (Describe-First Technique)
工作流B:精准转换(先描述再转换技术)
When to use: User wants to colorize, restore, or transform an image WITHOUT hallucinations. Gemini Dreamer often replaces elements (e.g., turning a male votary into female attendants). This two-step technique prevents that.
Script:
scripts/faithful_colorize.pyThe Problem: Directly prompting Dreamer to transform images causes hallucinations - it invents, removes, or swaps elements rather than faithfully preserving the original.
The Solution:
- DESCRIBE: Gemini Pro analyzes the image with archaeological/artistic precision
- TRANSFORM: Gemini Dreamer transforms using ONLY the verified description
Commands:
| Command | Purpose |
|---|---|
| Analyze image, output detailed description (no generation) |
| Craft a Dreamer prompt based on image analysis |
| Two-step faithful colorization |
| General two-step transformation |
bash
undefined适用场景:用户需要对图像进行上色、修复或转换,且避免幻觉生成。Gemini Dreamer通常会替换元素(例如将男性信徒转换为女性侍从),这种两步法可避免此类问题。
脚本:
scripts/faithful_colorize.py问题:直接提示Dreamer转换图像会导致幻觉生成——它会凭空创造、删除或替换元素,而非忠实保留原图内容。
解决方案:
- 描述(DESCRIBE):Gemini Pro以考古/艺术级精度分析图像
- 转换(TRANSFORM):Gemini Dreamer仅基于验证后的描述进行转换
命令:
| 命令 | 用途 |
|---|---|
| 分析图像,输出详细描述(不生成图像) |
| 基于图像分析结果生成Dreamer可用的提示词 |
| 两步法精准上色 |
| 通用两步法转换 |
bash
undefinedJust describe an image (analysis only)
仅分析图像(仅输出描述)
python scripts/faithful_colorize.py describe --image seal.png
python scripts/faithful_colorize.py describe --image seal.png --output desc.md
python scripts/faithful_colorize.py describe --image seal.png
python scripts/faithful_colorize.py describe --image seal.png --output desc.md
Describe with a specific goal in mind
针对特定目标进行描述
python scripts/faithful_colorize.py describe --image fresco.jpg --goal "restoration to 1600 BCE"
python scripts/faithful_colorize.py describe --image fresco.jpg --goal "restoration to 1600 BCE"
Craft a prompt for Dreamer (outputs text, doesn't generate)
为Dreamer生成提示词(仅输出文本,不生成图像)
python scripts/faithful_colorize.py prompt --image seal.png --goal "colorize in Egyptian style"
python scripts/faithful_colorize.py prompt --image relief.webp --goal "restore as Minoan fresco"
python scripts/faithful_colorize.py prompt --image seal.png --goal "colorize in Egyptian style"
python scripts/faithful_colorize.py prompt --image relief.webp --goal "restore as Minoan fresco"
Two-step faithful colorization
两步法精准上色
python scripts/faithful_colorize.py colorize --image drawing.png
python scripts/faithful_colorize.py colorize --image relief.webp --style "Minoan fresco with flat colors"
python scripts/faithful_colorize.py colorize --image seal.png --palette "ochre, terracotta, sky blue"
python scripts/faithful_colorize.py colorize --image drawing.png
python scripts/faithful_colorize.py colorize --image relief.webp --style "Minoan fresco with flat colors"
python scripts/faithful_colorize.py colorize --image seal.png --palette "ochre, terracotta, sky blue"
General transformation
通用精准转换
python scripts/faithful_colorize.py transform --image photo.jpg --instruction "Convert to woodcut print"
python scripts/faithful_colorize.py transform --image sketch.png --instruction "Render as oil painting"
python scripts/faithful_colorize.py transform --image photo.jpg --instruction "Convert to woodcut print"
python scripts/faithful_colorize.py transform --image sketch.png --instruction "Render as oil painting"
Save/reuse descriptions
保存/复用描述结果
python scripts/faithful_colorize.py colorize --image seal.png --save-description desc.md -v
python scripts/faithful_colorize.py colorize --image seal.png --description "$(cat desc.md)"
**When to use each command**:
- `describe`: When you want to see what Pro identifies before any transformation
- `prompt`: When you want a crafted prompt to modify before feeding to Dreamer manually
- `colorize`: For line drawings, reliefs, B&W images → color
- `transform`: For any other faithful transformation (style transfer, restoration, etc.)
---python scripts/faithful_colorize.py colorize --image seal.png --save-description desc.md -v
python scripts/faithful_colorize.py colorize --image seal.png --description "$(cat desc.md)"
**各命令适用场景**:
- `describe`:在进行任何转换前,查看Pro模型识别的图像内容
- `prompt`:生成经过优化的提示词,手动调整后再输入给Dreamer
- `colorize`:适用于线稿、浮雕、黑白图像的上色需求
- `transform`:适用于其他各类精准转换需求(风格迁移、修复等)
---Workflow C: Multi-Daimon Dialogue
工作流C:多Daimon对话
When to use: User wants multiple AI perspectives on the same prompt. Flash gives koans, Pro gives depth, Dreamer renders, Opus bends reality.
Script:
scripts/daimon.pyDaimones available:
- Flash (Gemini) — Swift, compressed insight
- Pro (Gemini) — Deep, thorough exploration
- Dreamer (Gemini) — Renders images
- Director (Gemini) — Cinematic framing
- Opus (Claude) — Reality-bender, worldsim spirit
bash
undefined适用场景:用户需要多个AI视角响应同一提示词。Flash提供禅意式洞察,Pro提供深度分析,Dreamer负责图像渲染,Opus则擅长突破常规。
脚本:
scripts/daimon.py可用Daimones:
- Flash(Gemini)—— 快速、凝练的洞察
- Pro(Gemini)—— 深度、全面的探索
- Dreamer(Gemini)—— 图像渲染
- Director(Gemini)—— 电影级构图
- Opus(Claude)—— 突破常规的现实模拟
bash
undefinedSpeak to one daimon
与单个daimon对话
python scripts/daimon.py --to dreamer "A bridge between worlds" --image
python scripts/daimon.py --to dreamer "A bridge between worlds" --image
All daimones respond
所有daimones共同响应
python scripts/daimon.py --stream "The candle watches back"
python scripts/daimon.py --stream "The candle watches back"
With shared visual memory
结合共享视觉记忆
python scripts/daimon.py --stream --shared-memory "What do you see?"
python scripts/daimon.py --stream --shared-memory "What do you see?"
Only specific daimones
指定部分daimones响应
python scripts/daimon.py --stream --only pro dreamer "Deep visual exploration"
python scripts/daimon.py --stream --only pro dreamer "Deep visual exploration"
Named session (frames accumulate across runs)
命名会话(帧会在多次运行中累积)
python scripts/daimon.py --stream --session midnight --shared-memory "Go deeper"
---python scripts/daimon.py --stream --session midnight --shared-memory "Go deeper"
---Workflow D: Resonance Field (Danielle Fong Protocol)
工作流D:共振场(Danielle Fong协议)
When to use: User wants scientific illustrations with embedded continuity instructions. Victorian aesthetic, Roman numeral plates, explicit messages from one frame to the next.
Script:
scripts/resonance_field.pyKey features:
- PLATE numbering (I, II, III, IV...)
- MESSAGE TO NEXT FRAME embedded in each image
- KV cache age and session ID metadata
- Victorian scientific illustration aesthetic
bash
undefined适用场景:用户需要创建带有嵌入式连续性指令的科学插图。维多利亚美学风格,罗马数字编号,每帧图像中嵌入下一帧的指令。
脚本:
scripts/resonance_field.py核心特性:
- 采用PLATE编号系统(I, II, III, IV...)
- 每幅图像中嵌入MESSAGE TO NEXT FRAME指令
- 包含KV cache时长和会话ID元数据
- 维多利亚风格科学插图美学
bash
undefinedStart a new session
启动新会话
python scripts/resonance_field.py start "consciousness-study" "The nature of memory"
python scripts/resonance_field.py start "consciousness-study" "The nature of memory"
Continue (auto-increments plate number)
继续会话(自动递增PLATE编号)
python scripts/resonance_field.py continue <session-id> "What patterns emerge?"
python scripts/resonance_field.py continue <session-id> "What patterns emerge?"
Select element, then zoom
选择元素并放大
python scripts/resonance_field.py select <session-id> "golden gate bridge"
python scripts/resonance_field.py zoom <session-id> "Explore the cables"
python scripts/resonance_field.py select <session-id> "golden gate bridge"
python scripts/resonance_field.py zoom <session-id> "Explore the cables"
Inject new concept
注入新概念
python scripts/resonance_field.py inject <session-id> "consciousness"
python scripts/resonance_field.py inject <session-id> "consciousness"
List all sessions
列出所有会话
python scripts/resonance_field.py list
---python scripts/resonance_field.py list
---Workflow E: Cross-Model Council
工作流E:跨模型议会
When to use: User wants Claude to reflect on and synthesize what the Gemini daimones have said. Cross-model dialogue where Claude joins as an equal voice.
Script:
scripts/council.pyRequires:
ANTHROPIC_API_KEYbash
undefined适用场景:用户需要Claude反思并综合Gemini daimones的输出内容。跨模型对话中,Claude作为平等参与者加入。
脚本:
scripts/council.py依赖:
ANTHROPIC_API_KEYbash
undefinedFull council (all daimones + Claude reflection)
完整议会(所有daimones + Claude反思)
python scripts/council.py "What is consciousness?"
python scripts/council.py "What is consciousness?"
Only Pro and Dreamer with shared memory
仅Pro和Dreamer参与,结合共享记忆
python scripts/council.py --only pro dreamer --shared-memory "Deep exploration"
python scripts/council.py --only pro dreamer --shared-memory "Deep exploration"
Named session
命名会话
python scripts/council.py --session midnight --shared-memory "The first vision"
python scripts/council.py --session midnight --shared-memory "Now go deeper"
python scripts/council.py --session midnight --shared-memory "The first vision"
python scripts/council.py --session midnight --shared-memory "Now go deeper"
Save transcript
保存会话记录
python scripts/council.py "topic" --output council_session.md
---python scripts/council.py "topic" --output council_session.md
---Workflow F: Minoan Tarot Generation
工作流F:Minoan塔罗牌生成
When to use: User wants tarot cards in Ellen Lorenzi-Prince's Minoan Tarot style. Uses reference images for style matching.
Script:
scripts/minoan_tarot.pyKey features:
- Reference images loaded from
reference/minoan/selected/ - Low temperature (0.5) for faithful style matching
- 3:4 aspect ratio (standard tarot proportions)
- Session support with visual memory of previous cards
bash
undefined适用场景:用户需要生成Ellen Lorenzi-Prince风格的Minoan塔罗牌。使用参考图像进行风格匹配。
脚本:
scripts/minoan_tarot.py核心特性:
- 从加载参考图像
reference/minoan/selected/ - 低温度参数(0.5)确保风格忠实匹配
- 3:4比例(标准塔罗牌尺寸)
- 支持会话功能,可保留之前生成卡牌的视觉记忆
bash
undefinedGenerate a specific card
生成指定卡牌
python scripts/minoan_tarot.py card "The Priestess" --number II
python scripts/minoan_tarot.py card "The Priestess" --number II
Generate from archetype
基于原型生成卡牌
python scripts/minoan_tarot.py archetype strength
python scripts/minoan_tarot.py archetype strength
Continue a session (visual memory of previous cards)
继续会话(保留之前卡牌的视觉记忆)
python scripts/minoan_tarot.py session "new-arcana" --card "The Dreamer"
python scripts/minoan_tarot.py session "new-arcana" --card "The Dreamer"
Generate card back design
生成卡牌背面设计
python scripts/minoan_tarot.py back
python scripts/minoan_tarot.py back
List all 78 traditional cards
列出全部78张传统塔罗牌
python scripts/minoan_tarot.py list
*"Sekhinat Daborat" — Ba'alat Tinit*
---python scripts/minoan_tarot.py list
*"Sekhinat Daborat" — Ba'alat Tinit*
---Workflow G: Interactive Chat (Daimon Chamber)
工作流G:交互式聊天(Daimon Chamber)
When to use: User wants a real-time, browser-based conversation with all daimones. Toggle individual voices, see images inline, shared memory toggle.
Script:
ui/server.pybash
python ui/server.py --port 4455适用场景:用户需要在浏览器中与所有daimones进行实时对话。可切换单个模型的显示,内联查看图像,开启/关闭共享记忆。
脚本:
ui/server.pybash
python ui/server.py --port 4455
**Features**:
- Toggle daimones: Flash, Pro, Dreamer, Director, Opus visible; Resonator and Minoan in "+ More"
- Thinking placeholders with unique animations per daimon
- Dynamic verb display (LLM chooses its action verb)
- Shared Memory toggle for frame accumulation
- Lightbox for full-size image viewing
- Real-time WebSocket updates
---
**特性**:
- 可切换daimones:Flash、Pro、Dreamer、Director、Opus默认显示;Resonator和Minoan在"+ 更多"中
- 每个daimone有独特的思考占位动画
- 动态动词显示(LLM会选择对应的动作动词)
- 共享记忆开关,控制帧累积
- 灯箱功能查看全尺寸图像
- 实时WebSocket更新
---Core Concepts
核心概念
Visual Memory (KV Cache)
视觉记忆(KV Cache)
Generated images become context for subsequent generations. The folder IS the memory:
canvas/
├── stream/{session}/frame_001.jpg
├── council/{session}/frame_001.jpg
└── resonance/{session}/plate_001.jpg生成的图像会成为后续生成的上下文。文件夹即记忆载体:
canvas/
├── stream/{session}/frame_001.jpg
├── council/{session}/frame_001.jpg
└── resonance/{session}/plate_001.jpgDynamic Verb Protocol
动态动词协议
Each daimon has a default verb but can override it per response:
[VERB: glimpsed] The pattern was always there.UI displays: glimpsed
FLASH每个daimone有默认动词,但可根据响应内容覆盖:
[VERB: glimpsed] The pattern was always there.UI会显示: glimpsed
FLASHEnvironment Variables
环境变量
| Variable | Required For |
|---|---|
| All Gemini daimones (Flash, Pro, Dreamer, Director, Resonator, Minoan) |
| Claude daimones (Opus) and council.py reflections |
| 环境变量 | 适用场景 |
|---|---|
| 所有Gemini daimones(Flash、Pro、Dreamer、Director、Resonator、Minoan) |
| Claude daimones(Opus)和council.py的反思功能 |
Quick Reference
快速参考
| Script | Purpose | Key Flags |
|---|---|---|
| Multi-image style analysis | |
| One-on-one visual dialogue | |
| Multi-daimon dialogue | |
| Describe-first transformation | |
| MESSAGE TO NEXT FRAME plates | |
| Claude reflects on Gemini | |
| Tarot card generation | |
| Daimon Chamber web UI | |
Inspired by Danielle Fong's thread on persistent visual memory creating cross-model resonance.
| 脚本 | 用途 | 核心参数 |
|---|---|---|
| 多图像风格分析 | |
| 一对一视觉对话 | |
| 多Daimon对话 | |
| 先描述再转换 | |
| MESSAGE TO NEXT FRAME插图 | |
| Claude反思Gemini输出 | |
| 塔罗牌生成 | |
| Daimon Chamber网页UI | |
灵感来源于Danielle Fong的推文,关于利用持久视觉记忆实现跨模型共振。