Loading...
Loading...
Compare original and translation side by side
1. Keyframe Generation Phase
- Generate consistent keyframes with IP-Adapter/LoRA
- Validate face consistency, lighting, pose progression
- Save to organized directory structure
- Auto-retry failed generations
2. I2V Animation Phase
- Queue each keyframe to I2V model (Wan 2.2, LTX-2, AnimateDiff)
- Monitor progress via ComfyUI API
- Validate each clip (resolution, fps, duration)
- Auto-retry with different seeds if failed
3. Concatenation Phase
- Pre-flight validation (ensure all clips match)
- Apply transition effects (crossfade, motion blur)
- FFmpeg encoding with proper codec
- Export final video with metadata
4. Quality Assurance
- Face consistency check across clips
- Color grading consistency
- Audio sync validation (if applicable)
- Generate QA report1. 关键帧生成阶段
- 使用IP-Adapter/LoRA生成一致性关键帧
- 验证面部一致性、光线、姿态连贯性
- 保存至结构化目录
- 自动重试失败的生成任务
2. I2V动画化阶段
- 将每个关键帧提交至I2V模型队列(Wan 2.2、LTX-2、AnimateDiff)
- 通过ComfyUI API监控进度
- 验证每个片段的分辨率、帧率、时长
- 失败时自动使用不同种子重试
3. 拼接阶段
- 预验证(确保所有片段参数匹配)
- 应用转场效果(交叉淡入淡出、运动模糊)
- 使用FFmpeg按正确编码格式转码
- 导出带元数据的最终视频
4. 质量保证
- 检查片段间的面部一致性
- 色彩分级一致性
- 音频同步验证(如有音频)
- 生成质量报告1. Image Discovery
- Scan directory for source images
- Validate image specs (resolution, format)
- Generate processing manifest
2. Parallel I2V Queue
- Queue all images to ComfyUI with appropriate prompts
- Stagger submissions to avoid overload
- Monitor queue depth and ETA
3. Progressive Validation
- Check each completed video immediately
- Flag issues (wrong resolution, fps, corruption)
- Auto-retry flagged videos
4. Export & Organize
- Move validated videos to output directory
- Generate index with metadata
- Create contact sheet (thumbnail preview grid)1. 图像识别
- 扫描目录获取源图像
- 验证图像规格(分辨率、格式)
- 生成处理清单
2. 并行I2V队列
- 将所有图像按对应提示词提交至ComfyUI
- 错开提交时间避免过载
- 监控队列深度和预计完成时间
3. 渐进式验证
- 完成后立即检查每个视频
- 标记问题(错误分辨率、帧率、损坏)
- 自动重试标记的视频
4. 导出与整理
- 将验证通过的视频移至输出目录
- 生成带元数据的索引
- 创建预览缩略图网格1. Clip Validation
- Verify all clips exist and are readable
- Check resolution, fps, codec consistency
- Report mismatches with fix suggestions
2. Transition Planning
- Detect scene changes (cut detection)
- Recommend transition types (crossfade, zoom, pan)
- Calculate transition timing
3. FFmpeg Pipeline
- Apply transitions between clips
- Re-encode with consistent settings
- Preserve quality (high bitrate, proper codec)
4. Audio Handling
- Extract audio from clips (if present)
- Crossfade audio at transitions
- Sync to final video timeline1. 片段验证
- 验证所有片段存在且可读取
- 检查分辨率、帧率、编码格式一致性
- 报告不匹配问题并提供修复建议
2. 转场规划
- 检测场景切换
- 推荐转场类型(交叉淡入淡出、缩放、平移)
- 计算转场时长
3. FFmpeg流水线
- 在片段间应用转场
- 按统一设置重新编码
- 保留画质(高码率、正确编码格式)
4. 音频处理
- 提取片段中的音频(如有)
- 在转场处交叉淡入淡出音频
- 同步至最终视频时间轴| Model | Quality | Speed | VRAM | Best For | Notes |
|---|---|---|---|---|---|
| LTX-2 | ★★★★★ | Medium | 16GB+ | Production 4K video | Native 4K, audio+video |
| Wan 2.2 MoE | ★★★★★ | Slow | 24GB+ | Film-quality aesthetics | First+last frame control |
| Wan 2.1 14B | ★★★★ | Slow | 24GB | High quality | Proven, stable |
| Wan 2.1 1.3B | ★★★ | Fast | 8GB | Quick iteration | Consumer-friendly |
| AnimateDiff V3 | ★★★ | Fast | 8GB | Infinite length | Motion LoRAs |
| SVD (Stable Video Diffusion) | ★★★ | Medium | 12GB | Short clips | 14-25 frames |
| Model | 画质 | 速度 | VRAM | 适用场景 | 说明 |
|---|---|---|---|---|---|
| LTX-2 | ★★★★★ | 中等 | 16GB+ | 专业4K视频制作 | 原生4K,支持音视频 |
| Wan 2.2 MoE | ★★★★★ | 较慢 | 24GB+ | 电影级画质 | 支持首尾帧控制 |
| Wan 2.1 14B | ★★★★ | 较慢 | 24GB | 高质量 | 成熟稳定 |
| Wan 2.1 1.3B | ★★★ | 较快 | 8GB | 快速迭代 | 面向普通用户 |
| AnimateDiff V3 | ★★★ | 较快 | 8GB | 无限时长 | 支持运动LoRA |
| SVD (Stable Video Diffusion) | ★★★ | 中等 | 12GB | 短片段 | 14-25帧 |
| Effect | Use Case | Encoding Cost |
|---|---|---|
| Crossfade | General purpose | Low |
| Motion blur | High-motion scenes | Medium |
| Zoom in/out | Dramatic emphasis | Medium |
| Pan left/right | Scene establishment | Medium |
| Fade to/from black | Chapter breaks | Low |
| Custom LUT | Color grading | Low |
| 效果 | 适用场景 | 编码成本 |
|---|---|---|
| 交叉淡入淡出 | 通用场景 | 低 |
| 运动模糊 | 高动态场景 | 中等 |
| 缩放 | 戏剧性强调 | 中等 |
| 左右平移 | 场景铺垫 | 中等 |
| 淡入淡出黑场 | 章节切换 | 低 |
| 自定义LUT | 色彩分级 | 低 |
undefinedundefinedundefinedundefined1. Soft Recovery (no restart)
- Clear stuck queue items
- Force garbage collection
- Unload models from VRAM
2. Hard Recovery (restart required)
- Save current queue state
- Kill ComfyUI process gracefully
- Wait for port release
- Restart with same config
- Restore queue from saved state
3. Emergency Fallback
- Switch to backup ComfyUI instance
- Redirect queue to instance on different port
- Continue processing without data loss1. 软恢复(无需重启)
- 清除停滞队列项
- 强制垃圾回收
- 从显存卸载模型
2. 硬恢复(需重启)
- 保存当前队列状态
- 优雅终止ComfyUI进程
- 等待端口释放
- 使用相同配置重启
- 从保存的状态恢复队列
3. 紧急降级
- 切换至备用ComfyUI实例
- 将队列重定向至不同端口的实例
- 无数据丢失继续处理undefinedundefined
---
---✓ Check ComfyUI is running and responsive
✓ Verify models are loaded (UNET, VAE, CLIP)
✓ Confirm output directory has sufficient space
✓ Validate source images exist and are readable
✓ Check prompts are non-empty and formatted correctly
✓ Verify workflow JSON is valid✓ 检查ComfyUI是否运行且响应正常
✓ 验证模型已加载(UNET、VAE、CLIP)
✓ 确认输出目录有足够空间
✓ 验证源图像存在且可读取
✓ 检查提示词非空且格式正确
✓ 验证工作流JSON有效✓ Video file exists and is non-zero size
✓ Resolution matches expected (e.g., 768x1024)
✓ FPS matches expected (e.g., 16 or 25)
✓ Duration matches expected (e.g., 3-5 seconds)
✓ Codec is compatible (h264, h265)
✓ No corruption (can read all frames)
✓ Face consistency score >0.85 (if character video)
✓ Color histogram within expected range✓ 视频文件存在且大小非零
✓ 分辨率符合预期(如768x1024)
✓ FPS符合预期(如16或25)
✓ 时长符合预期(如3-5秒)
✓ 编码格式兼容(h264、h265)
✓ 无损坏(可读取所有帧)
✓ 面部一致性得分>0.85(人物视频)
✓ 颜色直方图在预期范围内Metrics tracked:
- Face embedding distance (identity consistency)
- Optical flow magnitude (motion smoothness)
- Frame PSNR/SSIM (interpolation quality)
- Color histogram deviation (lighting consistency)
- Audio sync offset (if audio present)跟踪的指标:
- 人脸嵌入距离(身份一致性)
- 光流幅度(运动平滑度)
- 帧PSNR/SSIM(插值质量)
- 颜色直方图偏差(光线一致性)
- 音频同步偏移(如有音频)1. Seed Randomization Retry
- Failed generation? Try different seed
- Max 3 attempts per keyframe
- Track seeds that fail (avoid reuse)
2. Parameter Adjustment Retry
- CFG too high causing artifacts? Lower it
- Steps too low causing incompleteness? Increase
- Resolution too high OOM? Downscale
3. Model Fallback Retry
- Wan 2.2 14B OOM? Fall back to 1.3B
- LTX-2 unavailable? Fall back to Wan 2.1
- AnimateDiff motion broken? Switch motion LoRA
4. Checkpoint Resume
- Save progress after each successful clip
- Resume from last successful checkpoint
- Skip already-generated clips1. 种子随机化重试
- 生成失败?尝试不同种子
- 每个关键帧最多3次尝试
- 记录失败种子(避免重复使用)
2. 参数调整重试
- CFG过高导致伪影?降低参数
- 步数太少导致不完整?增加步数
- 分辨率过高导致显存不足?降低分辨率
3. 模型降级重试
- Wan 2.2 14B显存不足?降级至1.3B
- LTX-2不可用?降级至Wan 2.1
- AnimateDiff运动异常?切换运动LoRA
4. 断点续传
- 每个片段成功后保存进度
- 从最后成功的断点恢复
- 跳过已生成的片段logs/
├── 2026-02-16_pipeline.log # Main pipeline log
├── 2026-02-16_comfyui.log # ComfyUI stdout/stderr
├── 2026-02-16_validation.json # Validation results
├── 2026-02-16_failures.json # Failed attempts with reasons
└── 2026-02-16_recovery.json # Recovery actions takenlogs/
├── 2026-02-16_pipeline.log # 主流水线日志
├── 2026-02-16_comfyui.log # ComfyUI标准输出/错误日志
├── 2026-02-16_validation.json # 验证结果
├── 2026-02-16_failures.json # 失败尝试及原因
└── 2026-02-16_recovery.json # 执行的恢复操作project_name/
├── 00_keyframes/ # Source keyframe images
│ ├── kf01_scene_description.png
│ ├── kf02_scene_description.png
│ └── ...
├── 01_clips/ # Individual animated clips
│ ├── clip_001_kf01.mp4
│ ├── clip_002_kf02.mp4
│ └── ...
├── 02_validated/ # Clips that passed validation
│ ├── clip_001_kf01.mp4
│ ├── clip_002_kf02.mp4
│ └── ...
├── 03_transitions/ # Intermediate files for transitions
│ ├── transition_001_002.mp4
│ └── ...
├── 04_final/ # Final combined video
│ ├── final_video_v1.mp4
│ ├── final_video_v2.mp4 # After revisions
│ └── ...
├── logs/ # Execution logs
├── metadata/ # JSON metadata for each asset
└── manifest.json # Complete project manifestproject_name/
├── 00_keyframes/ # 源关键帧图像
│ ├── kf01_scene_description.png
│ ├── kf02_scene_description.png
│ └── ...
├── 01_clips/ # 独立动画片段
│ ├── clip_001_kf01.mp4
│ ├── clip_002_kf02.mp4
│ └── ...
├── 02_validated/ # 验证通过的片段
│ ├── clip_001_kf01.mp4
│ ├── clip_002_kf02.mp4
│ └── ...
├── 03_transitions/ # 转场中间文件
│ ├── transition_001_002.mp4
│ └── ...
├── 04_final/ # 最终合并视频
│ ├── final_video_v1.mp4
│ ├── final_video_v2.mp4 # 修订后版本
│ └── ...
├── logs/ # 执行日志
├── metadata/ # 各资源的JSON元数据
└── manifest.json # 完整项目清单undefinedundefinedundefinedundefinedundefinedundefined
---
---references/keyframe-generation.mdreferences/i2v-workflows.mdreferences/concatenation.mdreferences/validation.mdreferences/instance-management.mdreferences/api-reference.mdreferences/troubleshooting.mdreferences/keyframe-generation.mdreferences/i2v-workflows.mdreferences/concatenation.mdreferences/validation.mdreferences/instance-management.mdreferences/api-reference.mdreferences/troubleshooting.mdcomfyui-character-genvideo-assemblyyoutube-uploadercomfyui-character-genvideo-assemblyyoutube-uploaderundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefinedundefined
---
---undefinedundefinedundefinedundefinedundefinedundefined
---
---references/i2v-workflows.mdreferences/evolution.mdreferences/i2v-workflows.mdreferences/evolution.md