DiffSynth-Studio/docs/en/Diffusion_Templates/Introducing_Diffusion_Templates.md

Diffusion Templates

Diffusion Templates is a controllable generation plugin framework for Diffusion models in DiffSynth-Studio, providing additional controllable generation capabilities for base models.

• Open Source Code: DiffSynth-Studio
• Technical Report: coming soon
• Documentation Reference
  • Introducing Diffusion Templates: English Version, 中文版
  • Diffusion Templates Architecture Details: English Version, 中文版
  • Template Model Inference: English Version, 中文版
  • Template Model Training: English Version, 中文版
• Online Demo: ModelScope Creative Space
• Models: Collection
  • Structure Control: DiffSynth-Studio/Template-KleinBase4B-ControlNet
  • Brightness Adjustment: DiffSynth-Studio/Template-KleinBase4B-Brightness
  • Color Adjustment: DiffSynth-Studio/Template-KleinBase4B-SoftRGB
  • Image Editing: DiffSynth-Studio/Template-KleinBase4B-Edit
  • Super Resolution: DiffSynth-Studio/Template-KleinBase4B-Upscaler
  • Sharpness Enhancement: DiffSynth-Studio/Template-KleinBase4B-Sharpness
  • Aesthetic Alignment: DiffSynth-Studio/Template-KleinBase4B-Aesthetic
  • Inpainting: DiffSynth-Studio/Template-KleinBase4B-Inpaint
  • Content Reference: DiffSynth-Studio/Template-KleinBase4B-ContentRef
  • Panda Meme (Easter Egg Model): DiffSynth-Studio/Template-KleinBase4B-PandaMeme
• Datasets: Collection
  • DiffSynth-Studio/ImagePulseV2-Edit-Inpaint
  • DiffSynth-Studio/ImagePulseV2-TextImage
  • DiffSynth-Studio/ImagePulseV2-Edit-Background
  • DiffSynth-Studio/ImagePulseV2-Edit-Clothes
  • DiffSynth-Studio/ImagePulseV2-Edit-Pose
  • DiffSynth-Studio/ImagePulseV2-Edit-Change
  • DiffSynth-Studio/ImagePulseV2-Edit-AddRemove
  • DiffSynth-Studio/ImagePulseV2-Edit-Upscale
  • DiffSynth-Studio/ImagePulseV2-TextImage-Human
  • DiffSynth-Studio/ImagePulseV2-Edit-Crop
  • DiffSynth-Studio/ImagePulseV2-Edit-Light
  • DiffSynth-Studio/ImagePulseV2-Edit-Structure
  • DiffSynth-Studio/ImagePulseV2-Edit-HumanFace
  • DiffSynth-Studio/ImagePulseV2-Edit-Angle
  • DiffSynth-Studio/ImagePulseV2-Edit-Style
  • DiffSynth-Studio/ImagePulseV2-TextImage-MultiResolution
  • DiffSynth-Studio/ImagePulseV2-Edit-Merge

Model Gallery

• Super Resolution + Sharpness Enhancement: Generate ultra-high-clarity images

Low Resolution Input	High Resolution Output

• Structure Control + Aesthetic Alignment + Sharpness Enhancement: Fully-armed ControlNet

Structure Control Image	Output Image

• Structure Control + Image Editing + Color Adjustment: Artistic style creation at will

Structure Control Image	Editing Input Image	Output Image

• Brightness Control + Image Editing + Inpainting: Transport elements across dimensions

Reference Image	Inpaint Region	Output Image