mirror of
https://github.com/modelscope/DiffSynth-Studio.git
synced 2026-03-18 22:08:13 +00:00
2.5 KiB
2.5 KiB
Pipelines
So far, the following table lists our pipelines and the models supported by each pipeline.
Image Pipelines
Pipelines for generating images from text descriptions. Each pipeline relies on specific encoder and decoder models.
| Pipeline | Models |
|---|---|
| HunyuanDiTImagePipeline | text_encoder: HunyuanDiTCLIPTextEncoder text_encoder_t5: HunyuanDiTT5TextEncoder dit: HunyuanDiT vae_decoder: SDVAEDecoder vae_encoder: SDVAEEncoder |
| SDImagePipeline | text_encoder: SDTextEncoder unet: SDUNet vae_decoder: SDVAEDecoder vae_encoder: SDVAEEncoder controlnet: MultiControlNetManager ipadapter_image_encoder: IpAdapterCLIPImageEmbedder ipadapter: SDIpAdapter |
| SD3ImagePipeline | text_encoder_1: SD3TextEncoder1 text_encoder_2: SD3TextEncoder2 text_encoder_3: SD3TextEncoder3 dit: SD3DiT vae_decoder: SD3VAEDecoder vae_encoder: SD3VAEEncoder |
| SDXLImagePipeline | text_encoder: SDXLTextEncoder text_encoder_2: SDXLTextEncoder2 text_encoder_kolors: ChatGLMModel unet: SDXLUNet vae_decoder: SDXLVAEDecoder vae_encoder: SDXLVAEEncoder controlnet: MultiControlNetManager ipadapter_image_encoder: IpAdapterXLCLIPImageEmbedder ipadapter: SDXLIpAdapter |
Video Pipelines
Pipelines for generating videos from text descriptions. In addition to the models required for image generation, they include models for handling motion modules.
| Pipeline | Models |
|---|---|
| SDVideoPipeline | text_encoder: SDTextEncoder unet: SDUNet vae_decoder: SDVAEDecoder vae_encoder: SDVAEEncoder controlnet: MultiControlNetManager ipadapter_image_encoder: IpAdapterCLIPImageEmbedder ipadapter: SDIpAdapter motion_modules: SDMotionModel |
| SDXLVideoPipeline | text_encoder: SDXLTextEncoder text_encoder_2: SDXLTextEncoder2 text_encoder_kolors: ChatGLMModel unet: SDXLUNet vae_decoder: SDXLVAEDecoder vae_encoder: SDXLVAEEncoder ipadapter_image_encoder: IpAdapterXLCLIPImageEmbedder ipadapter: SDXLIpAdapter motion_modules: SDXLMotionModel |
| SVDVideoPipeline | image_encoder: SVDImageEncoder unet: SVDUNet vae_encoder: SVDVAEEncoder vae_decoder: SVDVAEDecoder |