mirror of
https://github.com/modelscope/DiffSynth-Studio.git
synced 2026-03-18 22:08:13 +00:00
2.6 KiB
2.6 KiB
IP-Adapter
IP-Adapter is a interesting model, which can adopt the content or style of another image to generate a new image.
Example: Content Controlling in Stable Diffusion
Based on Stable Diffusion, we can transfer the object to another scene. See sd_ipadapter.py.
| First, we generate a car. The prompt is "masterpiece, best quality, a car". | Next, utilizing IP-Adapter, we move the car to the road. The prompt is "masterpiece, best quality, a car running on the road". |
|---|---|
Example: Content and Style Controlling in Stable Diffusion XL
The IP-Adapter model based on Stable Diffusion XL is more powerful. You have the option to use the content or style. See sdxl_ipadapter.py.
- Content controlling (original usage of IP-Adapter)
| First, we generate a rabbit. | Next, enable IP-Adapter and let the rabbit jump. | For comparision, disable IP-Adapter to see the generated image. |
|---|---|---|
- Style controlling (InstantStyle)
| First, we generate a rabbit. | Next, enable InstantStyle and convert the rabbit to a cat. | For comparision, disable IP-Adapter to see the generated image. |
|---|---|---|
Example: Image Fusing (Experimental)
Since IP-Adapter can control the content based on more than one image, we can do something interesting. See sdxl_ipadapter_multi_reference.py.
We have two pokemons here:
| Charizard | Pikachu |
|---|---|
 |
 |
Fuse!
| Pikazard ??? |
|---|