mirror of
https://github.com/modelscope/DiffSynth-Studio.git
synced 2026-03-19 14:58:12 +00:00
45 lines
2.6 KiB
Markdown
45 lines
2.6 KiB
Markdown
# IP-Adapter
|
|
|
|
IP-Adapter is a interesting model, which can adopt the content or style of another image to generate a new image.
|
|
|
|
## Example: Content Controlling in Stable Diffusion
|
|
|
|
Based on Stable Diffusion, we can transfer the object to another scene. See [`sd_ipadapter.py`](./sd_ipadapter.py).
|
|
|
|
|First, we generate a car. The prompt is "masterpiece, best quality, a car".|Next, utilizing IP-Adapter, we move the car to the road. The prompt is "masterpiece, best quality, a car running on the road".|
|
|
|-|-|
|
|
|||
|
|
|
|
## Example: Content and Style Controlling in Stable Diffusion XL
|
|
|
|
The IP-Adapter model based on Stable Diffusion XL is more powerful. You have the option to use the content or style. See [`sdxl_ipadapter.py`](./sdxl_ipadapter.py).
|
|
|
|
* Content controlling (original usage of IP-Adapter)
|
|
|
|
|First, we generate a rabbit.|Next, enable IP-Adapter and let the rabbit jump.|For comparision, disable IP-Adapter to see the generated image.|
|
|
|-|-|-|
|
|
||||
|
|
|
|
|
|
* Style controlling (InstantStyle)
|
|
|
|
|First, we generate a rabbit.|Next, enable InstantStyle and convert the rabbit to a cat.|For comparision, disable IP-Adapter to see the generated image.|
|
|
|-|-|-|
|
|
||||
|
|
|
|
## Example: Image Fusing (Experimental)
|
|
|
|
Since IP-Adapter can control the content based on more than one image, we can do something interesting. See [`sdxl_ipadapter_multi_reference.py`](sdxl_ipadapter_multi_reference.py).
|
|
|
|
We have two pokemons here:
|
|
|
|
|Charizard|Pikachu|
|
|
|-|-|
|
|
|||
|
|
|
|
Fuse!
|
|
|
|
|Pikazard ???|
|
|
|-|
|
|
||
|