support IPAdapter?

[libai-lab]

No description provided.

[sunovivid]

Thank you for your interest in our work! We have not yet tested compatibility with IPAdapter, but since PAG integrates well with various pipelines such as inpainting, super-resolution, and ControlNet due to its very simple methodology, we believe it should work well. However, at this stage, we do not have code that clearly checks compatibility, but we plan to test this in the future. For more information, please refer to the active discussion on this topic in the Diffusers repository PR [https://github.com/huggingface/diffusers/pull/7944]. If there are any updates, we will ping you. Thank you.

[libai-lab]

I tested and it doesn't support IP adapter. How can I modify the code if I want to use it? Thank you for your great work

感谢您对我们工作的关注！我们尚未测试与 IPAdapter 的兼容性，但由于 PAG 的方法非常简单，可以很好地与各种流水线集成，例如修复、超分辨率和 ControlNet，我们相信它应该可以很好地工作。但是，在这个阶段，我们没有明确检查兼容性的代码，但我们计划在未来对此进行测试。有关更多信息，请参阅扩散器存储库 PR [https://github.com/ huggingface/diffusers/pull/7944] 中对此主题的积极讨论。如果有任何更新，我们会通知您。谢谢。

I tested and it doesn't support IP adapter. How can I modify the code if I want to use it? Thank you for your great work

[sunovivid]

Hi @libai-lab, Sorry for the late response.

We have implemented PAG compatible with IP-Adapter. Please check out the PR: huggingface/diffusers#8379.

We verified the compatibility between PAG and IP-Adapter, and it works great. However, it has not been merged into the stable version yet. Thankfully, a HuggingFace ML engineer is working to integrate it into Diffusers.

If you want to use it now, you can try cloning the PR (there is also an example test code). Otherwise, I will let you know once the PR is merged.

Thank you!

[sunovivid]

@libai-lab Thank you for waiting! Diffusers now officially support PAG. You can now easily use PAG in various Diffusers pipelines, including IP-Adapter.

For more details, check here.