Issue with colors

[DenkingOfficial]

Selected area of the image has a magenta tint after outpainting.

[lkwq007]

Can this color issue be reproduced with patch_match init_mode?

[DenkingOfficial]

Yes, it is:

[DenkingOfficial]

It goes crazy with colors when you covering the same area a couple of times

[lkwq007]

I see. How about install scikit-image and import it import skimage; then uncomment these two line in the run_outpaint

            mask=skimage.measure.block_reduce(mask,(8,8),np.max)
            mask=mask.repeat(8, axis=0).repeat(8, axis=1)

[agustincaniglia]

that's a known problem every repo had. I think they are fixed the red and then hey got the cyan bad... I don't know where they are now known repos like hlky or automatic but they did face this problem too. Sorry for bothering I don't know code I just know what I say.

[DenkingOfficial]

I see. How about install scikit-image and import it import skimage; then uncomment these two line in the run_outpaint

            mask=skimage.measure.block_reduce(mask,(8,8),np.max)
            mask=mask.repeat(8, axis=0).repeat(8, axis=1)

Nope, that's not working :(

[lkwq007]

that's a known problem every repo had. I think they are fixed the red and then hey got the cyan bad... I don't know where they are now known repos like hlky or automatic but they did face this problem too. Sorry for bothering I don't know code I just know what I say.

@agustincaniglia
Thanks for your information. It seems that's a bug of the current version stable diffusion.

@DenkingOfficial
If that's a bug of stable diffusion, I think I might be unable to fix it.
However, I just came up with a possible workaround: photometric correction via Poisson image editing. I will try it later.

[badcode6]

I am having this same issue with the edge pad

[fractaltr33]

Say more, each next generation enhances the contrast of each frame contour. Every new generation, periodically, the result in the whole picture becomes worse.

[lkwq007]

@DenkingOfficial

Some updates:

The major issue is that diffusers's inpainting doesn't preserve unmasked content well. It will slightly change the existing regions and therefore results in this color issue.

I just added photometric correction to suppress this color issue. Not sure if it work or not.
The current implementation only works on Linux/MacOS.

Before:

After:

[DenkingOfficial]

I just added photometric correction to suppress this color issue. Not sure if it work or not. The current implementation only works on Linux/MacOS.

That's amazing!
I'm gonna try it on WSL tomorrow
Thank you for your work!

[Rolli700]

Using Photometric correction replys something like:
PIE: Iter 5000, abs error [11.975403 21.68322 7.70292 ]

Ubuntu 20.04, fresh setup as discribed in your linux documentation.

[lkwq007]

Using Photometric correction replys something like: PIE: Iter 5000, abs error [11.975403 21.68322 7.70292 ]

Ubuntu 20.04, fresh setup as discribed in your linux documentation.

It's not an error. Just some metrics reported by fpie.