gdaladdo creates black edges if mask is used

[zdila]

What is the bug?

gdaladdo creates black edges if mask is used

Input file: input.tif.gz

Rendered before adding overviews:

Steps to reproduce the issue

Run gdaladdo -r lanczos --config COMPRESS_OVERVIEW JPEG --config PHOTOMETRIC_OVERVIEW=YCBCR input.tif on geotiff with following metadata:

Image Structure Metadata:
  SOURCE_COLOR_SPACE=YCbCr
  COMPRESSION=YCbCr JPEG
  INTERLEAVE=PIXEL
  JPEG_QUALITY=75
  JPEGTABLESMODE=1
Band 1 Block=13092x16 Type=Byte, ColorInterp=Red
  Mask Flags: PER_DATASET 
Band 2 Block=13092x16 Type=Byte, ColorInterp=Green
  Mask Flags: PER_DATASET 
Band 3 Block=13092x16 Type=Byte, ColorInterp=Blue
  Mask Flags: PER_DATASET 

Rendered after adding overviews:

Note that i render image onto red background.

Versions and provenance

GDAL 3.11.0dev-051a853584, released 2024/10/31
Linux bono 6.11.10-amd64 #1 SMP PREEMPT_DYNAMIC Debian 6.11.10-1 (2024-11-23) x86_64 GNU/Linux

Additional context

#11535 (comment)

[jratike80]

Have you tried with lossless compressed overviews?

[jratike80]

This gives an error

gdaladdo -r lanczos --config COMPRESS_OVERVIEW deflate input2.tif
0...10...20...30...40...50...60...70...80ERROR 1: RGBA interpreted raster bands are read-only.
ERROR 1: RGBA interpreted raster bands are read-only.
ERROR 1: RGBA interpreted raster bands are read-only.
ERROR 1: IReadBlock failed at X offset 0, Y offset 0
...90...100 - done.

but nearest resampling with no compression gives sharp edges

gdaladdo input3.tif

[zdila]

For me it seems like compression doesn't cause it but resampling method does.

• gdaladdo input.tif - no problem
• gdaladdo -r near input.tif - no problem
• gdaladdo -r average input.tif - no problem
• gdaladdo -r rms input.tif - no problem
• gdaladdo -r mode input.tif - thin black edges
• gdaladdo -r average_magphase input.tif - thin black edges
• gdaladdo -r bilinear input.tif - medium black edges
• gdaladdo -r cubic input.tif - medium black edges
• gdaladdo -r gauss input.tif - medium black edges
• gdaladdo -r cubicspline input.tif - thick black edges