feat(basemaps): Topo raster maps standardisation workflow. BM-1128

[Wentao-Kuang]

Motivation

As a Basemaps user, I want to consume the NZTopo 50 & 250 Maps as a tile service.

Modification

This work defines a new Argo Workflow. The workflow's purpose is to coordinate the standardisation of an NZTopo Map Series imagery collection. We have designed the workflow to process the following collections stored in the AWS S3 TopoReleaseArchive directory:

s3://topographic-upload/TopoReleaseArchive/NZTopo50_GeoTif_Gridless/
s3://topographic-upload/TopoReleaseArchive/NZTopo250_GeoTif_Gridless/

This workflow has two key steps:

For a NZTopo Map Series imagery collection:

1. Generate STAC Item and Collection files
2. Standardise the containing imagery

---

Checklist

If not applicable, provide explanation of why.

• Tests updated
• Docs updated
• Issue linked in Title

[tawera-manaena]

Suggested change

	container:
	image: 019359803926.dkr.ecr.ap-southeast-2.amazonaws.com/argo-tasks:{{workflow.parameters.version_argo_tasks}}
	command: [node, /app/index.js]
	env:
	- name: AWS_ROLE_CONFIG_PATH
	value: s3://linz-bucket-config/config.json
	args:
	- 'bmc'
	- 'topo-stac-creation'
	- '--source={{ inputs.parameters.source }}'
	- '--target={{ inputs.parameters.target }}'
	- '--title={{ inputs.parameters.title }}'
	- '--scale={{ inputs.parameters.scale }}'
	- '--resolution={{ inputs.parameters.resolution }}'
	- '--latest-only={{ inputs.parameters.latest-only }}'
	container:
	image: ghcr.io/linz/basemaps/cli:{{ workflow.parameters.version_basemaps_cli }}
	command: [node, /app/node_modules/@basemaps/cogify/dist/index.cjs]
	env:
	- name: AWS_ROLE_CONFIG_PATH
	value: s3://linz-bucket-config/config.json
	args:
	- 'stac'
	- '--source={{ inputs.parameters.source }}'
	- '--target={{ inputs.parameters.target }}'
	- '--title={{ inputs.parameters.title }}'
	- '--scale={{ inputs.parameters.scale }}'
	- '--resolution={{ inputs.parameters.resolution }}'
	- '--latest-only={{ inputs.parameters.latest-only }}'

We are in the process of migrating the Argo Task work to Basemaps. The former topo-stac-creation Argo Task can now be executed by way of the Cogify CLI's stac command. The workflow should be updated as per this suggestion.

[tawera-manaena]

@Wentao-Kuang - I've made a minor adjustment to the workflow in Argo. We need to bring those changes here.

Before

        artifacts:
          - name: tiles
            path: /tmp/topo-stac-creation/tiles.json
          - name: brokenTiffs
            path: /tmp/topo-stac-creation/brokenTiffs.json

After

        artifacts:
          - name: tiles
            path: /tmp/topo-stac-creation/tiles.json
          - name: brokenTiffs
            path: /tmp/topo-stac-creation/broken-tiffs.json