no2 and o3 maps are not plotted

[andagit]

Describe the bug
Please provide a clear and concise description of what the bug is.

• Pyaerocom version: "0.23.0"
• Computing platform: Lustre PPI
• Configuration file (if applicable): cfg_cams2-82_IFS-ESUITE-beta.py
• Error message (if applicable): Maps of no2 and o3 are not appearing in https://aeroval-test.met.no/annac/pages/maps/?project=cams2-82&experiment=IFS-ESUITE-beta&tab=timeseries&time=2003-2023&parameter=vmrno2&station=ALL

To Reproduce
Steps to reproduce the behavior:

1. module load /modules/MET/rhel8/user-modules/fou-kl/aerotools/pya-v2024.06.cams82.conda
2. cd /home/annac/Aeroval/config/config_files
3. aeroval_parallelize --cachegen-only --cacheram 70 -m /modules/MET/rhel8/user-modules/fou-kl/aerotools/pya-v2024.06.cams82.conda cfg_cams2-82_IFS-ESUITE-beta.py
   aeroval_parallelize --nocache --anaram 64 -m /modules/MET/rhel8/user-modules/fou-kl/aerotools/pya-v2024.06.cams82.conda cfg_cams2-82_IFS-ESUITE-beta.py

Expected behavior
A clear and concise description.
With the PyAerocom version "0.20.dev1" and same configuration file no2 and o3 maps are plotted, but not anylonger....
annac@ppi-r8login-b1:~/Aeroval/data/cams2-82/IFS-ESUITE-beta$ ls contour/no2
ls: cannot access 'contour/no2': No such file or directory

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

[lewisblake]

As we discussed, this could be a memory issue. Charlie had a similar issue with the CAMS2_83 run last week but it solved itself on a rerun. Please try this and report back :)

[andagit]

It is not a memory issue, but Jan is suggesting that when introducing the observations to the maps, PyAerocom map plotting became a bit more strict on model variable name and is struggling with reading mmro3 and mmrno2 (req. vmro3 and vmrno2) from the ECMWF model input model files.

[lewisblake]

Probably we should introduce a target unit into the ModelMapsEngine (if there isn't one already). We should check to see if in the model maps whether these conversions are occurring for species which are e.g., ug S m-3 vs ug m-3

[lewisblake]

@MichaelSchulzMETNO Is this a priority for CAMS2_82?

[MichaelSchulzMETNO]

I believe that should be "standard quality", to be able to show the maps for all evaluated variables. Does it help to plot only monthly maps?

[lewisblake]

@andagit when you get a chance, could you please try this fix #1422 and report back?

[andagit]

https://aeroval-test.met.no/annac/pages/maps/?project=cams2-82&experiment=IFStest is run with pya-v2024.12 and the maps for O3 and NO2 are now showing obs, but no model data: "No contour data available"

[lewisblake]

Jan and I would like to touch base about how to approach this. We think it may be better to invest our time into converting the data before reading it into pyaerocom. The conversion there is not very sophisticated and slows down the runs quite a bit. In this case. applying the same simple conversions ahead of time might be cheaper.