Marine GDAS Verification Tools

Unit Testing

This oceanview application relies on older interactive tools and probably requires a different Python environment. Test it separately, from the root directory of the repository:

conda activate oceanview  # Does not work on HPC yet
pytest --disable-warnings -v tests/oceanview/test_oceanview.py

The other application require the EVA modules to be loaded to work:

module use modulefiles
module load EVA/orion
pytest --disable-warnings -v tests/test_coding_style.py
pytest --disable-warnings -v tests/obsstats_ts/

Simple Observation Space Statistics

A quick way to generate o-b stats and compare experiments

python gdassoca_obsstats.py --exps .../COMROOT/cp1 .../COMROOT/cp2 --inst '*' --dirout cp1vscp2

The above will generate time series of o-b RMSEs, Bias, and obs count for multiple regions. It will also generate an HTML document to facilitate viewing figures.

---

Using oceanview

An interactive tool, mostly meant for insitu obs.

./oceanview -v waterTemperature -i insitu_profile_argo.2021070412.nc4

---

How to generate the EVA and State space figures

Create a scratch place to run run_vrfy.py. This script will generate a bunch of sbatch scripts and logs.

mkdir /somewhere/scratch
cd /somewhere/scratch
ln -s /path/to/run_vrfy.py .   # to be sorted out properly in the future
cp /path/to/vrfy_config.yaml .
module use ...
module load EVA/....

---

Edit vrfy_config.yaml

It's actually read as a jinja template to render pslot if necessary. Anything that is a templated variable in vrfy_jobcard.sh.j2 can be added to the yaml below.

pslot: "nomlb"
start_pdy: '20210701'
end_pdy: '20210701'
cycs: ["00", "06", "12", "18"]
run: "gdas"
homegdasmarineviz: "/path/to/gdas-marine-viz"
base_exp_path: "/path/to/comroot/{{ pslot }}/COMROOT/{{ pslot }}"
plot_ensemble_b: "OFF"
plot_parametric_b: "OFF"
plot_background: "OFF"
plot_increment: "ON"
plot_analysis: "OFF"
eva_plots: "ON"
qos: "batch"
hpc: "hercules"
eva_module: "EVA/orion"

---

Run the application

python run_vrfy.py vrfy_config.yaml This will generate and submit the job cards for all the cycles defined by cycs, from start_pdy to end_pdy.

---

View the results

The script above will create figures according to the specified configuration. An index.html file is also generated to facilitate browsing through the results.

On hera

X2GO is probably the simplest option to start a browser and view the results.

On MSU

Two options that works:

• Use the MSU Dashboard application
• Tar the results and copy to your local machine