Skip to content

Commit

Permalink
WW3: Add indicator log file for gridded output (#3304)
Browse files Browse the repository at this point in the history 
Adds functionality to write an indicator log file which will signal
gridded output has completed writing for a given grid and timestep

Refs #3094
Refs ufs-community/ufs-weather-model#2545
Refs NOAA-EMC/WW3#1321
  • Loading branch information
@MatthewMasarik-NOAA
MatthewMasarik-NOAA authored Feb 12, 2025
1 parent bc1dd7d commit 28184a8
Show file tree
Hide file tree
Showing 5 changed files with 89 additions and 149 deletions.
2 changes: 1 addition & 1 deletion Externals.cfg
View file
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# External sub-modules of global-workflow

[FV3GFS]
tag = GFS.v16.3.1
tag = GFS.v16.4.0
local_path = sorc/fv3gfs.fd
repo_url = https://github.com/ufs-community/ufs-weather-model.git
protocol = git
Expand Down
116 changes: 25 additions & 91 deletions docs/Release_Notes.md
View file
Original file line number Diff line number Diff line change
@@ -1,10 +1,12 @@
GFS V16.3.21 RELEASE NOTES
GFS V16.4.0 RELEASE NOTES

-------
PRELUDE
-------

The WAFS is separated from the GFS and is now its own package in production as WAFS.v7.0.0.
TODO: ADD DA UPDATE DETAILS

Also included in this upgrade are changes to add an indicator log file for WW3 gridded output.

IMPLEMENTATION INSTRUCTIONS
---------------------------
Expand All @@ -13,9 +15,9 @@ The NOAA VLab and the NOAA-EMC and NCAR organization spaces on GitHub are used t

```bash
cd $PACKAGEROOT
mkdir gfs.v16.3.21
cd gfs.v16.3.21
git clone -b EMC-v16.3.21 https://github.com/NOAA-EMC/global-workflow.git .
mkdir gfs.v16.4.0
cd gfs.v16.4.0
git clone -b EMC-v16.4.0 https://github.com/NOAA-EMC/global-workflow.git .
cd sorc
./checkout.sh -o
```
Expand All @@ -24,9 +26,9 @@ The checkout script extracts the following GFS components:

| Component | Tag | POC |
| --------- | ----------- | ----------------- |
| MODEL | GFS.v16.3.1 | Jun.Wang@noaa.gov |
| MODEL | GFS.v16.4.0 | Jun.Wang@noaa.gov |
| GLDAS | gldas_gfsv16_release.v.2.1.0 | Helin.Wei@noaa.gov |
| GSI | gfsda.v16.3.20 | Andrew.Collard@noaa.gov |
| GSI | gfsda.v16.3.22 | Andrew.Collard@noaa.gov |
| UFS_UTILS | ops-gfsv16.3.20 | George.Gayno@noaa.gov |
| POST | upp_v8.3.0 | Wen.Meng@noaa.gov |

Expand All @@ -49,146 +51,78 @@ cd ../ecf
VERSION FILE CHANGES
--------------------

* `versions/run.ver` - change `version=v16.3.21` and `gfs_ver=v16.3.21`
* `versions/run.ver` - change `version=v16.4.0` and `gfs_ver=v16.4.0`

SORC CHANGES
------------

The WAFS is no longer a submodule that is checked out within the GFS package.
The `sorc/checkout.sh` and `Externals.cfg` checkout script no longer clone WAFS.
The `sorc/build_all.sh` script no longer builds the WAFS code.
The `sorc/build_gfs_wafs.sh` build script is deleted.
The `sorc/link_fv3gfs.sh` script no longer links/copies WAFS files/execs.
* New MODEL tag: `GFS.v16.4.0`

JOBS CHANGES
------------

All WAFS jobs are removed from the GFS ecFlow definition file, rocoto mesh, and `ush/ecflow/prod.yml`.
Jobs removed:
* `jgfs_atmos_wafs_gcip`
* `jgfs_atmos_wafs_fFFF`
* `jgfs_atmos_wafs_grib2`
* `jgfs_atmos_wafs_grib2_0p25`
* `jgfs_atmos_wafs_blending_0p25`
* No changes from GFS v16.3.22

PARM/CONFIG CHANGES
-------------------

The following config files are deleted:
* `parm/config/config.wafs`
* `parm/config/config.wafsblending`
* `parm/config/config.wafsblending0p25`
* `parm/config/config.wafsgcip`
* `parm/config/config.wafsgrib2`
* `parm/config/config.wafsgrib20p25`

* The `WAFSF` flag is removed from `parm/config/config.base.emc.dyn` and `parm/config/config.base.nco.static`.
* All WAFS jobs are removed from platform env files, `parm/config/config.resources.emc.dyn`, and `parm/config/config.resources.nco.static`.
* The WAFS jobs are removed from experiment setup.

WAFS output is removed from the following transfer list files:
* `parm/product/transfer_gfs_1.list`
* `parm/product/transfer_gfs_7.list`
* No changes from GFS v16.3.22

SCRIPT CHANGES
--------------

The following WAFS rocoto scripts are removed:
* `jobs/rocoto/wafs.sh`
* `jobs/rocoto/wafsblending.sh`
* `jobs/rocoto/wafsblending0p25.sh`
* `jobs/rocoto/wafsgcip.sh`
* `jobs/rocoto/wafsgrib2.sh`
* `jobs/rocoto/wafsgrib20p25.sh`

The following ecf scripts are removed from the GFS:
* `ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_blending.ecf`
* `ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_blending_0p25.ecf`
* `ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2.ecf`
* `ecf/scripts/gfs/atmos/post_processing/grib2_wafs/jgfs_atmos_wafs_grib2_0p25.ecf`
* `ecf/scripts/gfs/atmos/post_processing/grib_wafs/jgfs_atmos_wafs_master.ecf`
* `ecf/scripts/gfs/atmos/post_processing/jgfs_atmos_wafs_gcip.ecf`

The WAFS is removed from `ecf/setup_ecf_links.sh`.

The WAFS output is removed from archival (`ush/hpssarch_gen.sh`).
* WW3-related changes to `scripts/exgfs_wave_post_gridded_sbs.sh` and `scripts/exglobal_forecast.sh`. Grid loop and counter updates. Log files are now checked for completion instead of the associated gridded output.

FIX CHANGES
-----------

* `fix/product/wafs_admin_msg` - removed
* No changes from GFS v16.3.22

MODULE CHANGES
--------------

Modules needed by WAFS are removed from `modulefiles/module_base.wcoss_dell_p3`.
* No changes from GFS v16.3.22

CHANGES TO FILE AND FILE SIZES
------------------------------

The following files will no longer be produced within the GFS COM:
* `gfs.tCCz.awf_0p25.fFFF.grib2` - renamed to `wafs.tCCz.awf.0p25.fFFF.grib2` in WAFSv7
* `gfs.tCCz.awf_grb45fFF.grib2` - renamed to `wafs.tCCz.awf_grid45.fFFF.grib2` in WAFSv7
* `wmo/grib2.tCCz.awf_grbfFF.45` - renamed to `wmo/grib2.wafs.tCCz.awf_grid45.fFFF` in WAFSv7
* `gfs.tCCz.control.wafsblending_0p25`
* `gfs.tCCz.wafs.0p25.anl` - renamed to `wafs.tCCz.0p25.anl.grib2` in WAFSv7
* `gfs.tCCz.wafs.0p25.anl.idx`
* `gfs.tCCz.wafs_0p25.fFFF.grib2`
* `gfs.tCCz.wafs_0p25.fFFF.grib2.idx`
* `gfs.tCCz.wafs_0p25_unblended.fFFF.grib2` - renamed to `WAFS_0p25_unblended_YYYYMMDDHHfFFF.grib2` in WAFSv7
* `gfs.tCCz.wafs_0p25_unblended.fFFF.grib2.idx`
* `gfs.tCCz.wafs.grb2fFFF` - renamed to `wafs.tCCz.master.fFFF.grib2` in WAFSv7
* `gfs.tCCz.wafs.grb2fFFF.idx`
* `gfs.tCCz.wafs_grb45fFF.grib2` - renamed to `gfs.tCCz.wafs_grb45fFFF.grib2` in WAFSv7
* `gfs.tCCz.wafs_grb45fFF.grib2.idx`
* `wmo/grib2.tCCz.wafs_grbfFF.45` - renamed to `wmo/grib2.wafs.tCCz.awf_grid45.fFFF` in WAFSv7
* `wmo/xtrn.wfsgfs0006.gfs_atmos_wafs_f30_00`
* `gfs.tCCz.gcip.fFF.grib2` - renamed to `wafs.tCCz.gcip.fFFF.grib2` in WAFSv7
* `WAFS_0p25_blended_YYYYMMDDHHf[06-48].grib2` - renamed to `WAFS_0p25_blended_ YYYYMMDDHHfFFF.grib2` in WAFSv7

The following files will no longer be produced within the GFS COM
and are being retired from the WAFS package:
* `gfs.tCCz.wafs_icao.grb2fFFF`
* `gfs.tCCz.wafs_icao.grb2fFFF.idx`
* `wafs.tCCz.master.fFFF.grib2` where FFF is from 001 to 005
* No changes from GFS v16.3.22

ENVIRONMENT AND RESOURCE CHANGES
--------------------------------

* Updates to improve the enkfgdas_update job runtime stability.
* Run with `--cpu-bind core` instead of `--cpu-bind depth`
* Change tasks to 280 and threads to 16
* No changes from GFS v16.3.22

PRE-IMPLEMENTATION TESTING REQUIREMENTS
---------------------------------------

* Which production jobs should be tested as part of this implementation?
* None
* All DA and wave jobs
* Does this change require a 30-day evaluation?
* No

DISSEMINATION INFORMATION
-------------------------

* No changes from GFS v16.3.20
* No changes from GFS v16.3.22

HPSS ARCHIVE
------------

* No changes from GFS v16.3.20
* No changes from GFS v16.3.22

JOB DEPENDENCIES AND FLOW DIAGRAM
---------------------------------

* No changes from GFS v16.3.20
* No changes from GFS v16.3.22

DOCUMENTATION
-------------

* No changes from GFS v16.3.20
* No changes from GFS v16.3.22

PREPARED BY
-----------
Kate.Friedman@noaa.gov
Yali.Mao@noaa.gov
Rahul.Mahajan@noaa.gov
Matthew.Masarik@noaa.gov
Jessica.Meixner@noaa.gov
Loading

0 comments on commit 28184a8

Please sign in to comment.