JEDI-based ensemble recentering and analysis calculation #3312
Conversation
DavidHuber-NOAA
removed
the
CI-Hera-Running
|
@aerorahul All comments addressed. I can't test the staging of the zero-valued warm-start native-grid increments which I made until they are staged in /scratch1/NCEPDEV/global/glopara/data/ICSDIR/ |
|
I don't have access to /scratch1/NCEPDEV/global/glopara/data/ICSDIR/, but I do have zeroed native-grid increments created for each resolution at /scratch1/NCEPDEV/da/David.New/zeroinc/C* |
|
Thanks @DavidNew-NOAA |
|
@aerorahul @KateFriedman-NOAA The path I gave you is pretty general, and I don't know how many places we want to put these zero increments yet. The only JEDI atmos CI case is |
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
|
I've addressed some some reviewer comments in the companion PRs (soon to merge) to this one, so I'll need to retest C96C48_ufs_hybatmDA |
|
@DavidNew-NOAA I'm working to copy in the zero increment files into the ICSDIR folders on Hera. So far I have done this: See those files here: I'm a bit confused about this part of the request: I see these C48 files: If I copy those in, change the |
|
WCOSS2 g-w CI Install The C96C48_ufs_hybatmDA failure is due to Expected initial condition files are not on WCOSS2. This may be related to @KateFriedman-NOAA's comment above The C96C48_hybatmaerosnowDA failure occurs when While the gdas_aeroanlinit job log file contains Does Currently, |
|
@KateFriedman-NOAA Disregard my comment about renaming. I renamed them myself. |
|
@RussTreadon-NOAA Hold off on testing JEDI as I have some more commits to push. I will take a look at the aero case this afternoon. |
@DavidNew-NOAA Ok, which files would you like me to pull in for C48 then? Are the C96 files that I pulled ok or do they need adjusting? Thanks! |
|
@KateFriedman-NOAA What you've copied allows us to run the JEDI atmos CI case, so no need for further action. Thanks! |
@DavidNew-NOAA Excellent, thanks for confirming! I have now synced the new C96 ICs to WCOSS2, MSU, and Gaea C5+C6. If you have more IC files in the future please open a Static Data Update issue and I'll take care of it. Thanks! |
Description
COORDINATED MERGE
This PR implements ensemble recentering and analysis calculation in the Global Workflow, using JEDI-based applications to replace certain GSI utilities when JEDI is turned on in the workflow. If using GSI, then the workflow will remain unchanged. This PR also (finally) implements native-grid DA increments into the worflow.
The
gdas_analcalcandenkfgdas_ecenjobs will be replaced bygdas_analcalc_fv3jediandenkfgdas_ecen_fv3jedijobs respectively. Theenkfgdas_echgresjob is eliminated, since changing of resolution of the deterministic backgrounds is done internally in the JEDI-based recentering application.The design for this PR is based on discussions between the DA team and GW team a few months ago. Explanation of the flow of data through the workflow:
The
gdas_analcalc_fv3jedijob dependencies do not change. The native-grid backgrounds andincrements are staged, and then the GDASApp JEDIfv3jedi_add_incrementsapplication is run to add them and interpolate to the Gaussian grid. The Gaussian-grid backgrounds are also staged, and then a simple Python function inserts to these analysis variables into the histories, which become the Gaussian analyses. This is done this way to guarantee that the resulting Gaussian analyses are in the exact format required by UPP.The
enkfgdas_ecen_fv3jedino longer depends on the analysis calc job, since the ensemble-resolution variational analysis is computed/interpolated internally in the JEDI-based recentering application. All other job dependencies remain the same. We no longer need to compute the ensemble mean analysis in this job, since it can be outputted the the JEDI local ensemble DA application in theenkfgdas_atmensanlsoljob and just staged for recentering. The variational increment and deterministic backgrounds are also staged to compute the ensemble-resolution variational analysis. The output of this job is no longer the recentered ensemble increments, but rather the "correction increment", which when added to ensemble increments becomes the recentered increments. The prefix for the "correction increment" iscatminc.The
enkfgdas_fcstjob now stages both the ensemble increments and the correction increment. They are added together withncboinforecast_postdet.shto generate the recentered increment.All forecast increments, both deterministic and ensemble, are now on the native cubed-sphere grid
Resolves #3248
Type of change
Change characteristics
How has this been tested?
Checklist