Skip to content

Commit c52d014

Browse files
emilyhcliuEmily LiuEmily Liu
authored
Add components for converting satwnd amv goes data from bufr dump to ioda. (#13)
Add components for converting satwnd amv goes data from bufr dump to ioda. dump/mapping - bufr2ioda mapping file - bufr2ioda Python converter dump/config - IODA configuration test YAML for script backend - IODA configuration test YAML for bufr backend /ush/test - bufr2ioda.sh - README.md Notes: The test shell script (bufr2ioda.sh) can test the following for each obs type: - bufr2netcdf ---> convert bufr to NetCDF IODA format using bufr-query with mapping file - script2netcdf ---> convert bufr to NetCDF IODA format using bufr-query with mapping file and python interface - bufr_backend ---> convert bufr to IODA in IODA backend with mapping file - script_backend ---> convert bufr to IODA in IODA backend with mapping file and Python script --------- Co-authored-by: Emily Liu <eliu@hercules-login-2.hpc.msstate.edu> Co-authored-by: Emily Liu <eliu@hercules-login-3.hpc.msstate.edu>
1 parent 70ed86d commit c52d014

7 files changed

+978
-0
lines changed

‎dump/config/bufr2ioda_script_backend_satwnd_amv_goes.yaml

+58
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,58 @@
1+
time window:
2+
begin: "2018-04-14T21:00:00Z"
3+
end: "2023-12-15T03:00:00Z"
4+
5+
observations:
6+
- obs space:
7+
name: "satwind_goes-16"
8+
observed variables: [windSpeed, windDirection]
9+
derived variables: [windEastward, windNorthward]
10+
simulated variables: [windEastward, windNorthward]
11+
obsdatain:
12+
engine:
13+
type: script
14+
script file: "bufr2ioda_satwnd_amv_goes.py"
15+
args:
16+
input_path: "./testinput/2021080100/gdas.t00z.satwnd.tm00.bufr_d"
17+
mapping_path: "./bufr2ioda_satwnd_amv_goes_mapping.yaml"
18+
category: "goes-16"
19+
obsdataout:
20+
engine:
21+
type: H5File
22+
obsfile: "./testoutput/2021080100/script_backend/gdas.t00z.satwnd.abi_goes-16.tm00.nc"
23+
24+
- obs space:
25+
name: "satwind_goes-17"
26+
observed variables: [windSpeed, windDirection]
27+
derived variables: [windEastward, windNorthward]
28+
simulated variables: [windEastward, windNorthward]
29+
obsdatain:
30+
engine:
31+
type: script
32+
script file: "bufr2ioda_satwnd_amv_goes.py"
33+
args:
34+
input_path: "./testinput/2021080100/gdas.t00z.satwnd.tm00.bufr_d"
35+
mapping_path: "./bufr2ioda_satwnd_amv_goes_mapping.yaml"
36+
category: "goes-17"
37+
obsdataout:
38+
engine:
39+
type: H5File
40+
obsfile: "./testoutput/2021080100/script_backend/gdas.t00z.satwnd.abi_goes-17.tm00.nc"
41+
42+
- obs space:
43+
name: "satwind_goes-18"
44+
observed variables: [windSpeed, windDirection]
45+
derived variables: [windEastward, windNorthward]
46+
simulated variables: [windEastward, windNorthward]
47+
obsdatain:
48+
engine:
49+
type: script
50+
script file: "bufr2ioda_satwnd_amv_goes.py"
51+
args:
52+
input_path: "./testinput/2021080100/gdas.t00z.satwnd.tm00.bufr_d"
53+
mapping_path: "./bufr2ioda_satwnd_amv_goes_mapping.yaml"
54+
category: "goes-18"
55+
obsdataout:
56+
engine:
57+
type: H5File
58+
obsfile: "./testoutput/2021080100/script_backend/gdas.t00z.satwnd.abi_goes-18.tm00.nc"

‎dump/config/bufr_bufr_backend_satwnd_amv_goes.yaml

+58
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,58 @@
1+
time window:
2+
begin: "2018-04-14T21:00:00Z"
3+
end: "2023-12-15T03:00:00Z"
4+
5+
observations:
6+
- obs space:
7+
name: "satwind_goes-16"
8+
simulated variables: [windDirection, windSpeed]
9+
obsdatain:
10+
engine:
11+
type: bufr
12+
obsfile: "./testinput/2021080100/gdas.t00z.satwnd.tm00.bufr_d"
13+
mapping file: "./bufr_satwnd_amv_goes_mapping.yaml"
14+
category: ["goes-16"]
15+
cache categories: # optional
16+
- ["goes-16"]
17+
- ["goes-17"]
18+
- ["goes-18"]
19+
obsdataout:
20+
engine:
21+
type: H5File
22+
obsfile: "./testoutput/2021080100/bufr_backend/gdas.t00z.satwnd.abi_goes-16.tm00.nc"
23+
24+
- obs space:
25+
name: "satwind_goes-17"
26+
simulated variables: [windDirection, windSpeed]
27+
obsdatain:
28+
engine:
29+
type: bufr
30+
obsfile: "./testinput/2021080100/gdas.t00z.satwnd.tm00.bufr_d"
31+
mapping file: "./bufr_satwnd_amv_goes_mapping.yaml"
32+
category: ["goes-17"]
33+
cache categories: # optional
34+
- ["goes-16"]
35+
- ["goes-17"]
36+
- ["goes-18"]
37+
obsdataout:
38+
engine:
39+
type: H5File
40+
obsfile: "./testoutput/2021080100/bufr_backend/gdas.t00z.satwnd.abi_goes-17.tm00.nc"
41+
42+
- obs space:
43+
name: "satwind_goes-18"
44+
simulated variables: [windDirection, windSpeed]
45+
obsdatain:
46+
engine:
47+
type: bufr
48+
obsfile: "./testinput/2021080100/gdas.t00z.satwnd.tm00.bufr_d"
49+
mapping file: "./bufr_satwnd_amv_goes_mapping.yaml"
50+
category: ["goes-18"]
51+
cache categories: # optional
52+
- ["goes-16"]
53+
- ["goes-17"]
54+
- ["goes-18"]
55+
obsdataout:
56+
engine:
57+
type: H5File
58+
obsfile: "./testoutput/2021080100/bufr_backend/gdas.t00z.satwnd.abi_goes-18.tm00.nc"

‎dump/config/bufr_script_backend_satwnd_amv_goes.yaml

+58
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,58 @@
1+
time window:
2+
begin: "2018-04-14T21:00:00Z"
3+
end: "2023-12-15T03:00:00Z"
4+
5+
observations:
6+
- obs space:
7+
name: "satwind_goes-16"
8+
observed variables: [windSpeed, windDirection]
9+
derived variables: [windEastward, windNorthward]
10+
simulated variables: [windEastward, windNorthward]
11+
obsdatain:
12+
engine:
13+
type: script
14+
script file: "bufr_satwnd_amv_goes.py"
15+
args:
16+
input_path: "./testinput/2021080100/gdas.t00z.satwnd.tm00.bufr_d"
17+
mapping_path: "./bufr_satwnd_amv_goes_mapping.yaml"
18+
category: "goes-16"
19+
obsdataout:
20+
engine:
21+
type: H5File
22+
obsfile: "./testoutput/2021080100/script_backend/gdas.t00z.satwnd.abi_goes-16.tm00.nc"
23+
24+
- obs space:
25+
name: "satwind_goes-17"
26+
observed variables: [windSpeed, windDirection]
27+
derived variables: [windEastward, windNorthward]
28+
simulated variables: [windEastward, windNorthward]
29+
obsdatain:
30+
engine:
31+
type: script
32+
script file: "bufr_satwnd_amv_goes.py"
33+
args:
34+
input_path: "./testinput/2021080100/gdas.t00z.satwnd.tm00.bufr_d"
35+
mapping_path: "./bufr_satwnd_amv_goes_mapping.yaml"
36+
category: "goes-17"
37+
obsdataout:
38+
engine:
39+
type: H5File
40+
obsfile: "./testoutput/2021080100/script_backend/gdas.t00z.satwnd.abi_goes-17.tm00.nc"
41+
42+
- obs space:
43+
name: "satwind_goes-18"
44+
observed variables: [windSpeed, windDirection]
45+
derived variables: [windEastward, windNorthward]
46+
simulated variables: [windEastward, windNorthward]
47+
obsdatain:
48+
engine:
49+
type: script
50+
script file: "bufr_satwnd_amv_goes.py"
51+
args:
52+
input_path: "./testinput/2021080100/gdas.t00z.satwnd.tm00.bufr_d"
53+
mapping_path: "./bufr_satwnd_amv_goes_mapping.yaml"
54+
category: "goes-18"
55+
obsdataout:
56+
engine:
57+
type: H5File
58+
obsfile: "./testoutput/2021080100/script_backend/gdas.t00z.satwnd.abi_goes-18.tm00.nc"

0 commit comments

Comments
 (0)