Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix check_group_daterange function in preprocessor.py #555

Closed
wants to merge 8 commits into from
Closed

Fix check_group_daterange function in preprocessor.py #555

Changes from 6 commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
c6f49c6
add start_time and end_time attrs to catalog_builder.py
jtmims Apr 23, 2024
39b819e
Merge branch 'NOAA-GFDL:main' into main
jtmims Apr 23, 2024
b376ffd
Merge branch 'NOAA-GFDL:main' into main
jtmims Apr 26, 2024
ddd7b47
add int to date conversion in check_group_daterange in preprocessor.py
jtmims Apr 26, 2024
58aafd8
add conditional to check for date type
jtmims Apr 26, 2024
92d09b5
point to pd value
jtmims Apr 26, 2024
0aa4f7e
Merge branch 'NOAA-GFDL:main' into main
jtmims Apr 29, 2024
e20a2a9
Merge branch 'NOAA-GFDL:main' into main
jtmims May 13, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions src/preprocessor.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -797,6 +797,17 @@
"""
date_col = "date_range"
try:
if not isinstance(group_df['start_time'].values[0], datetime.date):
# convert int to date type
date_format = ''
date_digits = math.floor(math.log10(group_df['start_time'].values[0]))+1
match date_digits:
case 8:
date_format = '%Y%m%d'
case 14:
date_format = '%Y%m%d%H%M%S'
group_df['start_time'] = pd.to_datetime(group_df['start_time'].values[0], format=date_format)
group_df['end_time'] = pd.to_datetime(group_df['end_time'].values[0], format=date_format)
# method throws ValueError if ranges aren't contiguous
dates_df = group_df.loc[:, ['start_time', 'end_time']]
date_range_vals = []
Expand Down
Loading