Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Establish global support files under role.glopara on Gaea (C5 & C6) #3133

Open
5 of 10 tasks
KateFriedman-NOAA opened this issue Dec 2, 2024 · 2 comments
Open
5 of 10 tasks
Assignees

Comments

@KateFriedman-NOAA
Copy link
Member

KateFriedman-NOAA commented Dec 2, 2024

What new functionality do you need?

To support global users on Gaea C5 & C6, the role.glopara account space needs to be established and populated with files (e.g. fix, ICs, etc.).

FYI @DavidBurrows-NCO

What are the requirements for the new functionality?

CI tests on Gaea C5 and C6 can complete successfully using the role.glopara staged data.

Acceptance Criteria

  • fix (C5)
  • fix (C6)
  • data (C5)
  • data (C6)
  • com (C5)
  • com (C6)
  • git (C5)
  • git (C6)
  • GDA (C5)
  • GDA (C6)

Suggest a solution (optional)

No response

@KateFriedman-NOAA KateFriedman-NOAA added the feature New feature or request label Dec 2, 2024
@KateFriedman-NOAA KateFriedman-NOAA self-assigned this Dec 2, 2024
@KateFriedman-NOAA
Copy link
Member Author

No allocation for nggps_emc project on Gaea C6, unable to establish role.glopara on C6 at the moment. Will work with management to obtain allocation.

Setup of role.glopara under /gpfs/f5/nggps_emc/ is in progress.

@KateFriedman-NOAA KateFriedman-NOAA changed the title Establish global support files on Gaea (C5 & C6) Establish global support files under role.glopara on Gaea (C5 & C6) Jan 27, 2025
@KateFriedman-NOAA KateFriedman-NOAA added the blocked Issue is currently being blocked by another issue label Jan 28, 2025
@KateFriedman-NOAA KateFriedman-NOAA removed the blocked Issue is currently being blocked by another issue label Feb 13, 2025
@KateFriedman-NOAA
Copy link
Member Author

The role.glopara account on Gaea now has allocation for C6. Will now proceed with establishing the staged data under role.glopara on C6.

@WalterKolczynski-NOAA WalterKolczynski-NOAA removed the feature New feature or request label Feb 24, 2025
KateFriedman-NOAA pushed a commit that referenced this issue Mar 3, 2025
Add support for the Gaea clusters by enabling cycled experiments
on C6 and addressing a number of issues on both clusters.

Also included is support for HPSS on C6, but it should NOT be
utilized at this time. The ES cluster, where HPSS connections are made,
has a significant issue with the F6 (C6's filesystem) mount that causes
the system to run extremely slow when filesystem-intense operations are
performed (such as htar). There is a plan to enable this feature more
broadly in the near future.

Included changes:
- Fixed memory variable unsetting for Gaea C5/6 in config.resources.GAEAC{5,6}
- Refactoring the system-level parameter detection when determining task
resources in the setup scripts to make it easier to define multiple
partitions, queues, and clusters.
- Adding a `DTN` partition, queue, and cluster definition.
- Added/renamed missing/miss-named tasks to tasks.py and added a check
that the input task is valid.

Refs #2905
Refs #3108
Refs #3133 
Refs #3261
Refs #3269 
Refs #3324
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants