Run integration tests against deployment

[soapy1]

Reference Issues or PRs

#2855

What does this implement/fix?

This PR updates the integration tests to support running against an existing cluster. You can do this by providing the --existing-deployment flag (opposed to the --cloud flag) when running the integration tests. --existing-deployment gets a path to an existing nebari config dir (must contain the nebari-config.yaml and the output dir /stages). For example see How to test this PR?

Also adds these tests to the Local Integration Tests GHA workflow.

Put a x in the boxes that apply

• Bug fix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds a feature)
• Breaking change (fix or feature that would cause existing features not to work as expected)
• Documentation Update
• Code style update (formatting, renaming)
• Refactoring (no functional changes, no API changes)
• Build related changes
• Other (please describe):

Testing

• Did you test the pull request locally?
• Did you add new tests?

How to test this PR?

Create a local deploy of nebari and then run the integration tests.

$ mkdir nebari-local
$ nebari init ....
$ nebari deploy ....
$ cd ./tests/tests_integration
$  pytest -vvv -s --existing-deployment=../../nebari-local .

[marcelovilla]

@soapy1 I know this is still a draft PR, but I wanted to check if you’re planning to address #2950. If so, it might be a good opportunity to offload as much cloud deployment logic as possible from pytest.

Let me know what you think!

[soapy1]

@marcelovilla yep, definitely can do. Just to clarify, you mean like update the ci workflows (eg. test_azure_integration.yaml) to use the change proposed by this PR?

[marcelovilla]

@soapy1 I was actually referring to the --cloud flag and the deployment fixtures, which will no longer be needed once we address #2950 (which seems to overlap with—or potentially duplicate—#2855). That said, we don’t need to remove them in this PR. I just wanted to bring it up in case it impacts your approach, especially if working around them requires extra effort when they might not exist in the future.

Regarding the use of the changes proposed in this PR for CI workflows in cloud integration tests, ideally, it would be great to have both local and cloud integration tests behave consistently, with the only difference being the deployment/destroy process. In other words, it would be beneficial if our tests could run against any Nebari cluster, regardless of how it was deployed. I’m not sure whether incorporating the changes from this PR into those CI workflows is the best approach or if we’d be better off having a separate workflow that allows running tests against any deployment. That is beyond the scope of this PR, but maybe it's worthwhile to keep it mind for the future.

Let me know if this makes sense!