Skip to content

Add new conditions to Playground #120

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Sep 4, 2024

Conversation

kerthcet
Copy link
Member

@kerthcet kerthcet commented Sep 3, 2024

What this PR does / why we need it

For better observation and higher test coverage.

Which issue(s) this PR fixes

Fixes #117 #113

Special notes for your reviewer

Does this PR introduce a user-facing change?

Once models haven't been created, `AbortProcessing` for model creation condition is emitted

@InftyAI-Agent InftyAI-Agent added needs-triage Indicates an issue or PR lacks a label and requires one. needs-priority Indicates a PR lacks a label and requires one. do-not-merge/needs-kind Indicates a PR lacks a label and requires one. labels Sep 3, 2024
@kerthcet kerthcet force-pushed the cleanup/add-conditions branch from ef070d6 to 6e9b3a8 Compare September 3, 2024 07:55
Signed-off-by: kerthcet <kerthcet@gmail.com>
@kerthcet kerthcet force-pushed the cleanup/add-conditions branch from 6e9b3a8 to 2269c16 Compare September 3, 2024 08:12
@kerthcet
Copy link
Member Author

kerthcet commented Sep 3, 2024

/kind cleanup
/approve

leave LGTM to @carlory

@InftyAI-Agent InftyAI-Agent added cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. approved Indicates a PR has been approved by an approver from all required OWNERS files. and removed do-not-merge/needs-kind Indicates a PR lacks a label and requires one. labels Sep 3, 2024

// Set the available to false
new_condition := metav1.Condition{
Type: inferenceapi.PlaygroundAvailable,
Status: metav1.ConditionFalse,
Reason: "PlaygroundNotReady",
Copy link
Contributor

@carlory carlory Sep 4, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PlaygroundAvailable=false implies the reason, so ServiceNotAvailable maybe better?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added the details to the message: Waiting for inference Service ready.

validation.ValidatePlayground(ctx, k8sClient, playground)
validation.ValidatePlaygroundStatusEqualTo(ctx, k8sClient, playground, inferenceapi.PlaygroundProgressing, "Pending", metav1.ConditionTrue)
},
},
{
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure whether the test in playground should update the service instead, I know that the service status will be updated via the lws by service controller.

The current intergation setup all controllers. It may be unreasonable. One side effect is that updating the service is impossible because the service status will be updated by the service controller. we have to update the lws object.

In kubernetes, the intergation tests for a given controller, other controllers will not be enabled.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well, Playground integrates with Service closely, where I believe integration tests should join here. In Kubernetes, different controllers didn't work with each other, so there's no need to put them together.

Signed-off-by: kerthcet <kerthcet@gmail.com>
Copy link
Member Author

@kerthcet kerthcet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

PTAL


// Set the available to false
new_condition := metav1.Condition{
Type: inferenceapi.PlaygroundAvailable,
Status: metav1.ConditionFalse,
Reason: "PlaygroundNotReady",
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added the details to the message: Waiting for inference Service ready.

validation.ValidatePlayground(ctx, k8sClient, playground)
validation.ValidatePlaygroundStatusEqualTo(ctx, k8sClient, playground, inferenceapi.PlaygroundProgressing, "Pending", metav1.ConditionTrue)
},
},
{
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well, Playground integrates with Service closely, where I believe integration tests should join here. In Kubernetes, different controllers didn't work with each other, so there's no need to put them together.

@carlory
Copy link
Contributor

carlory commented Sep 4, 2024

/lgtm

@InftyAI-Agent InftyAI-Agent added the lgtm Looks good to me, indicates that a PR is ready to be merged. label Sep 4, 2024
@InftyAI-Agent InftyAI-Agent merged commit e346d3f into InftyAI:main Sep 4, 2024
14 checks passed
@kerthcet kerthcet deleted the cleanup/add-conditions branch September 4, 2024 07:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. lgtm Looks good to me, indicates that a PR is ready to be merged. needs-priority Indicates a PR lacks a label and requires one. needs-triage Indicates an issue or PR lacks a label and requires one.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add new status once models haven't been created
3 participants