Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: 30s sleep when ISVC is loaded in order to avoid polling treshold #1534

Conversation

FedeAlonso
Copy link
Contributor

We were getting a lot of errors when trying to query a deployed model just a few moments it gets it's "Loaded" value in the activeModelState.
This was happening because there is some 20~30 seconds of delay after deploying the model due to polling.
image

@FedeAlonso FedeAlonso added verified This PR has been tested with Jenkins enhancements Bugfixes, enhancements, refactoring, ... in tests or libraries (PR will be listed in release-notes) labels Jun 14, 2024
Copy link

Quality Gate Passed Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code

See analysis details on SonarCloud

Copy link
Contributor

Robot Results

✅ Passed ❌ Failed ⏭️ Skipped Total Pass %
477 0 0 477 100

@FedeAlonso FedeAlonso merged commit 166bbe8 into red-hat-data-services:master Jun 17, 2024
8 checks passed
FedeAlonso added a commit to FedeAlonso/ods-ci that referenced this pull request Jun 20, 2024
…red-hat-data-services#1534)

fix: add 30s sleep when ISVC is loaded in order to avoid polling treshold
FedeAlonso added a commit that referenced this pull request Jun 21, 2024
* fix: wait for kserve inference host via cli (#1518)

* fix: use activeModelState to wait ISVC status (#1528)

* fix: use activeModelState to wait ISVC status

* delete duplicated code

* fix wrong condition assignment

* make it smarter

* fix lintern error

* fix: wait for Loaded

* fix: 30s sleep when ISVC is loaded in order to avoid polling treshold (#1534)

fix: add 30s sleep when ISVC is loaded in order to avoid polling treshold

* fix: wait pods to be Ready in KServe deployment (#1538)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancements Bugfixes, enhancements, refactoring, ... in tests or libraries (PR will be listed in release-notes) verified This PR has been tested with Jenkins
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants