Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[core] Add BLOB_STREAM property to compile model from stream #29354

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[core] Add BLOB_STREAM property to compile model from stream #29354

wants to merge 1 commit into from
+391 −32

Conversation

praasz
Copy link
Contributor

@praasz praasz commented Mar 9, 2025

Details:

  • Add BLOB_STREAM property to pass model stream in configuration
  • If model stream passed as property it can be regular or weightless model.
  • For weightless model the property WEIGHTS_PATH is hint where find the model's weights
  • If model found in cache then weight path will read from compiled options or from property WEIGHTS_PATH hint.
  • If model compile from stream fail the fallback path is selected.

Tickets:

@praasz
Add blob stream property to compile model from blob stream
cd41146 
Signed-off-by: Raasz, Pawel <pawel.raasz@intel.com>
@praasz praasz requested review from a team as code owners March 9, 2025 20:05
@github-actions github-actions bot added category: inference OpenVINO Runtime library - Inference category: TEMPLATE OpenVINO Template plugin category: CPP API OpenVINO CPP API bindings labels Mar 9, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
category: CPP API OpenVINO CPP API bindings category: inference OpenVINO Runtime library - Inference category: TEMPLATE OpenVINO Template plugin
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@praasz