Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update dependency kfp-server-api to v2.3.0 #294

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

renovate-bot
Copy link
Contributor

@renovate-bot renovate-bot commented Jan 21, 2025

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
kfp-server-api 2.0.5 -> 2.3.0 age adoption passing confidence

Release Notes

kubeflow/pipelines (kfp-server-api)

v2.3.0

Compare Source

Features
  • api: Add new ResourceSpec proto fields to support dynamic values. (#​11075) (83dcf1a)
  • backend: mount EmptyDir volumes for launcher write locations (#​10857) (65839ce)
  • backend: move comp logic to workflow params (#​10979) (0e37fd6)
  • Backend + SDK: Update kfp backend and kubernetes sdk to support EmptyDir (#​10913) (7506a8e)
  • component: internal (383cbcd)
  • component: internal (8041ea8)
  • component: internal (c06d9ae)
  • component: internal (ad03bb6)
  • components: Add role_field_name and model_name as input parameters to llm_evaluation_preprocessor component to support gemini model's input and output schema (de346d5)
  • components: Add Starry Net forecasting pipeline to public preview (3a0566e)
  • components: create infer preprocessor component (e9d6876)
  • components: Create the write_user_defined_error function (454a654)
  • components: create utility class for preprocessors and use it in rlhf preprocessor and infer preprocessor (cd16a33)
  • components: internal (e8f0208)
  • components: internal (6f62203)
  • components: internal (2eb9bec)
  • components: internal (c6f658b)
  • components: internal (e128bdb)
  • components: internal (abe5257)
  • components: internal (522b593)
  • components: internal (461d892)
  • components: release LLM Model Evaluation image version v0.7 (4f36fe3)
  • components: Retry on batch prediction internal errors in AutoSxS (5d9f4ab)
  • components: Support dynamic machine parameters in preview.custom_job.utils.create_custom_training_job_from_component (e44dfa7)
  • components: Support dynamic machine type paramters in CustomTrainingJobOp (#​10883) (b57f9e8)
  • components: Support dynamic values for boot_disk_type, boot_disk_size in preview.custom_job.utils.create_custom_training_job_from_component (7b7918e)
  • components: Support parsing Gemini BP outputs in AutoSxS pipeline (b4f91a3)
  • components: Update Starry Net image tags (bf5104f)
  • components: Use GetModel integration test to manually test write_user_defined_error function (609c637)
  • components: use preprocessor utility methods for the upload model graph (7908ed6)
  • frontend&backend: Add UI support for object store customization and prefixes (#​10787) (6723d3d)
  • GH workflow: migrate periodic functional tests to GH actions (#​10751) (c4d7ec3)
  • internal: Adding proto field to support regional quota (c8f08ba)
  • kubernetes_platform: Add empty dir mount (#​10892) (10aaf43)
  • kubernetes_platform: Update kubernetes_platform go package to include EnabledSharedMemory (#​10703) (7c63599)
Bug Fixes
  • components: add check and add log to call out the fallback to the default model checkpoint and remove the model checkpoint check condition in RLHF GCPC (92c3178)
  • components: Add input param autorater_prompt_parameters to online_evaluation_pairwise component (cf7450b)
  • components: Add staging and temp locations to prophet trainer component (00440f7)
  • components: Fix to model batch explanation component for Structured Data pipelines (289f64f)
  • components: Pass moddel name to eval_runner to process batch prediction's output as per the output schema of model used (0d3e79a)
  • components: Remove unused import function_based from infer pipeline (e369bd3)
  • components: Use instance.target_field_name format for text-bison models only, use target_field_name for gemini models (1a07ffa)
  • docs: add note about protoc dependency and version (#​10895) (d911c8b)
  • docs: IR -> Pipeline Spec (#​11031) (1e95eb6)
  • frontend: fixes filter pipeline text box shows error when typing anything in it. Fixes #​10241 (#​11096) (51d2c92)
  • frontend: reduce list run latency (#​10797) (768ece4)
  • frontend: retrieve archived logs from correct location (#​11010) (2e6e634)
  • sdk: Add required auth scopes to RegistryClient for GCP service accounts credentials (#​10819) (04b4cad)
  • sdk: Kfp support for pip trusted host (#​11151) (3efa029)
  • ui: fixes empty string value in pipeline parameters (#​11175) (e9c77ec)
  • Basic sample tests - sequential is flaky (#​11138) (e1d172b)
  • Incorrect typing in samples/cores/loop_parallism and fixing loop_parameter examples (#​11062) (1612dac)
  • re-enable exit hanler test. (#​11100) (000ef60)
  • kubernetes_platform: fix api-generator docker mount for SELinux (#​10890) (e69078b)
  • manifests: Move metacontroller to the top in kustmization.yaml (#​10669) (4e9fe75)
  • sdk: Throw 'exit_task cannot depend on any other tasks.' error when an ExitHandler has a parameter dependent on other task (#​11005) (08185e7)
Other Pull Requests

v2.2.0

Compare Source

Features
  • backend: add namespace & prefix scoped credentials to kfp-launcher config for object store paths (#​10625) (5e0f9b1)
  • backend: Merge kfp-tekton backend code (#​10678) (60a443e)
  • backend: Upgrade argo to v3.4.16 (#​10568) (809d576)
  • components: Add model name preprocess component; Use publisher model if user uploaded model is non-tuned (084f2c2)
  • components: add resolve_machine_spec and resolve_refined_image_uri to rlhf_preprocessor component (2a8d39e)
  • components: add resolve_reference_model_metadata to rlhf_preprocessor component (92a7969)
  • components: add task_type as a parameter to rlaif (64d288a)
  • components: Added support for text-bison@002 to preview.llm.rlhf_pipeline (2f27751)
  • components: AutoSxS GA pending release (aee464c)
  • components: Expand regions supported by preview.llm.rlhf_pipeline (22a98d9)
  • components: internal (a4f01b7)
  • components: Introduce placeholders: SERVICE_ACCOUNT_PLACEHOLDER, NETWORK_PLACEHOLDER, PERSISTENT_RESOURCE_ID_PLACEHOLDER and ENCYRPTION_SPEC_KMS_KEY_NAME_PLACEHOLDER. In addition, use PERSISTENT_RESOURCE_ID_PLACEHOLDER as the default value of persistent_resource_id for CustomTrainingJobOp and create_custom_training_job_op_from_component. With this change, custom job created without explicitly setting persistent_resource_id will inherit job level persistent_resource_id, if Persistent Resource is set as job level runtime (67d3cd6)
  • components: migrate function_based convert_to_delimited_string to rlhf_preprocessor component (efefe34)
  • components: migrate function_based resolve_num_microbatches to rlhf_preprocessor component (ee28c72)
  • components: migrate function_based resolve_regional_endpoint to rlhf_preprocessor component (f175c71)
  • components: Move AutoSxS pipeline to v1 directory (d919ae7)
  • components: Move ModelImportEvaluationOp component to preview namespace (33db128)
  • components: Report TensorBoard metrics for preview.llm.rlhf_pipeline in real time (3d8069b)
  • components: Use larger base reward model when tuning t5-xxl with the preview.llm.rlhf_pipeline (ff7f660)
  • components: Use larger base reward model when tuning text and chat variants of bison@001 with the preview.llm.rlhf_pipeline (ac39931)
  • components: use rlhf_preprocessor to replace the current value_exists call in rlhf (c967d9f)
  • kubernetes_platform: Update kubernetes_platform go package to include generic ephemerl volume (#​10602) (2fc1492)
  • kubernetes_platform: Update kubernetes_platform go package to include node affinities and pod (anti)affinities (#​10583) (4f8cae2)
  • sdk+backend: Add support for generic ephemeral volume (#​10605) (3fb76a8)
Bug Fixes
  • backend: Update backend common code and integration tests with updated API Service Params (#​10640) (8b2a099)
  • Backend + SDK: Add missing optional field to SecretAsVolume and … (#​10550) (a78dc77)
  • components: Ensure preview.llm.rlhf_pipeline runs if no tensorboard_id is provided (ff0d0a7)
  • components: Fix image version parameter in rl pipelines (cef6e51)
  • components: Fix model eval import error in text generation/classification eval pipeline (7630f85)
  • components: Make AutoSxS autorater_prompt_parameters required (df20088)
  • components: remove default prediction column names in evaluation classification component to fix incorrect column names for bigquery data source (54f2e45)
  • components: Remove the unused functions from function_based (e052dc8)
  • components: Remove the unused generate_default_instruction and resolve_upload_location from function_based (e9d8764)
  • components: Remove the unused resolve_data_paths from function_based (c386913)
  • components: Update service account comment (bf444ac)
  • metadata envoy: upgrade envoy and config from 1.12 to 1.27 (#​10589) (96aaad9)
Other Pull Requests
  • No public description (cab99f7)
  • No public description (79d0a5c)
  • Update loop_output.py example for the new parallel loop type requirement (#​10637) (afddae9)

v2.1.0

Compare Source

Features
  • backend: Enable logging for KFP components (#​10288) (5399585)
  • backend: preserve querystring in pipeline root (fixes #​10318) (#​10319) (9a30612)
  • backend: Upgrade go version to 1.20 (#​10502) (b96b7bc)
  • backend + SDK: Add Backend and SDK support for timeout in pod spec (#​10481) (b734420)
  • backend + SDK: Add backend and SDK support to use Kubernetes FieldPath as env (#​10496) (dd0c17d)
  • Backend + SDK: Update kfp backend and kubernetes sdk to support ConfigMaps as volumes and as env variables (#​10483) (1edd85f)
  • Backend + SDK: Update kfp backend and kubernetes sdk to support ImagePullPolicy (#​10417) (83cabab)
  • Backend + SDK: Update kfp backend and kubernetes sdk to support ImagePullSecrets (#​10427) (1582e0a)
  • Backend + SDK: Update kfp backend and kubernetes sdk to support pod labels and annotations (#​10393) (b3978c1)
  • Backend + SDK: Update kfp backend and kubernetes sdk to support tolerations (#​10471) (2983a7d)
  • component: Migrate AutoSxS pipeline to preview and move related files to _implementation/llm directory to help Model Eval team use side by side metrics as part of their pipeline (3d62d26)
  • components: Add num_microbatches to _implementation.llm training components (685634d)
  • components: Add better docstrings for AutoSxS (9f8495d)
  • components: Add CMEK support to preview.llm.rlhf_pipeline (3dbf3cf)
  • components: Add CMEK support to AutoSxS pipeline (8ccd7a1)
  • components: Add CMEK validation to preview.llm.infer_pipeline (b7ea6e7)
  • components: Add configurable image prefix to llm utility method (544d1fd)
  • components: Add location validation to preview.llm.rlhf_pipeline (361c16f)
  • components: Add RLAIF pipeline to preview (d4c3f35)
  • components: Added experimental args to batch_prediction_pairwise component (f00df96)
  • components: Bump image tag used by preview.llm pipelines (9007fb0)
  • components: change output format to allow possible post eval (44f9992)
  • components: Copy text generation eval and text classification evak pipelines from preview to v1 (6ce3dc5)
  • components: Enable text generation pipeline to generate row based metrics (efeed83)
  • components: Implement new component to preprocess and validate inputs for rlhf (0ece6d0)
  • components: Implement new output format of inference component (4e1491a)
  • components: Implement the feature store grounding pipeline (d73c6db)
  • components: Implement the train time evaluation in reward model training. With the train time eval dataset available, the pipeline outputs the accuracy and cross entropy metrics to the log (731cb81)
  • components: Output errors as a separate table from Arbiter (a66c599)
  • components: Release Forecasting training pipelines to V1 namespace (ab549ef)
  • components: Release Forecasting training pipelines to V1 namespace (1f6ada6)
  • components: Release new LLM Eval image version 0.5 (8c59816)
  • components: support aliases arg in ModelUploadOp (bce8487)
  • components: Support scheduling and labels in utils.build_payload (4bb3423)
  • components: Update _LLM_EVAL_VERSION to v0.6 (1b65da4)
  • components: update eval pipeline documentation to clarify the required pipeline parameters (06ddf94)
  • components: Update LLM Evaluation Pipelines to use text-bison@002 model by default (83cb88f)
  • components: Use a single inference component for AutoSxS (8c7b5b2)
  • kubernetes_platform: Add ActiveDeadlineSeconds(timeout) to the kubernetes platform spec (#​10464) (1fcc681)
  • kubernetes_platform: Add k8s FieldPath as env to the kubernetes_platform (#​10485) (b9ae095)
  • kubernetes_platform: Update kubernetes_platform go package to i… (#​10442) (6fb997a)
  • kubernetes_platform: Update kubernetes_platform go package to include ConfigMaps as volumes and as env variables. (#​10400) (6cc234b)
  • kubernetes_platform: Update kubernetes_platform go package to include imagePullPolicy. (#​10416) (f51dc39)
  • kubernetes_platform: Update kubernetes_platform go package to include ImagePullSecrets (#​10410) (1c9ac5c)
  • kubernetes_platform: Update kubernetes_platform go package to include pod labels and annotations (#​10357) (daa7299)
  • sdk: add DockerRunner #localexecution (#​10328) (adc5b3b)
  • sdk: add local execution logging #localexecution (#​10326) (7849272)
  • sdk: add local execution output collection #localexecution (#​10325) (76aad8b)
  • sdk: add local execution skeleton #localexecution (#​10292) (5cd708d)
  • sdk: add special dsl.OutputPath read logic #localexecution (#​10334) (654bbde)
  • sdk: add subprocess task handler #localexecution (#​10302) (21f8e9c)
  • sdk: remove local execution feature flag #localexecution (#​10355) (8a5a17e)
  • sdk: support Concat and IfPresent placeholder in local container component execution #localexecution (#​10348) (2897a10)
  • sdk: Support dsl.ParallelFor over list of Artifacts (#​10441) (b528568)
  • sdk: support f-strings in local pipeline execution (#​10435) (977bffc)
  • sdk: support local Container Component execution #localexecution (#​10333) (846f887)
  • sdk: support local execution of pipelines in pipelines (#​10440) (1fe1c63)
  • sdk: support local pipeline execution (#​10423) (442d457)
Bug Fixes
  • Modified the swagger json files according to the modified proto files. (#​10591) (cc971c9)
  • backend: correct run field map col names (#​10430) (421d65a)
  • backend: fix timeout for internal server error. Fixes #​10267 (#​10439) (25f4478)
  • backend: fixes "cannot save parameter" error message. Fixes #​9678 (#​10459) (1ae0a82)
  • backend: Fixes response status of http error code when uploading duplicate pipeline [Fixes #​10311] (#​10546) (96eb87c)
  • backend: get pipeline by name is broken due to version typo, Fixes #​9940 (#​10268) (e6ddb0c)
  • backend: MLMD pagination on getting executions of DAG (#​10396) (f65bb0f)
  • components: Add autosxs_pipeline to the all variable for the preview/model_evaluation directory (9f165b6)
  • components: Add relevant component and pipeline inputs/outputs to support creating ModelEvaluations as part of the AutoSxS Metrics component (2abe91e)
  • components: Fix missing pipeline parameters (5c06ab4)
  • components: Only run preview.llm.bulk_inference after tuning third-party models with RLHF (b9e08de)
  • components: Pass tuned model checkpoint to inference pipeline after RLHF tuning (755c1f9)
  • components: Propagate location to sub-components in AutoSxS (624fc04)
  • components: Remove the unused resolve_candidate_columns from function_based (a42ded1)
  • components: rename custom task calibration_score_rubric -> score_rubric (0b1553e)
  • components: Resolve unique model display name on each preview.llm.rlhf_pipeline run instead of reusing cached result (075d58f)
  • components: Return None as sliced feature attribution values for the classes which are not predicted in bp outputs (19a24e3)
  • docs: make full version dropdown show on all KFP SDK docs versions (#​10577) (d3e2de4)
  • Modified the comment/text for pipeline_version_id (#​10581) (0f3d17d)
  • components: Update base image for KFP lightweight component for VPC SC compliance (ddb2f9a)
  • components: Update base image for KFP lightweight component for VPC SC compliance (80c9b04)
  • components: Update text generation pipeline input description (05f69b2)
  • components: Upload the tuned adapter to Model Registry instead of model checkpoint from preview.llm.rlhf_pipeline (2e2ba9e)
  • components: Use large_model_reference as model_reference_name when uploading models from preview.llm.rlhf_pipeline instead of hardcoding value as text-bison@001 (f51a930)
  • components: Use llama-2-7b for the base reward model when tuning llama-2-13 with the preview.llm.rlhf_pipeline (227eab1)
  • components: Use PipelineJob location in AutoSxS components, add init file (449c304)
  • components: Write model resource_name to the output of training pipeline remote runner (0f3f68c)
  • docs: Updated legal info due to migration from CLA to DCO (#​10501) (c0cf4ad)
  • frontend: Add disableParsingRawHTML option for markdown-to-jsx component (#​10315) (c6acac9)
  • kubernetes_platform: Add optional field to SecretAsVolume and ConfigMapAsVolume. Fixes #​10548 (#​10549) (9253c7a)
  • rlhf: Supporting adapter only output for reward model training (066f229)
  • samples: Update resource_spec, retry, secret samples to v2 pipelines (#​9876) (a9a433c)
  • samples: Updated samples/core to V2 (#​9879) (1d96903)
  • sdk: fix bug where dsl.OneOf with multiple consumers cannot be compiled (#​10452) (21c5ffe)
  • sdk: fix presentation of strings in local execution #localexecution (#​10353) (89d4234)
  • sdk: fixes type issues for ParallelFor. Fixes #​9366 (#​10436) (fe04a5a)
  • sdk: permit empty local execution outputs #localexecution (#​10338) (64d46df)
  • sdk: Prevents dsl.ParallelFor over single parameter from compiling. (#​10494) (144761c)
  • sdk: remove redundant newline character in local DockerRunner logs (#​10354) (86b7e23)
  • sdk: use kfp.dsl.types to replace kfp.components.types Fixes #​10282 (#​10283) (b40912c)
Other Pull Requests
2.0.5 (2023-12-08)
Features
Bug Fixes
  • components: Append tune-type label when uploading models tuned by preview.llm.rlhf_pipeline (708b8bd)
Other Pull Requests
2.0.4 (2023-12-01)
Features
  • components: [endpoint_batch_predict] add retry function for retryable error (a54ac75)
  • components: [third party model inference] Initialize component (1e089e6)
  • components: Add ability to tune chat model with preview.llm.rlhf_pipeline (f67cbfa)
  • components: Add chat dataset preprocessor to preview.llm.infer_pipeline (d8f2c14)
  • components: add environment variable support to GCPC's create_custom_training_job_from_component (91f50da)
  • components: add LLM Eval pipeline parameter for customizing eval dataset reference ground truth field (f6aad5e)
  • components: Add tuning dataset support to LLM Eval Text Generation and Text Classification Pipelines. Include new LLM Eval Preprocessor component to both pipelines (b55ed6e)
  • components: Create new eval dataset preprocessor for formatting eval dataset (6cfad2b)
  • components: Edit embedding pipeline to use generic batch predict component to support multilingual embeddings model (397b1c9)
  • components: Enable endpoint_batch_predict component to take in publisher model by either model_address + model_id or just model_id (1f69834)
  • components: Fix batch prediction model parameters payload sanitization error(batch prediction job) (fb4512d)
  • components: Group preview.llm.rlhf_pipeline components for more readability (c23b720)
  • components: Group preview.llm.rlhf_pipeline components for more readability (bcd5922)
  • components: Group preview.llm.rlhf_pipeline components for more readability (a927984)
  • components: Update image tag used by RLHF components (4a5cbbf)
  • sdk: add executor output path and executor input message placeholders (#​10240) (d3323c0)
  • sdk: add local execution config #localexecution (#​10234) (0d7913c)
  • sdk: support .after() referencing task in ParallelFor group (#​10257) (11f60d8)
Bug Fixes
  • backend: Pipeline and PipelineVersion Description column value should be optional. (#​10205) (0948561)
  • components: fix GCPC AutoMLImageTrainingJobRunOp ModuleNotFoundError (9f278f3)
  • frontend: Support running old v1 pipeline. Fix #​10153 (#​10276) (f5cb2d7)
Other Pull Requests
  • feat(components):[text2sql] Integration with first party LLM model inference pipeline (71e5a93)
  • No public description (a8dd311)
  • feat(components):[text2sql] Generate SQL queries by model batch prediction (2910d0b)
2.0.3 (2023-10-27)
Features
  • backend: Support consuming parent DAG input artifact (#​10162) (52f5cf5)
  • backend: Update driver and launcher images (#​10164) (c0093ec)
  • components: [endpoint_batch_predict] Initialize component (0d75611)
  • components: [text2sql] Generate column names by model batch predict (1bee8be)
  • components: [text2sql] Generate table names by model batch prediction (ebb4245)
  • components: [text2sql] Implement preprocess component logic (21079b5)
  • components: [text2sql] Initialize preprocess component and integrate with text2sql pipeline (9aa750e)
  • components: [text2sql] Initialize evaluation component (ea93979)
  • components: [text2sql] Initialize validate and process component (633ddeb)
  • components: Add ability to preprocess chat llama datasets to _implementation.llm.chat_dataset_preprocessor (99fd201)
  • components: Add question_answer support for AutoSxS default instructions (412216f)
  • components: Add sliced evaluation metrics support for custom and unstructured AutoML models in evaluation feature attribution pipeline (d8a0660)
  • components: Add sliced evaluation metrics support for custom and unstructured AutoML models in evaluation pipeline (0487f9a)
  • components: add support for customizing model_parameters in LLM eval text generation and LLM eval text classification pipelines (d53ddda)
  • components: Make model_checkpoint optional for preview.llm.infer_pipeline (e8fb699)
  • components: migrate DataflowFlexTemplateJobOp to GA namespace (now v1.dataflow.DataflowFlexTemplateJobOp) (faba922)
  • components: Set display names for SFT, RLHF and LLM inference pipelines (1386a82)
  • components: Support service account in kubeflow model_batch_predict component (1682ce8)
  • components: Update image tag used by llm pipelines (4d71fda)
  • sdk: support a Pythonic artifact authoring style (#​9932) ([8d00d0e](https://redirect.github.c

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Disabled by config. Please merge this manually once you are satisfied.

Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.


  • If you want to rebase/retry this PR, check this box

This PR was generated by Mend Renovate. View the repository job log.

@renovate-bot renovate-bot changed the title fix(deps): update dependency kfp-server-api to v2.3.0 Update dependency kfp-server-api to v2.3.0 Feb 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant