Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhance: Add force trigger #30641

Merged
merged 1 commit into from
Feb 19, 2024

Conversation

XuanYang-cn
Copy link
Contributor

@XuanYang-cn XuanYang-cn commented Feb 18, 2024

  1. Increase maxCount of L0 compaction tasks to 30

This could reduce the l0 compaction task number by 30% for high-frequently-generated-small l0 segments, with the maximum size 64MB stay not changed. So that l0 segments would accumulate slower and decrease the mem presure caused by L0 segment for QueryNode

  1. Add force Trigger for later manual timely l0 compaction triggers.

See also: #30191, #30556

1. Increase maxCount of L0 compaction tasks to 30

This could reduce the l0 compaction task number by 30% for
high-frequently-generated-small l0 segments, with the maximum size 64MB stay not changed.
So that l0 segments would accumulate slower and decrease the mem presure
caused by L0 segment for QueryNode

2. Add force Trigger for later manual timely l0 compaction triggers.

See also: milvus-io#30191

Signed-off-by: yangxuan <xuan.yang@zilliz.com>
@sre-ci-robot sre-ci-robot added the size/L Denotes a PR that changes 100-499 lines. label Feb 18, 2024
@mergify mergify bot added dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement labels Feb 18, 2024
Copy link

codecov bot commented Feb 18, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Comparison is base (99297ab) 80.26% compared to head (1051409) 80.27%.
Report is 3 commits behind head on master.

Additional details and impacted files

Impacted file tree graph

@@           Coverage Diff           @@
##           master   #30641   +/-   ##
=======================================
  Coverage   80.26%   80.27%           
=======================================
  Files         966      966           
  Lines      136745   136748    +3     
=======================================
+ Hits       109765   109778   +13     
+ Misses      23253    23244    -9     
+ Partials     3727     3726    -1     
Files Coverage Δ
internal/datacoord/compaction_l0_view.go 89.69% <100.00%> (+0.32%) ⬆️
pkg/util/paramtable/component_param.go 98.31% <100.00%> (ø)

... and 14 files with indirect coverage changes

@mergify mergify bot added the ci-passed label Feb 18, 2024
Copy link
Contributor

@congqixia congqixia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@sre-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, XuanYang-cn

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@sre-ci-robot sre-ci-robot merged commit 44d436d into milvus-io:master Feb 19, 2024
14 checks passed
@XuanYang-cn XuanYang-cn deleted the enhance-l0-trigger branch February 21, 2024 02:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved ci-passed dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement lgtm size/L Denotes a PR that changes 100-499 lines.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants