fix: Trigger l0 compaction when l0 views don't change

[XuanYang-cn]

Trigger l0 compaction when l0 views don't change

So that leftover l0 segments would be compacted in the end.

1. Refresh LevelZero plans in comactionPlanHandler, remove the meta dependency
   of compaction trigger v2
2. Add ForceTrigger method for CompactionView interface
3. rename mu to taskGuard
4. Add a new TriggerTypeLevelZeroViewIDLE
5. Add an idleTicker for compaction view manager

See also: #30098, #30556

Signed-off-by: yangxuan xuan.yang@zilliz.com

[mergify]

@XuanYang-cn

Invalid PR Title Format Detected

Your PR submission does not adhere to our required standards. To ensure clarity and consistency, please meet the following criteria:

1. Title Format: The PR title must begin with one of these prefixes:

• feat: for introducing a new feature.
• fix: for bug fixes.
• enhance: for improvements to existing functionality.
• test: for add tests to existing functionality.
• doc: for modifying documentation.
• auto: for the pull request from bot.

2. Description Requirement: The PR must include a non-empty description, detailing the changes and their impact.

Required Title Structure:

[Type]: [Description of the PR]

Where Type is one of feat, fix, enhance, test or doc.

Example:

enhance: improve search performance significantly 

Please review and update your PR to comply with these guidelines.

[mergify]

@XuanYang-cn ut workflow job failed, comment rerun ut can trigger the job again.

[codecov]

Codecov Report

Attention: Patch coverage is 96.68874% with 5 lines in your changes are missing coverage. Please review.

Project coverage is 80.42%. Comparing base (57397b1) to head (bccd65e).
Report is 80 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master   #30729      +/-   ##
==========================================
- Coverage   80.69%   80.42%   -0.27%     
==========================================
  Files         952      962      +10     
  Lines      137065   137087      +22     
==========================================
- Hits       110598   110251     -347     
- Misses      22745    23111     +366     
- Partials     3722     3725       +3     

Files	Coverage Δ
internal/datacoord/compaction.go	78.19% <100.00%> (+0.41%)	⬆️
internal/datacoord/compaction_scheduler.go	94.44% <100.00%> (ø)
internal/datacoord/compaction_view.go	78.30% <ø> (ø)
internal/datacoord/server.go	71.18% <100.00%> (ø)
internal/datacoord/compaction_l0_view.go	90.09% <92.85%> (+0.39%)	⬆️
internal/datacoord/compaction_view_manager.go	96.79% <98.50%> (+8.72%)	⬆️
internal/datacoord/compaction_trigger_v2.go	89.77% <93.18%> (+3.85%)	⬆️

... and 219 files with indirect coverage changes

[mergify]

@XuanYang-cn E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@XuanYang-cn E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[XuanYang-cn]

/run-cpu-e2e

[mergify]

@XuanYang-cn E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@XuanYang-cn E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[XuanYang-cn]

/run-cpu-e2e

[mergify]

@XuanYang-cn E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[congqixia]

/lgtm

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, XuanYang-cn

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• internal/datacoord/OWNERS [congqixia]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment