Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhance: Remove useless ops when there is no write #34767

Merged

Conversation

congqixia
Copy link
Contributor

Related to #33235

THe querynode pipeline will make map & call ProcessInsert when there is no write messages. So querynodes will have high CPU usage even when there is no workload.

This PR check msg length before composing data struct and calling method

Related to milvus-io#33235

THe querynode pipeline will make map & call ProcessInsert when there is
no write messages. So querynodes will have high CPU usage even when
there is no workload.

This PR check msg length before composing data struct and calling method

Signed-off-by: Congqi Xia <[email protected]>
@sre-ci-robot sre-ci-robot added the size/M Denotes a PR that changes 30-99 lines. label Jul 17, 2024
@sre-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@mergify mergify bot added dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement ci-passed labels Jul 17, 2024
Copy link

codecov bot commented Jul 19, 2024

Codecov Report

Attention: Patch coverage is 81.25000% with 3 lines in your changes missing coverage. Please review.

Project coverage is 84.39%. Comparing base (17c96e1) to head (9639963).
Report is 16 commits behind head on master.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #34767      +/-   ##
==========================================
+ Coverage   80.76%   84.39%   +3.62%     
==========================================
  Files        1161      891     -270     
  Lines      141018   116823   -24195     
==========================================
- Hits       113898    98588   -15310     
+ Misses      22755    13856    -8899     
- Partials     4365     4379      +14     
Files Coverage Δ
internal/querynodev2/pipeline/delete_node.go 94.44% <100.00%> (ø)
internal/querynodev2/pipeline/insert_node.go 83.60% <75.00%> (+0.27%) ⬆️

... and 292 files with indirect coverage changes

@aoiasd
Copy link
Contributor

aoiasd commented Jul 19, 2024

/lgtm

@sre-ci-robot sre-ci-robot merged commit 2ac7164 into milvus-io:master Jul 19, 2024
11 of 12 checks passed
congqixia added a commit to congqixia/milvus that referenced this pull request Jul 19, 2024
Related to milvus-io#33235

THe querynode pipeline will make map & call ProcessInsert when there is
no write messages. So querynodes will have high CPU usage even when
there is no workload.

This PR check msg length before composing data struct and calling method

Signed-off-by: Congqi Xia <[email protected]>
congqixia added a commit to congqixia/milvus that referenced this pull request Jul 19, 2024
Related to milvus-io#33235

THe querynode pipeline will make map & call ProcessInsert when there is
no write messages. So querynodes will have high CPU usage even when
there is no workload.

This PR check msg length before composing data struct and calling method

Signed-off-by: Congqi Xia <[email protected]>
congqixia added a commit to congqixia/milvus that referenced this pull request Jul 19, 2024
Related to milvus-io#33235

THe querynode pipeline will make map & call ProcessInsert when there is
no write messages. So querynodes will have high CPU usage even when
there is no workload.

This PR check msg length before composing data struct and calling method

Signed-off-by: Congqi Xia <[email protected]>
sre-ci-robot pushed a commit that referenced this pull request Jul 22, 2024
…4839)

Cherry pick from master
pr: #34767
Related to: #33235

THe querynode pipeline will make map & call ProcessInsert when there is
no write messages. So querynodes will have high CPU usage even when
there is no workload.

This PR check msg length before composing data struct and calling method

Signed-off-by: Congqi Xia <[email protected]>
@congqixia congqixia deleted the enhance/avoid_useless_ops_nowrite branch July 22, 2024 07:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved ci-passed dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement lgtm size/M Denotes a PR that changes 30-99 lines.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants