Filtering in a large collection #34631
Unanswered
aping
asked this question in
Q&A and General discussion
Replies: 3 comments 6 replies
-
Filtering search on a collection with huge dataset is a normal operation. |
Beta Was this translation helpful? Give feedback.
1 reply
-
might be related with #34442? Did you see any OOM kill signal or it might be a SIGBUS cased by this bug |
Beta Was this translation helpful? Give feedback.
3 replies
-
query nodes get restarted by k8s -> can you verify error message or Signal why milvus killed it self? |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I have a large collection with 9B rows, dim is 768, searching is ok with 3TB of memory with ivf_sq8 and mmap enabled.
there're also ~10 dynamic fields in the collection, question is, is it possible to do searching + filtering with any one of the dynamic fields?
I mean like
I tried but it didn't work, I saw query nodes oom, or restarted by k8s because it failed to respond liveness probe (this is a little bit bizzare, why would it fail liveness probe).
so just wondering, in general is it still possible to filter within a collection of this size?
Beta Was this translation helpful? Give feedback.
All reactions