[Bug]: Querynode oomkilled when concurrent upserting data into 1024 partitions #34058
Open
1 task done
Labels
kind/bug
Issues or changes related a bug
severity/critical
Critical, lead to crash, data missing, wrong result, function totally doesn't work.
triage/accepted
Indicates an issue or PR is ready to be actively worked on.
Milestone
Is there an existing issue for this?
Environment
Current Behavior
deploy milvus with config
test steps
queryNode oomkilled
The qn oomkilled after about two minutes of concurrent requests, around at 2024-06-21 03:40:52
![image](https://private-user-images.githubusercontent.com/27288593/341708632-5e67f1a8-db32-43a5-bdfa-cec865689df5.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTk1OTI1OTcsIm5iZiI6MTcxOTU5MjI5NywicGF0aCI6Ii8yNzI4ODU5My8zNDE3MDg2MzItNWU2N2YxYTgtZGIzMi00M2E1LWJkZmEtY2VjODY1Njg5ZGY1LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA2MjglMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNjI4VDE2MzEzN1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWIyY2I3MzQzNzA0ZTc4NGY3YzY4YmYwZjI3MDhkZmZlZDBmN2E3N2Y3ZGZjMGM5NGY1NjhjYzcxODgwM2VhNzUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.-D6bfLmVjf3UbM-r_F29AIo7h_fGzQR-QjLn12oX3mM)
grafana: metrics of compact-opt-flush3
prroscope: alloc_objects of compact-opt-flush3-milvus-querynode
Expected Behavior
No response
Steps To Reproduce
No response
Milvus Log
Anything else?
No response
The text was updated successfully, but these errors were encountered: