-
Notifications
You must be signed in to change notification settings - Fork 713
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat: update sort algorithm using loser tree for multi sort merge #15869
base: main
Are you sure you want to change the base?
Conversation
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Is there any performance comparison data of this pr? |
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Not yet, do I need to add an algorithm level benchmark, or just ci-benchmark? |
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
you can pref it in local, eg:
|
Signed-off-by: coldWater <[email protected]>
No noticeable changes. There seems to be a slight improvement from flamegraph, not obvious. It could also be due to the distribution of the data. data setread rows: 25000000 sqlsortselect * from t order by a,b ignore_result; windowSELECT MAX(d) OVER (PARTITION BY a) FROM t ignore_result; |
The codes LGTM. Some comments about this pr: Better add a new setting named Then we can create the |
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
Signed-off-by: coldWater <[email protected]>
src/query/pipeline/transforms/src/processors/transforms/sort/rows/simple.rs
Show resolved
Hide resolved
Signed-off-by: coldWater <[email protected]>
I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/
Summary
Fixes #11604
Tests
Type of change
This change is![Reviewable](https://camo.githubusercontent.com/23b05f5fb48215c989e92cc44cf6512512d083132bd3daf689867c8d9d386888/68747470733a2f2f72657669657761626c652e696f2f7265766965775f627574746f6e2e737667)