Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][Resource Manager][Zeta] add tag to worker, when submit job can use tag to choose worker #7036

Closed
3 tasks done
liunaijie opened this issue Jun 21, 2024 · 1 comment · Fixed by #7045
Closed
3 tasks done
Assignees

Comments

@liunaijie
Copy link
Contributor

liunaijie commented Jun 21, 2024

Search before asking

  • I had searched in the feature and found no similar feature requirement.

Description

Now, we don't have the resource manager on queue level. like yarn queue. when submit job we will send job to all worker if avaliable.

I check the code, find we can add some tag to hazelcast node, then when we assign task, we can use this tag to choose node.

Here are some code need to update:
1.SeaTunnelServer then create node, add tag
image

  1. DefaultSlotService when create slot profile, read tag.
    image

  2. AbstractResourceManager when assign task to worker, use tag to choose

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@gitfortian
Copy link
Contributor

great!!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants