Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Issue: Getting half partitions while Consumer Group Migration #1283

Open
shubhamsnehi opened this issue Apr 24, 2024 · 0 comments
Open

Issue: Getting half partitions while Consumer Group Migration #1283

shubhamsnehi opened this issue Apr 24, 2024 · 0 comments

Comments

@shubhamsnehi
Copy link

My service is hosted on Kubernetes cluster and my use case is, I have one consumer group as C1, which is consuming messages from topic T1 which has 70 partitions. I have fetched the latest committed offsets for topic T1 by the consumer C1 for all the 70 partitions. Now I have created a new, dynamic, consumer group for example as C2. So, as per my approach, I have committed offsets for all the 70 partitions and now I will fetch the assigned partitions for the particular pod of the new consumer group i.e. C2 and the seek and set the offsets of the assigned partitions as per old consumer C1.
So I am using group.Next() for getting the generation and from that I am fetching the assigned partitions for the particular pod of the C2. But here I am getting only half of partitions i.e. 35 partitions.

Any solve on this?

@shubhamsnehi shubhamsnehi changed the title Issue: Getting half partitions in Consumer Group Migration Issue: Getting half partitions while Consumer Group Migration Apr 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant