Skip to content

Consistent hashing algorithm leads to uneven distribution of partitions. #12296

@baimu7

Description

@baimu7

Hello, we are using Ignite 2.15 in our project. In practice, we found that the partition assignment method RendezvousAffinityFunction, which is based on consistent hashing, has an issue with uneven distribution. For example, when assigning partitions to 120 nodes, the number of partitions assigned to each node varies significantly. Is there any way to solve this problem?

Alternatively, if our project does not need to consider backups or data migration caused by nodes joining or leaving the cluster, can we simply use a straightforward hash function instead of consistent hashing for partition assignment? If so, what potential issues might arise from this approach?

Image

RendezvousAffinityFunctionTest.java

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions