Java Code Examples for org.apache.kafka.common.utils.Utils#murmur2()

The following examples show how to use org.apache.kafka.common.utils.Utils#murmur2() . You can vote up the ones you like or vote down the ones you don't like, and go to the original project or source file by following the links above each example. You may check out the related API usage on the sidebar.
Example 1
Source File: KeyModPartitioner.java    From SkyEye with GNU General Public License v3.0 5 votes vote down vote up 
@Override
public int partition(String topic, Object key, byte[] keyBytes, Object value, byte[] valueBytes, Cluster cluster) {
    List<PartitionInfo> partitions = cluster.partitionsForTopic(topic);
    int numPartitions = partitions.size();
    int partitionNum = 0;
    try {
        partitionNum = Utils.murmur2(keyBytes);
    } catch (Exception e) {
        partitionNum = key.hashCode();
    }

    return Math.abs(partitionNum % numPartitions);
}
Example 2
Source File: PartitionTest.java    From SkyEye with GNU General Public License v3.0 5 votes vote down vote up 
public static void main(String[] args) {
    String app = "app-test1";
    String host = "jthink";
    int numPartitions = 9;

    String key = new StringBuilder(app).append(host).toString();
    byte[] keyBytes= ByteBuffer.allocate(4).putInt(key.hashCode()).array();
    int partitionNum = 0;
    try {
        partitionNum = Utils.murmur2(keyBytes);
    } catch (Exception e) {
        partitionNum = key.hashCode();
    }
    System.out.println(Math.abs(partitionNum % numPartitions));
}
Example 3
Source File: KafkaMQClientHandler.java    From Thunder with Apache License 2.0 5 votes vote down vote up 
@SuppressWarnings("resource")
private int getPartitionIndex(Consumer<String, byte[]> consumer, String topic, String key) {
    int partitionNumber = consumer.partitionsFor(topic).size();

    StringSerializer keySerializer = new StringSerializer();
    byte[] serializedKey = keySerializer.serialize(topic, key);

    int positive = Utils.murmur2(serializedKey) & 0x7fffffff;

    return positive % partitionNumber;
}
Example 4
Source File: KafkaTest.java    From Thunder with Apache License 2.0 5 votes vote down vote up 
@SuppressWarnings("resource")
private int getPartitionIndex(int partitionNumber, String topic, String key) {
    StringSerializer keySerializer = new StringSerializer();
    byte[] serializedKey = keySerializer.serialize(topic, key);

    int positive = Utils.murmur2(serializedKey) & 0x7fffffff;

    return positive % partitionNumber;
}
Example 5
Source File: DefaultMessage.java    From azeroth with Apache License 2.0 4 votes vote down vote up 
public long getPartitionHash() {
    if (partitionHash <= 0 && partitionFactor != null) {
        partitionHash = Utils.murmur2(partitionFactor.toString().getBytes());
    }
    return partitionHash;
}