46

Kafka 调整partiton数目和replica factor

 5 years ago
source link: http://www.zhyea.com/2018/07/13/kafka-reset-partition-num-and-replica-factor.html?amp%3Butm_medium=referral
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

调整partiton

调整partition可以直接执行如下命令：

./kafka-topics.sh --alter --topic topicName --zookeeper $ZK_HOST_NODE --partitions partitionNum

注意替换topicName、$ZK_HOST_NODE和partitionNum三个参数。

调整replica factor

调整replica-factor需要先创建一个json描述文件replica.json，大致如下：

{
    "version": 1,
    "partitions": [
        {
            "topic": "topicName",
            "partition": 0,
            "replicas": [
                1,
                2
            ]
        },
        {
            "topic": "topicName",
            "partition": 1,
            "replicas": [
                2,
                3
            ]
        },
        {
            "topic": "topicName",
            "partition": 2,
            "replicas": [
                3,
                4
            ]
        }
    ]
}

在描述文件中说明分区和副本所在broker的Id的映射。

而后在replica.json所在的位置执行如下命令：

$KAFKA_HOME/bin/kafka-reassign-partitions.sh --zookeeper $ZK_HOST_NODE  --reassignment-json-file replica.json --execute

另外，kafka-manager是个好东西，可以直接在界面上完成partiton数目的调整。可惜不能调整replica-factor。

#####


report

Recommend

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK