I would like to deploy a Kafka cluster in two data centers with the same number of nodes on each DC. The first DC is used in active mode, and the second in passive mode.
For example, let's say that both data centers have 3 nodes with 2 built-in replicas (ISRs) in the first DC and one ISR in the second DC.
Is it possible to have a third DC containing an arbiter / observer / observer node, so that in the event of a single DC failure, the leader election can succeed with the correct result in terms of sequence? mongoDB has a function called Replica set Arbiter .
How about deploying ZooKeeper on three data centers? From my understanding, ZooKeeper does not store Kafka data, and should not be contacted for each new entry in the Kafka topic, i.e. You do not pay the delay for the third DC for each new entry.
source
share