Geek Answers Handbook

Kafka - difference between log end offset (LEO) and High Watermark (HW)

What is the difference between LEO and HW in Replica ( Leader Replica )?

Will they contain the same number? I understand that HW is last committed message offset .

When will LEO be updated and how?

+5
source share
1 answer

A high watermark indicates the offset of messages that are fully replicated, while the offset at the end of the log may be larger if there are still newly added entries in the leading section that are not yet replicated.

Consumers can only receive messages up to a high watermark.

See this blog post for more details: http://www.confluent.io/blog/hands-free-kafka-replication-a-lesson-in-operational-simplicity/

+7
source

More articles:


All Articles