Geek Answers Handbook

Kafka consumer maximum value?

I worked at Google and read the Kafka documentation, but I could not find out the maximum value of the consumer bias and whether there was a bias after the maximum value. I understand that the offset is an Int64 value, so the maximum value is 0xFFFFFFFFFFFFFFFFFF. If there is a workaround, how does Kafka deal with this situation?

+7
offset apache-kafka kafka-consumer-api
source share
2 answers

According to this post , the offset will not reset:

At the moment, we are not rolling back. Since the displacement is long, it can last a very long time. If you write 1 TB per day, you can continue for about 4 million days.

In addition, you can always use more sections (each section has its own offset).

Since Luciano said, you probably should not worry.

+17
source share

It seems that this is not actually being "processed". But, taking into account that the offset belongs to the section, it seems that we should not worry about it :)

See http://search-hadoop.com/m/uyzND1uRn8D1sSH322/rollover/v=threaded

+2
source share

More articles:


All Articles