Geek Answers Handbook

Saving data in Apache Kafka

I just started reading about Apache kafka a few days ago, so I'm kind of new to this technology. I have some doubts / questions and I need to find out. For instance:

  • According to the configuration: log.retention.hourswe can set the duration in hours here. Is it possible to extend the data storage time by 2 years?

  • According to this link , it says:

The Kafka cluster retains all published messages - regardless of whether they were used - for a custom period of time. For example, if journal retention is set to two days, then within two days after the publication of the message, it is available for consumption, after which it will be discarded to make room. Kafka's performance is almost constant in terms of data size, so storing large amounts of data is not a problem.

As already stated, perfomance is effectively constant in terms of data size . Does this mean that we can store data as much as possible? Do I need additional setup or a monitor?

+4
source share
2 answers

1) . log.retention.hours - . 2 - 17520 . .

2) , . , Kafka , , , , . , , .

+5

log.retention.hours , 100 , . , , O(1).

, , , .

0

More articles:


All Articles