Flume agent - can I specify compression as gzip or bz2?

Can I specify a compression parameter for the Flume agent so that the data is sent to the collector in a compressed format? I know that there are collector-level compression options, but it would also be extremely useful to be able to transfer compressed data from the agent.

Thank!

+5
source share
1 answer

The pond has sink gzipand decorators gunzipthat you can use. Place the decorator gzipon your agent’s sink and decorator gunzipon the collector receiver, and transferring compressed data between the agent and the collector should be easy.

+2
source

All Articles