Geek Answers Handbook

S3cmd sync returns kill

I am trying to sync several large buckets on Amazon S3.

When I run my S3cmd sync -recursive command, I get a response saying "killed".

Does anyone know what this could mean? Is there a limit on the number of files that can be synchronized in S3?

thanks for your help

+7
source share
2 answers

After reading this, it looks like the program has problems with memory consumption. In particular, this can lead to an OOM killer (from killer memory) to remove this process and prevent the system from getting bogged down. A quick look at dmesg after the process is killed will usually be shown if this is the case or not.

With that in mind, I would make sure that you are in the latest version, in which problems with memory consumption are resolved in the release notes .

+7
source

An old question, but I would like to say that before you try to add more physical memory or increase vm memory, just try to add more swap.

I did this with 4 servers (ubuntu and centos) with a low bar (700 MB total, 15 MB total) and now it works fine.

0
source

More articles:


All Articles