S3 Sync Not Writable Warning

Question

I am trying to use s3cmd sync (vanilla command remote to local), but for each file I get a warning not writable: Operation not permitted (see below). However, the files look correctly loaded, and if I do ls in the file, it is. I tried using the --disable-multipart flag, but that didn't make any difference. I am using s3cmd version 1.5.0-rc1.

Is there a reason I can get these alerts?

 WARNING: MD5 signatures do not match: computed=11ff15bf.., received="b119cb85b109c6.." WARNING: ./path/part-r-00003.gz.parquet not writable: Operation not permitted s3://bucket/path/part-r-00003.gz.parquet -> <fdopen> [31 of 72] 36101458 of 36101458 100% in 2s 16.30 MB/s done 

Answer 1

The likely reason is that S3 objects were saved with file system attributes. When you synchronize them in a local directory, by default s3cmd sync will try to restore these attributes, including uid, gid.

To prevent s3cmd from doing this, run it with the -no-preserve option, for example:

 s3cmd sync --no-preserve s3://bucket/my/key/prefix .