Does Amazon S3 support multicast atomic downloads?

Question

I am developing a system against Amazon S3. I am doing this in C # using the S3.NET SDK.

I want to upload several files to S3 at once, but if someone does not work, I want all of them to fail. I can do it? How?

Does the TransferUtility.UploadDirectory SDK create atomic directory loading, where if any file in the directory does not load, all of them do not work?

If it does not perform atomic loading, then I will need to have code to manage it; how to find out which files were successful and which failed to use TransferUtility.UploadDirectory?

Thanks for any help or direction.

Answer 1

Well, it seems that TransferUtility methods are pretty high-level helper types that give a little feedback, and there isn’t any atomicity logic included in UploadDirectory (as well as S3 for multiple files, which really should happen for good atomicity).

Therefore, some types of constant sequence queues are needed to make sure that everything is done. The multi-file upload mechanism for S3 for atomic processing would be very convenient, and perhaps they are working on it, but they currently do not have this feature.

Answer 2

No, you cannot do this. S3 does not offer an API for multi-user downloads. The best thing you can do is to implement this in your client (if one download failed, delete all objects that have already been downloaded), but, of course, this is not atomic.