Is blocked or not blocked boto3.Bucket.upload_file?

Question

boto3.Bucket.upload_file blocks or does not block?

i.e. if I ran the following

bucket = session.Bucket(bucket_name)
bucket.upload_file(Key=s3_key, Filename=source_path)
os.remove(source_path)

Do I have a race condition, depending on file size? Or should the download be completed before the file is deleted?

Answer 1

The current boto3 is upload_fileblocked. As mootmoot said, you should definitely do some error handling to be safe if you delete the file.

Answer 2

, upload_file() S3Transfer, , . (API- S3Transfer) .

Answer 3

, , API, . , - (, ).

bucket = session.Bucket(bucket_name)
try :
  bucket.upload_file(Key=s3_key, Filename=source_path)
  os.remove(source_path)
except : 
  raise

S3 .

bucket.upload_file(
     Key=s3_key, 
     Filename=source_path, 
     extra_args={'Metadata': {'source_path': source_path}}
) 

S3 Bucket . PUT , , (, ).

Answer 4

Boto3 , .

See conversations about async + boto3 here:

https://github.com/boto/boto3/issues/648

https://github.com/boto/boto3/issues/746