All geek questions in one place

Is there a file limit on Google Cloud Storage (GCS)?

I believe that there should not be any restrictions, but I just wanted to confirm (as it is not mentioned in official documents):

  • Is there a file limit on Google Cloud Storage (GCS)?
  • Is there a performance impact (in access and write operation) if I have a very large number of files in GCS?
  • Is there a limit on the length of the file name (since I could use the file name to create the pseudo-directory structure)?
+5
source share
1 answer

Re (3): per https://cloud.google.com/storage/docs/bucket-naming , the bucket names are limited to 222 characters (and several other restrictions); per https://cloud.google.com/storage/docs/bucket-naming#objectnames (the same web page is slightly lower), object names are limited to 1024 characters (when utf8 is encoded) with one mandatory restriction ("should not contain “Carriage Return” or “Feed Line”) and a few “highly recommended” conventions (no escape characters, avoid certain punctuation).

Re (1) and (2), as far as I know, there are no restrictions on the number of objects that you can store in GCS, as well as performance implications depending on such numbers. Google online docs specifically say " any amount of data."

However, if you require a strong commitment to a project of unusual size (many petabytes, not terabytes, mentioned in https://cloud.google.com/storage/docs/overview ), you might be best advised to get this commitment “officially” by contacting Sales at https://cloud.google.com/contact/ .

http://googlecloudplatform.blogspot.com/2013/11/justdevelopit-migrates-petabytes-of-data-to-google-cloud-storage.html specifically conducts interviews with a client using Cloud Storage for "more than 10 petabytes [[growing ]] at a rate of 800 terabytes per month, "so at least to such orders, you should definitely be fine.

+13
source

Source: https://habr.com/ru/post/1213412/

More articles:


All Articles