Geek Answers Handbook

Is there a maximum file size for the hard limit for a CSV file?

Somehow one of our parties failed last night, the file size that would have been generated is 500 MB with about 500,000 records (lines).

Just wondering if there is a hard file size for .csv files?

I understand that Excel has a strict row limit of 60 thousand rows, but this is a discovery.

+4
source share
2 answers

Depending on how you process the CSV file, you may run out of memory and / or processor bottlenecks with large files.

In addition, on 32-bit Linux systems, there is a 2 GB file size limit that limits the maximum CSV size, regardless of processor power and memory. Having said that, CSV files that are large are a good sign that you should consider a more efficient and reliable solution for processing your data, such as a database system.

+5
source

The maximum file size of any file in the file system is determined by the file system itself, and not by the suffix of the file or file type. So the answer is no.

But, as you said, the application that you use to process the file may have limitations.

+4
source

More articles:


All Articles