Geek Answers Handbook

Number of column restrictions in BigQuery?

Is there a limit on the number of columns in BigQuery?

I am going to prepare a large number of columns, as suggested by best practices. https://developers.google.com/bigquery/articles/ingestionbestpractices

+4
source share
2 answers

The limit is 10,000 columns. This limit was introduced as somewhat arbitrary, provided that no one would have more than 10 thousand columns. Looking at the error logs, someone really hit this restriction and got an error. There is also a 64k limit for the total row size (CSV data bytes) upon import.

+5
source

2013 update: the row size limit has moved from 64 to 1 MB for CSV and 20 MB for JSON data. It is recommended that you keep the number of columns below 10,000.

Check out https://developers.google.com/bigquery/preparing-data-for-bigquery#dataformats

+3
source

More articles:


All Articles