Dataflow permission to read BigQuery table pointing to "Disk"?

BigQuery can read from Google Drive as a federation source. See here . I want to read a table in BigQuery in my data stream pipeline that points to a disk document.

Connecting BigQuery to a file in Drive works fine:

enter image description here

But when I try to read this table in my Dataflow pipeline I (understandably), we get the following error:

No matching credentials found to access Google Drive. Contact us for table owner assistance.

[..] PCollection<TableRow> results = pipeline.apply("whatever", BigQueryIO.Read.fromQuery("SELECT * from [CPT_7414_PLAYGROUND.google_drive_test]")) .apply(ParDo.of(new DoFn<TableRow, TableRow>() { [..] 

How can I allow Dataflow to be read from a table in BigQuery that points to Drive?

+5
source share
1 answer

Currently, the data stream does not support reading from a join table supported by Drive, but this is coming soon.

+1
source

All Articles