BigQuery Node not processing results pagination correctly

[imReker]

Bug Description

I'm using BigQuery to get a lot of data. Because the result json > 5MB, so BigQuery paginates the results.
But n8n only fetched and parsed first page of data and ignored the rest.

To Reproduce

1. Create a BigQuery node.
2. Make a query to generate large data results, such as 1000 rows of strings with size of 1KB.

SELECT id, "aaaaaaaaaaaaaaaaaaaaaaaaaaa......  1KB of string" as `d`
FROM UNNEST(GENERATE_ARRAY(1, 1000)) AS id

3. Execute and only get about 800 rows in result, not 1000 rows.
4. Set Raw Output to true and execute the query, I noticed that there is pagination token, means the rest of data is in next page.
   

Expected behavior

Fetch pagination data correctly.

Operating System

Ubuntu 24.04

n8n Version

1.45.1

Node.js Version

v20.14.0

Database

MySQL

Execution mode

main (default)

[imReker]

According to Google's document https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs/query#QueryRequest

A non-empty pageToken indicates that additional results are available. To see additional results, query the jobs.getQueryResults method. For more information, see Paging through table data.

[Joffcom]

Thanks for reporting this @imReker, I have created NODE-1417 as the internal ticket to get this fixed.

[janober]

Fix got released with [email protected]