Issues

• Indirect dynamic overwrite fails on second write when partitionField/partitionType are retained

  GoogleCloudDataproc/spark-bigquery-connector#1514 · Filter by author judahrand opened on Aug 13, 2026
  

• [Bug] Direct write mode fails with com.google.api.gax.rpc.NotFoundException: io.grpc.StatusRuntimeException: NOT_FOUND: Requested entity was not found. when table is dropped and recreated between writes

  GoogleCloudDataproc/spark-bigquery-connector#1487 · Filter by author ksebatianblalid opened on May 14, 2026
  2

  

• Wrong nullablily for arrays and their elements when reading table

  GoogleCloudDataproc/spark-bigquery-connector#1482 · Filter by author eejbyfeldt opened on May 1, 2026
  

• MapType read back as array<struct<key,value>> instead of map + DecimalType precision lost on read - regression from 0.43.1

  GoogleCloudDataproc/spark-bigquery-connector#1478 · Filter by author ye11owSub opened on Apr 16, 2026
  

• Invalid table ID "test_b_deals$202602051235232241136685". Table IDs must be alphanumeric (plus underscores) and must be at most 1024 characters long. Also, Table decorators cannot be used.

  GoogleCloudDataproc/spark-bigquery-connector#1464 · Filter by author bixi-hemant opened on Feb 10, 2026
  2

• Spark read hangs indefinitely

  GoogleCloudDataproc/spark-bigquery-connector#1463 · Filter by author danbaron63 opened on Jan 29, 2026
  3

• DATETIME is read as String and not able to write it in indirect mode

  GoogleCloudDataproc/spark-bigquery-connector#1451 · Filter by author lbg-manasa-padimalla opened on Dec 4, 2025
  13

  

• Exception while writing to BigQuery table with BigNumeric data type

  GoogleCloudDataproc/spark-bigquery-connector#1438 · Filter by author lbg-samson-daniel opened on Nov 18, 2025
  8

• Using row_number().over(Window) leads to Arrow exception in 4.0 preview (0.43.1-preview)

  GoogleCloudDataproc/spark-bigquery-connector#1435 · Filter by author mariussoutier opened on Oct 28, 2025
  14

  

• Spark Structured Streaming - BigQuery as a source

  GoogleCloudDataproc/spark-bigquery-connector#1433 · Filter by author kolban-google opened on Oct 23, 2025

• Failure to run query that requires kms key query setting

  GoogleCloudDataproc/spark-bigquery-connector#1415 · Filter by author JFvdm opened on Aug 29, 2025
  1

  

• Using of parent project option with query parameter

  GoogleCloudDataproc/spark-bigquery-connector#1414 · Filter by author urosstan-db opened on Aug 23, 2025

• Value at index is null reading bigquery public dataset

  GoogleCloudDataproc/spark-bigquery-connector#1404 · Filter by author steve-ashton-amp opened on Jul 30, 2025

• [Feature Request] Improve Logging for Materialized View Read Fallback on Permission Failure

  GoogleCloudDataproc/spark-bigquery-connector#1401 · Filter by author cjac opened on Jul 25, 2025
  

• MapType of Decimal, MapType or ArrayType are not supported any more

  GoogleCloudDataproc/spark-bigquery-connector#1394 · Filter by author walmaaoui opened on Jul 16, 2025
  5

• Not able to read SQL queries unless a materializationDataset is specified as option

  GoogleCloudDataproc/spark-bigquery-connector#1392 · Filter by author alvaro-ps opened on Jul 11, 2025
  

• spark-sql unable to resolve table names

  GoogleCloudDataproc/spark-bigquery-connector#1385 · Filter by author abbas-gadhia opened on Jun 18, 2025
  4

  

• data not inserting in 'overwrite' mode - Value has type STRUCT which cannot be inserted into column source, which has type STRING

  GoogleCloudDataproc/spark-bigquery-connector#1365 · Filter by author soumikdas-oa opened on May 15, 2025

• Reading table with pseudo columns has ArrayIndexOutOfBoundsException

  GoogleCloudDataproc/spark-bigquery-connector#1361 · Filter by author wkeithvan opened on Apr 28, 2025
  1

  

• Latest connector makes job fail with missing bigquery.jobs.create permission

  GoogleCloudDataproc/spark-bigquery-connector#1352 · Filter by author mariussoutier opened on Apr 4, 2025
  13

  

• BigQuery Connector Ignores location Option When Submitting Query Jobs — Always Defaults to US

  GoogleCloudDataproc/spark-bigquery-connector#1348 · Filter by author sbaldassin opened on Mar 25, 2025
  

• "spark.sql.sources.partitionOverwriteMode": "DYNAMIC" - creates additional tables

  GoogleCloudDataproc/spark-bigquery-connector#1314 · Filter by author MichalBogoryja opened on Nov 15, 2024
  5

  

• Destination table's schema is not compatible with dataframe's schema. Incompatible max length for field: FIELD_NAME, cannot write source field with max length: null to destination field with max length: 8

  GoogleCloudDataproc/spark-bigquery-connector#1312 · Filter by author kumarshekhar opened on Oct 28, 2024
  1

  

• GCP Identity federation auth failure with AWS

  GoogleCloudDataproc/spark-bigquery-connector#1306 · Filter by author sytianhe opened on Oct 16, 2024
  2

• bigquery.tables.create Permission required on appending data to a BigQuery Table

  GoogleCloudDataproc/spark-bigquery-connector#1277 · Filter by author smic-itss-jdcastro opened on Aug 6, 2024
  4