Build: Bump pyspark[connect] from 4.0.1 to 4.1.2

[dependabot]

Bumps pyspark[connect] from 4.0.1 to 4.1.2.

Commits

• f0bb2e6 Preparing Spark release v4.1.2-rc1
• 977ab6f Removing test jars and class files
• 384299a [SPARK-56872][SQL][4.1] Fix NPE in DowncastLongUpdater.decodeSingleDictionaryId
• 01da789 [SPARK-56840][SQL][FOLLOW-UP] Add a real NullIf repro test
• 1d8d3d3 [SPARK-56840][SQL] Avoid unresolved NullIf type lookup
• 0e6df72 [SPARK-56793][K8S] Avoid cluster-wide LIST in executor pods polling
• c50668d [SPARK-56812][INFRA] Fix URL of get-pip.py in dev/infra/Dockerfile for Python...
• cfff222 [SPARK-56755][SQL][TESTS][FOLLOWUP][4.1] Fix ShowCreateTableSuite
• 723067a [SPARK-56584][PYTHON][4.1] Generalize RESULT_TYPE_MISMATCH_FOR_ARROW_UDF er...
• 2aa1c5c [SPARK-56755][SQL] Fix SHOW CREATE TABLE for v2 table partitioned by bucket t...
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[ebyhr]

___________________ test_spark_writes_orc_pyiceberg_reads[1] ___________________
...
    @pytest.mark.integration
    @pytest.mark.parametrize("format_version", [1, 2])
    def test_spark_writes_orc_pyiceberg_reads(spark: SparkSession, session_catalog: Catalog, format_version: int) -> None:
        """Test that ORC files written by Spark can be read by PyIceberg."""
        identifier = f"default.spark_writes_orc_pyiceberg_reads_v{format_version}"
    
        # Create test data
        test_data = [
            (1, "Alice", 25, True),
            (2, "Bob", 30, False),
            (3, "Charlie", 35, True),
            (4, "David", 28, True),
            (5, "Eve", 32, False),
        ]
    
        # Create Spark DataFrame
>       spark_df = spark.createDataFrame(test_data, ["id", "name", "age", "is_active"])
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...
	details = "[SQL_CONF_NOT_FOUND] The SQL...rk.sql.session.localRelationChunkSizeRows\" cannot be found. Please verify that the config exists. SQLSTATE: 42K0I"}"

[ebyhr]

I see #2855 (comment)

Dockerfile uses:

• BASE_IMAGE_SPARK_VERSION: 4.0.1
• ICEBERG_SPARK_RUNTIME_VERSION: 4.0_2.13

Perhaps, we need to wait for #3389 to use Spark 4.1?