Skip to content

Pull requests: apache/spark

New pull request New
269 Open 54,675 Closed
269 Open 54,675 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[SPARK-56243][SS] Throw detailed error on malformed Kafka record timestamps
#55038 opened Mar 26, 2026 by kavpreetgrewal Loading…
1
[SPARK-56242][PYTHON][TESTS] Add a test to ensure no 3rd party libraries are imported for "import pyspark"
#55037 opened Mar 26, 2026 by gaogaotiantian Loading…
[SPARK-56241][SQL] Derive outputOrdering from KeyedPartitioning key expressions
#55036 opened Mar 26, 2026 by peter-toth Loading…
6
[SPARK-56175][SQL] FileTable implements SupportsPartitionManagement and V2 catalog table loading
#55034 opened Mar 26, 2026 by LuciferYang • Draft
1
Add test coverage for DSv2 table refresh and pinning design doc
#55033 opened Mar 26, 2026 by longvu-db • Draft
1
[SPARK-54944][PYTHON][TEST] Add tests for pa.Array.to_pandas with default arguments
#55031 opened Mar 26, 2026 by zhengruifeng Loading…
[SPARK-56235][CORE] Add reverse index in TaskSetManager to avoid O(N) scans in executorLost
#55030 opened Mar 26, 2026 by DenineLu Loading…
1
[SPARK-56234][CORE] Support disabling log directory scanning by path pattern in SHS
#55029 opened Mar 26, 2026 by sarutak Loading…
11
[SPARK-56227][CORE] Fix GcmTransportCipher to correctly handle multiple messages per channel
#55028 opened Mar 26, 2026 by aajisaka • Draft
1
1
[SPARK-56222][PYTHON] Create ArrowStreamGroupSerializer and ArrowStreamCoGroupSerializer
#55026 opened Mar 26, 2026 by Yicong-Huang Loading…
3
[SPARK-56221][SQL][PYTHON] Feature parity between spark.catalog.* vs DDL commands
#55025 opened Mar 26, 2026 by HyukjinKwon Loading…
2
[SPARK-56220][PYTHON] Add utility to check wrongly used errorClass in Python
#55022 opened Mar 25, 2026 by gaogaotiantian • Draft
[SPARK-31561][SQL] Add QUALIFY Clause
#55019 opened Mar 25, 2026 by sunchao Loading…
[WIP][SPARK-XXXXX][SQL] df.cache() with DSv2 interfaces to enable V2ScanRelationPushDown optimizer rules
#55017 opened Mar 25, 2026 by dbtsai Loading…
1
[SPARK-56216][SS] Integrate checkpoint V2 with auto-repair snapshot
#55015 opened Mar 25, 2026 by ericm-db Loading…
1
[SPARK-56121][SQL] Use dedicated EmptyRelation node for static PropagateEmptyRelation
#55014 opened Mar 25, 2026 by liuzqt Loading…
[SPARK-56204][SQL] Strip Alias wrappers from inline table row expressions in parser
#55007 opened Mar 25, 2026 by mihailotim-db Loading…
[SPARK-56202][SS] Refactor streaming join tests: split Base/Suite hierarchy and simplify mode dispatch
#55005 opened Mar 25, 2026 by cloud-fan Loading…
3
[SPARK-56200][CORE] Remove jackson JSON nesting depth limitation
#55004 opened Mar 25, 2026 by lsm1 Loading…
[SPARK-56199][CORE] Read fallback storage blocks asynchronously and multithread
#55003 opened Mar 25, 2026 by EnricoMi Loading…
1
[SPARK-56171][SQL] Enable V2 file write path for non-partitioned DataFrame API writes and delete FallBackFileSourceV2
#54998 opened Mar 25, 2026 by LuciferYang Loading…
2
[SPARK-56190][SQL] Support nested partition columns for DSV2 PartitionPredicate
#54995 opened Mar 25, 2026 by szehon-ho Loading…
17
[SPARK-56123][PYTHON] Refactor SQL_GROUPED_AGG_ARROW_UDF and SQL_GROUPED_AGG_ARROW_ITER_UDF
#54992 opened Mar 24, 2026 by Yicong-Huang Loading…
1
[SPARK-38101][CORE] Fix executors failing fetching map statuses with INTERNAL_ERROR_BROADCAST
#54987 opened Mar 24, 2026 by azmatsiddique Loading…
[WIP][DO-NOT-REVIEW][SPARK-55886][SQL] Add DataFrame.zip for merging column-projected DataFrames
#54976 opened Mar 24, 2026 by zhengruifeng • Draft
ProTip! What’s not been updated in a month: updated:<2026-02-26.