[jeremydmiller]

Bumps <Version> from 6.62.1 to 6.63.0. This PR's CI run is the release gate for 6.63: the milestone's PRs were merged while Actions was disabled, and LocalGate was skipped.

In 6.63 (durability, from chaos rounds two and three)

• GH-5406 HTTP span tags are written before anything can short-circuit the request #5418 HTTP span tags (http.route, http.request.method, handler.type) are skipped when tenant detection, JSON or validation short-circuits #5406, GH-5416 Document waiting on a message the broker fans out to several queues #5419 Tracked session reports Completed after the first copy of a fanned-out message succeeds #5416 (docs), GH-5409 Commit the out-of-process durability chaos rig with a README #5420 Commit the out-of-process durability chaos rig (src/Testing/DurabilityChaosRig) with a README #5409 (the chaos rig), GH-5411 A durable pop skips envelopes the inbox already holds instead of rolling the batch back #5421 PostgreSQL queue: one inbox id conflict rolls back the whole durable pop batch (no ON CONFLICT) #5411, GH-5412 The SQL Server scheduled-message poll never waits on a lock #5422 SQL Server: the scheduled-message poll is a deadlock victim under normal multi-node load #5412, GH-5413 A database queue drains a backlog without waiting a polling interval per batch #5424 Investigate the slow drain after PostgreSQL outages in the durability chaos rig (~8 min settle, ~470 s worst message) #5413, GH-5410 A commit that applied but reported an error is not dead-lettered and its cascades run #5425 An EF Core commit that succeeds on the server but errors on the client dead-letters committed work and strands its cascades on the live node #5410, GH-5423 A node resumed after being ejected as stale does not commit work another node already handled #5427 A node that resumes after being ejected as stale commits messages another node already handled #5423
• GH-5428 The MySQL expired-handled cleanup no longer locks live inbox rows #5431 MySQL: the expired-Handled inbox cleanup deadlocks with handler commits, and the handler's message is dead-lettered #5428: the MySQL expired-handled cleanup no longer locks live inbox rows
• GH-5429 Oracle's in-transaction mark-as-handled refuses work another node already handled #5432 Oracle: committed handler work runs again when connections fail (no handled fence on Oracle's in-transaction mark) #5429: Oracle's in-transaction mark-as-handled refuses work another node already handled
• GH-5430 SQLite in Balanced mode assigns node numbers and reads health checks as UTC #5433 SQLite in Balanced mode: every node registers as node 1, and released inbox rows are never recovered after restarts #5430: SQLite in Balanced mode assigns node numbers and reads health checks as UTC
• GH-5426 A scheduled retry on a database queue is fenced on the inbox row's owner #5434 Residual duplicate commits after a stale node resumes, on scheduled retries (after the #5423 fence) #5426: a database queue's scheduled retry is fenced on the inbox row's owner
• GH-5435 Tenant databases with one name on one host are told apart by port #5436 Two tenant databases with one name on one host but different ports share a durability agent, so the second one's scheduled messages never run #5435: tenant databases with one name on one host are told apart by port
• GH-5438 The outbox-to-queue move is one transaction on MySQL, SQL Server and SQLite #5439 MySQL queue: one Work committed twice under the same envelope id after a stale-node ejection and inbox recovery (chaos leg 1b) #5438: the outbox-to-queue move is one transaction on MySQL, SQL Server and SQLite
• GH-5414 Durability chaos rig, round three #5440 Durability chaos testing, round three: MySQL/Oracle/SQLite queues, dead letter replay, Toxiproxy, partitioning, multi-tenancy #5414: durability chaos rig, round three

Also on this branch: GH-4701's in-transaction retire test now expects the GH-5423 refusal (DuplicateIncomingEnvelopeException, then the rollback, then the discard retires the copy). CIPersistence failed on it in the first run, and it bisected to #5427. The other 45 checks were green.

🤖 Generated with Claude Code

https://claude.ai/code/session_013nKJrqsJw3j23Xd46q37ob