Skip to content

fix(linux/vulkan): preserve host aspect ratio in encoder output#5130

Open
hebo6 wants to merge 1 commit into
LizardByte:masterfrom
hebo6:master
Open

fix(linux/vulkan): preserve host aspect ratio in encoder output#5130
hebo6 wants to merge 1 commit into
LizardByte:masterfrom
hebo6:master

Conversation

@hebo6
Copy link
Copy Markdown

@hebo6 hebo6 commented May 16, 2026

Description

Fixes a behavior inconsistency between the VAAPI and Vulkan encoders on Linux: when the encoder target resolution differs in aspect from the captured source, the VAAPI path letterboxes the source into the encoded frame while the Vulkan path stretches it to fill.

Screenshot

Issues Fixed or Closed

Roadmap Issues

Type of Change

  • feat: New feature (non-breaking change which adds functionality)
  • fix: Bug fix (non-breaking change which fixes an issue)
  • docs: Documentation only changes
  • style: Changes that do not affect the meaning of the code (white-space, formatting, missing semicolons, etc.)
  • refactor: Code change that neither fixes a bug nor adds a feature
  • perf: Code change that improves performance
  • test: Adding missing tests or correcting existing tests
  • build: Changes that affect the build system or external dependencies
  • ci: Changes to CI configuration files and scripts
  • chore: Other changes that don't modify src or test files
  • revert: Reverts a previous commit
  • BREAKING CHANGE: Introduces a breaking change (can be combined with any type above)

Checklist

  • Code follows the style guidelines of this project
  • Code has been self-reviewed
  • Code has been commented, particularly in hard-to-understand areas
  • Code docstring/documentation-blocks for new or existing methods/components have been added or updated
  • Unit tests have been added or updated for any new or modified functionality

AI Usage

  • None: No AI tools were used in creating this PR
  • Light: AI provided minor assistance (formatting, simple suggestions)
  • Moderate: AI helped with code generation or debugging specific parts
  • Heavy: AI generated most or all of the code changes

@hebo6 hebo6 changed the title vulkan: preserve host aspect ratio in encoder output fix(linux/vulkan): preserve host aspect ratio in encoder output May 16, 2026
@sonarqubecloud
Copy link
Copy Markdown

@ReenigneArcher ReenigneArcher added the ai PR has signs of heavy ai usage (either indicated by user or assumed) label May 16, 2026
@ReenigneArcher

This comment was marked as resolved.

Copy link
Copy Markdown
Contributor

@neatnoise neatnoise left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As the original author of the Vulkan encoder path — this looks correct and clean. Single dispatch, no extra passes or sync, negligible overhead.

A few notes:

  1. rgb2yuv.comp L43-47: The black value computation assumes range_y/range_uv are (1,0). Worth a comment noting this assumption so it doesn't break silently if those values change in the future.

  2. vulkan_encode.cpp L115-116: Push constant struct layout changed (fields inserted in the middle) — fine since both C++ and GLSL are updated together, but worth being aware of for any future out-of-tree shader variants.

  3. vulkan_encode.cpp L290-293: The & ~1 rounding on eff_w/eff_h and offsets could theoretically leave a 1-pixel gap if frame dimensions are odd. Might want to assert or clamp that dst_offset + eff_size <= frame_size.

@ReenigneArcher ReenigneArcher added this to the vulkan milestone May 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ai PR has signs of heavy ai usage (either indicated by user or assumed)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants