Skip to content

Surface meaningful skip reasons when no Azure VM size meets test requirements#4363

Draft
Copilot wants to merge 1 commit intokasenlaskar/fix_testskip_reasoningfrom
copilot/sub-pr-4361-again
Draft

Surface meaningful skip reasons when no Azure VM size meets test requirements#4363
Copilot wants to merge 1 commit intokasenlaskar/fix_testskip_reasoningfrom
copilot/sub-pr-4361-again

Conversation

Copy link
Contributor

Copilot AI commented Mar 19, 2026

When no Azure VM size satisfies a test case's requirements, LISA previously emitted a generic "no available quota found" message, making it hard to diagnose why a test was skipped.

Changes

  • _get_meet_capabilities: Changed item from tuple-unpacking to list indexing so unmet check_result.reasons from the first failing candidate can be written back to item[2] after the generator is exhausted.
  • _get_azure_capabilities: After determining no VM was found, collects and de-duplicates the stored unmet_reasons across all candidate items. Produces either a specific "Requirement mismatch: <reasons>" message or a structured fallback noting the cause is undiagnosed.

Before / After

# Before
no available quota found on 'eastus'.

# After — when requirements are diagnosable
Requirement mismatch: gpu_count minimum is 1, but capability is 0; nic_count minimum is 4, but capability is 2

# After — when cause is unknown
Test skipped on 'eastus' for an unknown reason. This could be due to insufficient quota,
unmet hardware requirements, or other undiagnosed causes. Manual investigation may be required.

💡 You can make Copilot smarter by setting up custom instructions, customizing its development environment and configuring Model Context Protocol (MCP) servers. Learn more Copilot coding agent tips in the docs.

Copilot AI mentioned this pull request Mar 19, 2026
9 tasks
Copilot AI changed the title [WIP] [WIP] Address feedback on test case impact for skip reasoning fix Surface meaningful skip reasons when no Azure VM size meets test requirements Mar 19, 2026
Copilot AI requested a review from kanchansenlaskar March 19, 2026 10:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants