Skip to content

[TRTLLM-14510][feat] BREAKING: serve: default num_serve_frontends to 8 with single-frontend fallback - #19379

Merged
lancelly merged 11 commits into
NVIDIA:mainfrom
lancelly:feat/serve-num-frontends-default-8
Oct 30, 2026
Merged

[TRTLLM-14510][feat] BREAKING: serve: default num_serve_frontends to 8 with single-frontend fallback#19379
lancelly merged 11 commits into
NVIDIA:mainfrom
lancelly:feat/serve-num-frontends-default-8

Commits

  1. Commits on Oct 29, 2026