Skip to content

[TRTLLM-17226][perf] Reduce sampler logprobs temporary memory - #20803

Merged
zhaoyangwang-nvidia merged 6 commits into
NVIDIA:mainfrom
zhaoyangwang-nvidia:perf/compact-logprobs
Oct 27, 2026
Merged

[TRTLLM-17226][perf] Reduce sampler logprobs temporary memory#20803
zhaoyangwang-nvidia merged 6 commits into
NVIDIA:mainfrom
zhaoyangwang-nvidia:perf/compact-logprobs

Fix sampler logprob test signature and FP32 comparisons

4a9d57b
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Oct 26, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO