You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Fast LLM server for NVIDIA Blackwell: GeForce RTX 50 and RTX PRO. Qwen3.8-27B on one RTX 5090: 91-94 tok/s, 1.3x vLLM and 1.4x llama.cpp. Runs the 123.6 GiB Qwen3.8-Flash-Next on a 32 GB card. OpenAI and Anthropic API, tool calls, one docker run.
RTX 5090 & RTX 5060 Docker container with PyTorch + TensorFlow. First fully-tested Blackwell GPU support for ML/AI. CUDA 12.8, Python 3.11, Ubuntu 24.04. Works with RTX 50-series (5090/5080/5070/5060) and RTX 40-series.
Blackwell-optimized llama.cpp Docker image – works on all NVIDIA GPUs, but tuned for RTX 50 series. Built from scratch with CUDA 12.8, sm_120, NVFP4-ready. 250+ tok/s on 4B F16. Includes llama-chat script.
Single-GPU passthrough of an RTX 50 series (Blackwell, 5080 in test case) to a VM on Linux: scripts, EndeavourOS ISO patcher, and the fixes for the black guest screen and the black host display after guest shutdown.
Space Engineers plugin — fixes the RTX 50-series (Blackwell) grass crash by replacing the geometry-shader foliage pipeline with compute + indirect draw. Same vanilla grass, no geometry shader.