https://smcleod.net/tags/optimisation/ Recent content in Optimisation on smcleod.net https://smcleod.net/logo-painted-350.svg https://smcleod.net/logo-painted-350.svg Hugo -- 0.152.2 en Wed, 02 Sep 2026 09:01:14 +1000 https://smcleod.net/2026/02/patching-nvidias-driver-and-vllm-to-enable-p2p-on-consumer-gpus/ Wed, 25 Feb 2026 23:59:00 +1000 https://smcleod.net/2026/02/patching-nvidias-driver-and-vllm-to-enable-p2p-on-consumer-gpus/ NVIDIA artificially restricts peer-to-peer (P2P) GPU communication to their enterprise cards. Turns out this is a software limitation, not a hardware one. I patched my drivers to remove it, hacked vLLM to take advantage of it, and got a 15-50% throughput improvement running Qwen 3.5 35b on dual RTX 3090s.