Tag: gpu
All the articles with the tag "gpu".
NVIDIA is not a GPU company anymore
A GPU-sharing problem I never solved cleanly years ago stayed with me, so I spent a weekend back in the NVIDIA world to see what had changed. What I found is that NVIDIA is no longer a GPU vendor. It is a full stack, from CUDA and the warp scheduler at the bottom, through NCCL, NVLink, NVSwitch, and the Mellanox fabric, through Grace CPUs and DGX systems and DGX Cloud, through TensorRT, vLLM, Triton, and Dynamo, up to build.nvidia.com with NIMs, Nemotron, Blueprints, Skills, and NeMo Guardrails. These are my weekend findings, and they end where my old problem started: how you share a GPU.
The private cloud with no requirements
A government customer in the Gulf asked for a private cloud with Kubernetes and handed over no requirements. The design work turned out to be inventing the requirements: imagining the tenants who would show up and what they would ask for, then choosing technology against the two questions that stand in for the word best when there is no spec, whether it locks you in and whether it is already paid for.