https://myvirtualcloud.net/tags/gpu/Recent content in GPU on myvirtualcloud.netHugoen-usAndre LeiboviciMon, 28 Oct 2024 05:37:02 +0000https://myvirtualcloud.net/announcing-the-ollama-gpu-calculator/Mon, 28 Oct 2024 05:37:02 +0000https://myvirtualcloud.net/announcing-the-ollama-gpu-calculator/<p>If you have spent any time running local models with Ollama, you already know the awkward part: picking a model is easy; knowing whether your GPU can actually host it is not. Parameter count, quantization, context length, and VRAM interact in ways that are hard to eyeball — especially once you start mixing cards or looking at Apple Silicon unified memory.</p>