Most people look at four RTX 3060s with 12GB of VRAM each and see a budget build. I looked at it and saw something else: the exact hardware configuration that the current generation of compressed, sparse, speculative models was designed around. Here’s my argument. With quad Multi-GPU systems, the PCI has been the bottleneck. Each […]
Earlier this summer, I tried running the QWEN3-CODER-NEXT Open Weights LLM Model locally on one of my Threadripper 64GB AI Workstations with 4 RTX-3060 12GB using layers across my 48GB of combined VRAM. With QWEN3-CODER-NEXT, I was able to replicate my original Lunar Lander game in Unity C# but it was very slow at 5.06 […]
During my Summer break from teaching at Northwest University, I upgraded my home AI workstations with more memory to run larger local Open Source and Open Weights 48GB LLM Models using CrewAI. I also needed to bake lighting in some of my very large Unity 3D open world environments (e.g. Exodus Vigil, Castle Quest) using […]
