Run "Kimi K3" on a Laptop With 32 GB Ram (No GPU Needed)
Waste is a 6,000-line C engine that runs the 2.78-trillion-parameter Kimi K3 mixture-of-experts model on a laptop with 32 GB RAM and no GPU, achieving about 0.5 tokens per second by keeping only a 27 GB trunk resident and streaming the rest from a fast NVMe drive. The project went viral on Hacker News because it demonstrates that even the largest open-weight models can be run on consumer hardware, albeit very slowly, by treating inference as a storage problem rather than a compute problem.