Honest field notes from the workshop — what we built, what the numbers actually said, and where we hit the wall. Wins and dead ends both; the dead ends are usually the more useful read.
Getting the FreeToken MoE runtime up on a Turing RTX 5000 — the two fixes that mattered, and 36–40 tok/s on a 35B-A3B NVFP4 model from a six-year-old card. With the numbers and the patches.
Read → Writeup · Mixture-of-ExpertsA prototype that predicts which experts fire next and prefetches ahead of the router across a three-tier cache — byte-identical output at half the VRAM, coherent at a third. The design, the results, the wall we hit, and why we gave the whole thing away.
Read →