Recursive Releases 9GB 1.8-Bit MoE Model 'Boole-32B-A2.5B-Preview', Reaching 565 tok/s on a Single RTX 5090
The Recursive team has released Boole-32B-A2.5B-Preview on r/LocalLLaMA, applying 1.8-bit mixed-precision quantization and expert pruning to fit a 32B MoE model
