Uncensored Nex-N2.5-mini GGUF: Running a 35B MoE Locally on an 18GB VRAM Card
An uncensored GGUF build of Nex-N2.5-mini (IQ4_XS) enables local execution on an 18GB GPU. Explore its 35B MoE architecture, 262K context, vision mmproj, and ll
#VRAMOptimization
TAU HOME stories tagged VRAMOptimization.