Quantization and Abliteration Tip: Why Compressing Before Uncensoring Prevents Performance Drop
According to abliteration know-how shared by dealign.ai, you must quantize a language model first before applying uncensored weight adjustments to prevent regre