Awesome

RoLoRA

RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization

Codes and Models Coming soon.