#fine-tuning

LoRA & DoRA: The Math, Memory, and Trade-offs

LoRA and DoRA explained: matrix shapes, the geometry of weight decomposition, exact memory math for a 27B model, and what the DoRA benchmarks support.