@paul_rietschka I stumbled upon that because LoRA kept talking how very low rank changes can make significant improvements and so on (not surprised about that tbh) So yeah, always seeing the best in people I suspect they kept increasing model sizes for marketing purposes.