LLaMA-Factory (hiyouga)

Comparison of Frameworks for Fine-Tuning AI: Unsloth, Axolotl, TRL, and LLaMA-Factory — Speed, VRAM, and Multi-GPU Support

The authors compared four popular frameworks for fine-tuning large language models: Unsloth, Axolotl, TRL, and LLaMA-Factory. The focus was on training speed, video memory (VRAM) consumption, and multi-GPU support. The results will help developers choose the optimal tool for their tasks.

Meta Unsloth Hugging Face LLaMA-Factory (hiyouga)