General question about difference between finetuning on Huggingface's trainer and using llama-recipes finetune script

[Tizzzzy]

🚀 The feature, motivation and pitch

I see on the finetune tutorial there is a Huggingface's trainer notebook link.
What is the difference between finetune llama3 using Huggingface's trainer notebook and using llama-recipes finetune script. Do they have a different finetune performance on llama3? What are the advantages and disadvantages of each approach?

Alternatives

No response

Additional context

No response

[mreso]

Hi @Tizzzzy the quick start notebook is meant to get you up and running within minutes and it supports a single Gpu. With the finetuning script on the other hand you will be able to scale up your finetuning to multiple gpus and nodes.