How do you have multi gpu environment?

Unfortunately, Unsloth only supports single-GPU settings at the moment For multi-GPU settings, I recommend popular alternatives like TRL

Unsloth Max, 2 T4, 3h 4m , 5h 14m , 1h 6m , 54h 20m * Peak Memory Usage on a Multi GPU System System, GPU, Alpaca

unsloth library Unsloth AI is a new AI company that is working to make training large language models much faster and more efficient

unsloth ai I used Llama Factory and Unsloth supports multigpu without issue when running in accelerate