fine-tuning the model for edge devices

[ogahozy]

i like this work but model is too heavy to edge device like the rasberry pi and android devices. is it possible to fine tune the model for only english language following by quantization to reduce the size for edge device?

[saakolch]

Yes, sure. Check Unsloth API: https://docs.unsloth.ai/basics/gemma-3n-how-to-run-and-fine-tune