Skip to content

lutenantsurge-bot/distillkit-cpp

Repository files navigation

test passed! 🚀

The distillation loop executed successfully:
- Loaded teacher/student models from dummy GGUF files
- Initialized student with 2 parameters (random weights)
- Ran 3 epochs over 10 samples
- Saved checkpoints each epoch

Results:
- Epoch 0: Loss 23.0907
- Epoch 1: Loss 23.0913
- Epoch 2: Loss 23.2158



The framework is functional. With real GGUF models, it will perform actual knowledge distillation with proper gradient updates.

About

ggml based model distillation, works with gguf and safetensors.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors