Noisy Student Training when you have 100 hours labelled and 60,000 unlabelled
How the noisy student loop actually works, why the noise and the pseudo-label filter are the method, and where it falls apart in practice.
#training
2 posts
Posts tagged training
Fine-tuning an open model with QLoRA
A hands-on QLoRA fine-tuning walkthrough: dataset prep, 4-bit training with peft and trl, merging, and vLLM serving behind an OpenAI-compatible API.