view article Article Making Knowledge Distillation Cheap Enough to Run at Scale MultiverseComputingCAI • Aug 10 • 42
Running Featured 95 Distilling 100B+ Models 40x Faster with TRL 📝 95 TRL distillation for 100B+ teachers, 40x faster