Capacity Ratios Fail as a Safeguard Against Harmful Knowledge Distillation in Cross-Domain Pill Retrieval
A large-scale study finds that capacity ratios, the standard safeguard for choosing knowledge distillation teachers, fail to predict harmful transfer ...
