Terms
Model Distillation
Model distillation is a technique in which a student model learns from the outputs of a more extensively trained model. It may be used legitimately to reduce training costs or maliciously to extract a model’s capabilities through APIs.