Knowledge Distillation with TAs

This video presents a paper exploring the effectiveness of introducing intermediate teaching networks (Teacher Assistants) to the knowledge distill...
Back to Top