3つの要点 ✔️ 知識蒸留(KD)によるモデル複製・再現を防ぐ"Nasty Teacher"の提案 ✔️ 通常のモデルと同等の性能を維持しつつ、学生モデルの性能を著しく低下させる ✔️ 様々な条件での実験により、知識蒸留に対する免疫(KD-immunity)を実証 Undistillable: Making A Nasty Teacher That CANNOT teach students written by Haoyu Ma, Tianlong Chen, Ting-Kuei Hu, Chenyu You, Xiaohui Xie, Zhangyang Wang (Submitted on 29 Sept 2020) Comments: Accepted to ICLR2021. Subjects: knowledge distillation, avoid knowledge le