Порівняння методів

	MobileNet: Ефективні згорткові нейронні мережі для мобільного зору	Дистиляція знань
Галузь	Глибоке навчання	Глибоке навчання
Родина	Machine learning	Machine learning
Рік появи	2017	2015
Автор методу	Andrew Howard et al. (Google)	Hinton, G., Vinyals, O. & Dean, J.
Тип	Lightweight CNN architecture	Neural network compression (teacher–student)
Основоположне джерело	Howard, A. G., et al. (2017). MobileNets: Efficient convolutional neural networks for mobile vision applications. arXiv preprint.	Hinton, G., Vinyals, O. & Dean, J. (2015). Distilling the Knowledge in a Neural Network. NeurIPS Deep Learning Workshop.
Інші назви	MobileNets, Depthwise Separable CNN, Efficient Mobile Vision Network, Mobil Evrişimli Sinir Ağı	Bilgi Damıtma (Knowledge Distillation), bilgi damıtma, teacher-student distillation, model distillation
Пов'язані	2	5
Підсумок	MobileNet is a family of lightweight convolutional neural network architectures introduced by Howard et al. at Google in 2017. It is designed to run image classification, object detection, and other vision tasks directly on mobile devices and embedded systems with limited computational budgets. By replacing standard convolutions with depthwise separable convolutions and exposing two global hyperparameters, MobileNet dramatically reduces multiply-add operations and model size while retaining competitive accuracy.	Knowledge Distillation is a model-compression technique, introduced by Geoffrey Hinton and colleagues in 2015, that trains a small student model using the soft-label outputs of a large teacher model. Distilled models such as DistilBERT and TinyBERT reach roughly 97% of the larger model's performance while running far faster.