方法对比

	AlexNet	Dropout
领域	深度学习	深度学习
方法族	Machine learning	Machine learning
起源年份	2012	2014
提出者	Krizhevsky, A.; Sutskever, I.; Hinton, G. E.	Srivastava, N.; Hinton, G.; Krizhevsky, A.; Sutskever, I.; Salakhutdinov, R.
类型	Deep Convolutional Neural Network (CNN)	Stochastic regularization technique for neural networks
开创性文献	Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems, 25, 1097–1105. (Republished: Communications of the ACM, 60(6), 84–90, 2017.)	Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2014). Dropout: A Simple Way to Prevent Neural Networks from Overfitting. Journal of Machine Learning Research, 15, 1929–1958.
别名	AlexNet, Krizhevsky net, SuperVision CNN, ImageNet CNN 2012	dropout regularization, stochastic dropout, neuron dropout, inverted dropout
相关	3	1
摘要	AlexNet is a deep convolutional neural network (CNN) introduced by Alex Krizhevsky, Ilya Sutskever, and Geoffrey Hinton in 2012. It won the ImageNet Large Scale Visual Recognition Challenge (ILSVRC 2012) with a top-5 error rate of 15.3%, outstripping the runner-up by more than 10 percentage points and reigniting broad interest in deep learning. The architecture introduced or popularised several techniques — ReLU activations, dropout regularisation, and multi-GPU training — that became standard practice across the field.	Dropout is a stochastic regularization technique for training deep neural networks, introduced by Srivastava, Hinton, Krizhevsky, Sutskever, and Salakhutdinov in 2014. During each training step, each neuron is independently switched off with probability (1 − p), preventing the network from co-adapting its units too tightly and thereby reducing overfitting.