ScholarGate
Pembantu

Bandingkan kaedah

Semak kaedah pilihan anda secara bersebelahan; baris yang berbeza akan diserlahkan.

Normalisasi Kelompok×Cabit×ResNet (Residual Network)×
BidangPembelajaran MendalamPembelajaran MendalamPembelajaran Mendalam
KeluargaMachine learningMachine learningMachine learning
Tahun asal201520142016
PengasasIoffe, S. & Szegedy, C.Srivastava, N.; Hinton, G.; Krizhevsky, A.; Sutskever, I.; Salakhutdinov, R.He, K.; Zhang, X.; Ren, S.; Sun, J.
JenisNormalization technique (applied per mini-batch during training)Stochastic regularization technique for neural networksDeep Convolutional Neural Network with skip connections
Sumber perintisIoffe, S. & Szegedy, C. (2015). Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift. Proceedings of the 32nd International Conference on Machine Learning (ICML), PMLR 37, 448–456. link ↗Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2014). Dropout: A Simple Way to Prevent Neural Networks from Overfitting. Journal of Machine Learning Research, 15, 1929–1958. link ↗He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770–778. DOI ↗
AliasBatchNorm, BN, batch norm, mini-batch normalizationdropout regularization, stochastic dropout, neuron dropout, inverted dropoutResNet, Residual Network, Deep Residual Learning, ResNet-50
Berkaitan114
RingkasanBatch Normalization is a training technique introduced by Sergey Ioffe and Christian Szegedy in 2015 that normalizes the pre-activation outputs of each layer using the mean and variance computed over the current mini-batch. By stabilizing the input distribution to each layer throughout training, it substantially reduces internal covariate shift, enabling the use of higher learning rates and making deep networks train faster and more reliably.Dropout is a stochastic regularization technique for training deep neural networks, introduced by Srivastava, Hinton, Krizhevsky, Sutskever, and Salakhutdinov in 2014. During each training step, each neuron is independently switched off with probability (1 − p), preventing the network from co-adapting its units too tightly and thereby reducing overfitting.ResNet (Residual Network) is a deep convolutional neural network architecture introduced by Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun at CVPR 2016. By inserting shortcut (skip) connections that carry the input of a block directly to its output — defining the block's task as learning a residual correction rather than a full mapping — ResNet enabled training of networks with hundreds or even thousands of layers without the vanishing-gradient degradation that had previously made very deep networks impractical. It won the ILSVRC 2015 image recognition competition with a top-5 error of 3.57% and remains the most widely used backbone architecture in computer vision.
ScholarGateSet data
  1. v1
  2. 3 Sumber
  3. PUBLISHED
  1. v1
  2. 2 Sumber
  3. PUBLISHED
  1. v1
  2. 3 Sumber
  3. PUBLISHED

Pergi ke carian Muat turun slaid

ScholarGateBandingkan kaedah: Batch Normalization · Dropout · ResNet. Dicapai 2026-06-16 daripada https://scholargate.app/ms/compare