Сравнение на методи
Прегледайте избраните методи един до друг; редовете с разлики са откроени.
| Търсене на невронни архитектури× | Стохастична оптимизация× | |
|---|---|---|
| Област≠ | Дълбоко обучение | Оптимизация |
| Семейство≠ | Machine learning | Process / pipeline |
| Година на възникване≠ | 2017 | 1951 (SGD); 2014 (Adam) |
| Създател≠ | Zoph, B. & Le, Q.V. | — |
| Тип≠ | Automated architecture optimization (deep learning) | Gradient-based iterative optimization |
| Основополагащ източник≠ | Zoph, B. & Le, Q.V. (2017). Neural Architecture Search with Reinforcement Learning. ICLR. link ↗ | Robbins, H. & Monro, S. (1951). A Stochastic Approximation Method. Annals of Mathematical Statistics, 22(3), 400-407. DOI ↗ |
| Други названия≠ | Nöral Mimari Arama (NAS), NAS, automated architecture design, differentiable architecture search | Stokastik Optimizasyon (SGD & Varyantları), stochastic gradient descent, SGD, Adam |
| Свързани≠ | 5 | 3 |
| Резюме≠ | Neural Architecture Search (NAS), introduced by Zoph and Le in 2017, automatically optimizes architectural decisions such as a network's depth, width, and connection structure instead of hand-designing them. Leading methods in the field include DARTS, ENAS, and Once-for-All. | Stochastic optimization is a family of iterative methods that minimize an objective function by computing gradients on randomly sampled subsets of data — mini-batches — rather than on the entire dataset at once. Pioneered by Robbins and Monro in 1951 as stochastic approximation, the approach became the standard engine for training large-scale machine-learning models through variants such as SGD with momentum, AdaGrad, RMSProp, and Adam. |
| ScholarGateНабор от данни ↗ |
|
|