مقایسهٔ روش‌ها

	جستجوی معماری عصبی	بهینه‌سازی تصادفی
حوزه	یادگیری عمیق	بهینه‌سازی
خانواده	Machine learning	Process / pipeline
سال پیدایش	2017	1951 (SGD); 2014 (Adam)
پدیدآور	Zoph, B. & Le, Q.V.	—
نوع	Automated architecture optimization (deep learning)	Gradient-based iterative optimization
منبع بنیادین	Zoph, B. & Le, Q.V. (2017). Neural Architecture Search with Reinforcement Learning. ICLR.	Robbins, H. & Monro, S. (1951). A Stochastic Approximation Method. Annals of Mathematical Statistics, 22(3), 400-407.
نام‌های دیگر	Nöral Mimari Arama (NAS), NAS, automated architecture design, differentiable architecture search	Stokastik Optimizasyon (SGD & Varyantları), stochastic gradient descent, SGD, Adam
مرتبط	5	3
خلاصه	Neural Architecture Search (NAS), introduced by Zoph and Le in 2017, automatically optimizes architectural decisions such as a network's depth, width, and connection structure instead of hand-designing them. Leading methods in the field include DARTS, ENAS, and Once-for-All.	Stochastic optimization is a family of iterative methods that minimize an objective function by computing gradients on randomly sampled subsets of data — mini-batches — rather than on the entire dataset at once. Pioneered by Robbins and Monro in 1951 as stochastic approximation, the approach became the standard engine for training large-scale machine-learning models through variants such as SGD with momentum, AdaGrad, RMSProp, and Adam.