ScholarGate
Asistent

Compară metode

Examinează metodele selectate una lângă alta; rândurile care diferă sunt evidențiate.

Rețele Kolmogorov-Arnold×Mamba (Model de Spațiu de Stări)×Vision Transformer×
DomeniuÎnvățare profundăÎnvățare profundăÎnvățare profundă
FamilieMachine learningMachine learningMachine learning
Anul apariției202420232021
Autorul originalZiming LiuAlbert GuDosovitskiy, A. et al.
TipNeural network architectureNeural network architectureTransformer architecture for images (self-attention over patches)
Sursa seminalăLiu, Z., Wang, Y., Vaidya, S., Ruehle, F., Halverson, J., Soljačić, M., Hou, T. Y., & Tegmark, M. (2024). KAN: Kolmogorov-Arnold Networks. arXiv preprint arXiv:2404.19756. link ↗Gu, A., & Dao, C. (2023). Mamba: Linear-time sequence modeling with selective state spaces. arXiv preprint arXiv:2312.08956. link ↗Dosovitskiy, A. et al. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. ICLR. link ↗
Denumiri alternativeKAN, Kolmogorov-ArnoldMamba, State space models, Selective state spaceGörsel Transformer (ViT), görsel transformer, ViT, patch transformer for images
Înrudite445
RezumatKolmogorov-Arnold Networks (KAN) is a neural network architecture introduced by Liu et al. in 2024 that replaces linear transformations with learned univariate functions on edges. Inspired by the Kolmogorov-Arnold representation theorem, KAN achieves superior function approximation with fewer parameters than traditional MLPs, offering potential efficiency gains and improved interpretability.Mamba is a sequence model architecture introduced by Gu and Dao in 2023 that achieves linear-time complexity while maintaining strong performance on language modeling tasks. By combining state space models with input-dependent selectivity, Mamba addresses the quadratic complexity of transformers while preserving modeling power.The Vision Transformer (ViT), introduced by Dosovitskiy and colleagues in 2021, splits an image into fixed-size patches, treats those patches as a sequence, and applies the Transformer self-attention mechanism to image classification. Given enough training data, it surpasses convolutional neural networks (CNNs).
ScholarGateSet de date
  1. v1
  2. 1 Surse
  3. PUBLISHED
  1. v1
  2. 1 Surse
  3. PUBLISHED
  1. v1
  2. 2 Surse
  3. PUBLISHED

Mergi la căutare Descarcă prezentarea

ScholarGateCompară metode: Kolmogorov-Arnold Networks · Mamba (State Space Model) · Vision Transformer. Preluat la 2026-06-20 de pe https://scholargate.app/ro/compare