ScholarGate
Assistant

Comparer des méthodes

Examinez les méthodes sélectionnées côte à côte ; les lignes qui diffèrent sont mises en évidence.

Mamba (Modèle à espace d'états)×Modèles de Diffusion Latente×Autoencodeurs masqués×Vision Transformer×
DomaineApprentissage profondApprentissage profondApprentissage profondApprentissage profond
FamilleMachine learningMachine learningMachine learningMachine learning
Année d'origine2023202220212021
Auteur d'origineAlbert GuRobin RombachKaiming HeDosovitskiy, A. et al.
TypeNeural network architectureNeural network architectureNeural network architectureTransformer architecture for images (self-attention over patches)
Source fondatriceGu, A., & Dao, C. (2023). Mamba: Linear-time sequence modeling with selective state spaces. arXiv preprint arXiv:2312.08956. link ↗Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022). High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 10684-10695). DOI ↗He, K., Chen, X., Xie, S., Li, Y., Dollár, P., & Girshick, R. (2022). Masked autoencoders are scalable vision learners. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 16000-16009). DOI ↗Dosovitskiy, A. et al. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. ICLR. link ↗
AliasMamba, State space models, Selective state spaceLDM, Stable Diffusion, Latent DiffusionMAE, Vision MAEGörsel Transformer (ViT), görsel transformer, ViT, patch transformer for images
Apparentées4445
RésuméMamba is a sequence model architecture introduced by Gu and Dao in 2023 that achieves linear-time complexity while maintaining strong performance on language modeling tasks. By combining state space models with input-dependent selectivity, Mamba addresses the quadratic complexity of transformers while preserving modeling power.Latent Diffusion Models (LDMs) are a generative approach introduced by Rombach et al. in 2022 that performs the diffusion process in a compressed latent space rather than pixel space, enabling efficient high-resolution image synthesis. By compressing images into a low-dimensional latent representation using a variational autoencoder, diffusion becomes computationally tractable while maintaining visual quality.Masked Autoencoders (MAE) is a self-supervised learning approach introduced by He et al. in 2021 that masks random patches of an image and trains a model to reconstruct the missing content. Adapting the masked language modeling paradigm from NLP to vision, MAE learns rich visual representations by solving a challenging reconstruction task without requiring labels.The Vision Transformer (ViT), introduced by Dosovitskiy and colleagues in 2021, splits an image into fixed-size patches, treats those patches as a sequence, and applies the Transformer self-attention mechanism to image classification. Given enough training data, it surpasses convolutional neural networks (CNNs).
ScholarGateJeu de données
  1. v1
  2. 1 Sources
  3. PUBLISHED
  1. v1
  2. 1 Sources
  3. PUBLISHED
  1. v1
  2. 1 Sources
  3. PUBLISHED
  1. v1
  2. 2 Sources
  3. PUBLISHED

Aller à la recherche Télécharger les diapositives

ScholarGateComparer des méthodes: Mamba (State Space Model) · Latent Diffusion Models · Masked Autoencoders · Vision Transformer. Consulté le 2026-06-19 sur https://scholargate.app/fr/compare