ScholarGate
Asistent

Compară metode

Examinează metodele selectate una lângă alta; rândurile care diferă sunt evidențiate.

Mamba (Model de Spațiu de Stări)×Modele de difuzie latente×Autoencodere mascate×Vision Transformer×
DomeniuÎnvățare profundăÎnvățare profundăÎnvățare profundăÎnvățare profundă
FamilieMachine learningMachine learningMachine learningMachine learning
Anul apariției2023202220212021
Autorul originalAlbert GuRobin RombachKaiming HeDosovitskiy, A. et al.
TipNeural network architectureNeural network architectureNeural network architectureTransformer architecture for images (self-attention over patches)
Sursa seminalăGu, A., & Dao, C. (2023). Mamba: Linear-time sequence modeling with selective state spaces. arXiv preprint arXiv:2312.08956. link ↗Rombach, R., Blattmann, A., Lorenz, D., Esser, P., & Ommer, B. (2022). High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 10684-10695). DOI ↗He, K., Chen, X., Xie, S., Li, Y., Dollár, P., & Girshick, R. (2022). Masked autoencoders are scalable vision learners. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 16000-16009). DOI ↗Dosovitskiy, A. et al. (2021). An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale. ICLR. link ↗
Denumiri alternativeMamba, State space models, Selective state spaceLDM, Stable Diffusion, Latent DiffusionMAE, Vision MAEGörsel Transformer (ViT), görsel transformer, ViT, patch transformer for images
Înrudite4445
RezumatMamba is a sequence model architecture introduced by Gu and Dao in 2023 that achieves linear-time complexity while maintaining strong performance on language modeling tasks. By combining state space models with input-dependent selectivity, Mamba addresses the quadratic complexity of transformers while preserving modeling power.Latent Diffusion Models (LDMs) are a generative approach introduced by Rombach et al. in 2022 that performs the diffusion process in a compressed latent space rather than pixel space, enabling efficient high-resolution image synthesis. By compressing images into a low-dimensional latent representation using a variational autoencoder, diffusion becomes computationally tractable while maintaining visual quality.Masked Autoencoders (MAE) is a self-supervised learning approach introduced by He et al. in 2021 that masks random patches of an image and trains a model to reconstruct the missing content. Adapting the masked language modeling paradigm from NLP to vision, MAE learns rich visual representations by solving a challenging reconstruction task without requiring labels.The Vision Transformer (ViT), introduced by Dosovitskiy and colleagues in 2021, splits an image into fixed-size patches, treats those patches as a sequence, and applies the Transformer self-attention mechanism to image classification. Given enough training data, it surpasses convolutional neural networks (CNNs).
ScholarGateSet de date
  1. v1
  2. 1 Surse
  3. PUBLISHED
  1. v1
  2. 1 Surse
  3. PUBLISHED
  1. v1
  2. 1 Surse
  3. PUBLISHED
  1. v1
  2. 2 Surse
  3. PUBLISHED

Mergi la căutare Descarcă prezentarea

ScholarGateCompară metode: Mamba (State Space Model) · Latent Diffusion Models · Masked Autoencoders · Vision Transformer. Preluat la 2026-06-19 de pe https://scholargate.app/ro/compare