手法を比較
選択した手法を並べて確認できます。異なる行はハイライト表示されます。
| Weakly Supervised Vision Transformer× | 自己教師あり学習× | |
|---|---|---|
| 分野≠ | 深層学習 | 機械学習 |
| 系統 | Machine learning | Machine learning |
| 提唱年≠ | 2021–2022 | 2018–2020 |
| 提唱者≠ | Dosovitskiy et al. (ViT); weak supervision paradigm from Zhou and others | LeCun, Y. and community (formalized ~2018–2020) |
| 種類≠ | Self-attention image model with weakly supervised training | Representation learning paradigm |
| 原典≠ | Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., & Houlsby, N. (2021). An image is worth 16x16 words: Transformers for image recognition at scale. In International Conference on Learning Representations (ICLR). link ↗ | LeCun, Y. & Misra, I. (2022). Self-supervised learning: The dark matter of intelligence. Meta AI Blog. https://ai.facebook.com/blog/self-supervised-learning-the-dark-matter-of-intelligence/ link ↗ |
| 別名 | WS-ViT, weakly supervised ViT, weak supervision with vision transformer, ViT with weak labels | SSL, self-supervised pre-training, pretext-task learning, unsupervised representation learning |
| 関連≠ | 4 | 3 |
| 概要≠ | Weakly Supervised Vision Transformer (WS-ViT) trains a Vision Transformer on image data that lacks precise pixel-level annotations, instead using cheaper, noisier supervision such as image-level class tags, bounding boxes, or web-scraped text. The global self-attention mechanism of the transformer makes it especially capable of localising objects and learning discriminative features from these incomplete labels. | Self-supervised learning (SSL) is a machine-learning paradigm that generates its own supervisory signal directly from unlabeled data by defining an auxiliary pretext task — such as predicting masked words, rotating images, or contrasting augmented views — and uses the learned representations as a powerful starting point for downstream tasks with minimal labeled examples. |
| ScholarGateデータセット ↗ |
|
|