手法を比較

	畳み込みニューラルネットワーク（分類）	Transformer (NLP)
分野	深層学習	深層学習
系統	Machine learning	Machine learning
提唱年	1998	2017
提唱者	LeCun, Y. et al.	Vaswani, A. et al.
種類	Deep neural network (convolutional)	Attention-based deep neural network
原典	LeCun, Y., Bottou, L., Bengio, Y. & Haffner, P. (1998). Gradient-Based Learning Applied to Document Recognition. Proceedings of the IEEE, 86(11), 2278–2324.	Vaswani, A. et al. (2017). Attention Is All You Need. NeurIPS.
別名	CNN (Evrişimli Sinir Ağı — Sınıflandırma), CNN classification, ConvNet, convolutional network classifier	Transformer Modeli (NLP), attention-based language model, self-attention network, transformer NLP
関連	5	4
概要	A Convolutional Neural Network (CNN) is a deep learning model, established by LeCun and colleagues in 1998, that learns local patterns directly from images and structured data to classify them. Stacks of convolutional filters discover increasingly abstract features, so manual feature engineering can be largely reduced.	The Transformer is an attention-based deep learning model, introduced by Vaswani and colleagues in 2017, that performs text classification, named-entity recognition, and language modelling by letting every token in a sequence attend directly to every other token. It replaced earlier recurrent designs with a self-attention mechanism that processes whole sequences in parallel.