ScholarGate
助手

方法对比

并排查看您选择的方法;存在差异的行会高亮显示。

图注意力网络×专家混合模型×
领域深度学习深度学习
方法族Machine learningMachine learning
起源年份20182017
提出者Veličković, P. et al.Shazeer, N. et al.
类型Graph neural network (attention-based)Sparse neural network architecture (conditional computation)
开创性文献Veličković, P. et al. (2018). Graph Attention Networks. ICLR. link ↗Shazeer, N. et al. (2017). Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer. ICLR. arXiv:1701.06538 link ↗
别名Graf Dikkat Ağı (GAT), GAT, graph attention network, attention-based graph neural networkUzman Karışımı (Mixture of Experts — MoE), uzman karışımı, MoE, sparse mixture of experts
相关43
摘要The Graph Attention Network (GAT), introduced by Veličković and colleagues in 2018, is a graph neural network variant that learns how much importance to assign to each neighbouring node through a self-attention mechanism. On heterogeneous neighbourhoods and relational classification it produces results superior to graph convolutional networks (GCN).Mixture of Experts (MoE) is a sparse neural-network architecture, introduced by Shazeer and colleagues in 2017 with the sparsely-gated MoE layer, in which only a subset of expert sub-networks is activated for each input. As seen in models such as Switch Transformer and Mixtral, it holds computation cost fixed even as the total parameter count grows.
ScholarGate数据集
  1. v1
  2. 2 来源
  3. PUBLISHED
  1. v1
  2. 2 来源
  3. PUBLISHED

前往搜索 下载幻灯片

ScholarGate方法对比: Graph Attention Network · Mixture of Experts. 于 2026-06-20 检索自 https://scholargate.app/zh/compare