博客 > 人工智能&数据科学 > 通用算法和模型 > 图嵌入和图神经网络
# 图嵌入和图神经网络 > 转载自:https://leovan.me/cn/2020/04/graph-embedding-and-gnn/ ![ca4956647e3fb8b29e326e332553f4f5.png](/resources/d6c5092ab1eb49f09ae034260a58cb41) ![01907dc5f6ebc88b16c24a516ec60e9b.png](/resources/6248e0a7cb494d9a828e60868d7d744b) ## 图嵌入 ![d31f4b4653a368f22d0c4ce5989055bd.png](/resources/60f9c619951740dd876a543426f1f3e8) ### Random Walk ![bd929364bfc0686c2f19ffb55a81c47e.png](/resources/1904afb213be407d82daacb07a51e367) ![84399fdb5cfa3260bfd0c996bf4b7f6a.png](/resources/eb97b95f7f034b5c8dc6094d2a5c8deb) ![d52cc264868c1dd0573a6791d0e5cfb0.png](/resources/b521b15eb99f4791acb3772664850f2a) ### Matrix Fractorization ![96c876d48441a77adc6544ad66e0dd76.png](/resources/ec3d51ee86914d728adbb182cf8b8799) ![08fc17ec1a3182e86d0f162b972729d7.png](/resources/980eda1f047d41188240022967d7cd5a) ![584c9e2ee592be1f8628810b33c8d7c3.png](/resources/f10c6401624046369e41c4e5fc0fa3d3) ### Meta Paths ![21d5f6f0d2a2df1a6450771ebfe1bb56.png](/resources/01ebb2d542354e9fb760e6af3e760f3b) ![10dea2c0ed34ac8217bf886b41951bce.png](/resources/175c8cd48b144f32b0964b6ec2b0c611) ### Deep Learning ![5b51dee163e2bdfc714dd808668bbe36.png](/resources/dafa7996d5284e81901b66c43bd5165a) ![261cc0de5b890d5bce906e50655fef5c.png](/resources/96c9b6073fab408089bed4ee2c13378f) ![5c40ae00ece0cadb7f0afddb971a5864.png](/resources/b5ac125134b64e3fa102ce24ed8c07e0) ![452dcd161873d342e8b1f0086ac77e4d.png](/resources/63455127b5254819819c2225e664a3c3) ### Others ![5cda069b41a6b7c3e981cd02f283671b.png](/resources/2744b426ed62405aba3566e5db7504e8) ## 图神经网络 ![b7bfb34793235c186a1e3dcfdcfc2b98.png](/resources/760650c6ee40492bbd3ef284953f41ea) ![ffd74a3eb2b2567b03035b5a7696aab6.png](/resources/39f3f34c054543a8a62511d7f4866c4e) ![568fd6272ca7883b6c74d2a19ea424b3.png](/resources/e40f34e0d90b48ccac5312383c2bdf6e) ![e595c81d8fb77709fce799a748b88ec2.png](/resources/dcf6f72018e145ac83839ee205558ec3) ### Graph Neural Networks ![eb832b5ac0e1faa35e542a8641e5b4e0.png](/resources/3d141067fb74486fad9e783cff4702f3) ![5738cb35b41537f41bd135f2376a409e.png](/resources/2c55a381440042eaab775a7c70ced8e0) ### Graph Convolutional Networks ![b6c46b6396bd40da1aefe65b028a065f.png](/resources/61e7fab482a44aab8036e56173e96edb) ![bc92e63ddec8dced6d496dd2f2c6d912.png](/resources/0b1d2a60ca6c437ea8f0106a9c665383) ![d719bff13c6d409250b512022251d417.png](/resources/a8708ed6fed044be9a842a9e534c9903) ![6862494a47401c02e7ded683d26fcc6b.png](/resources/264bc20d77d44c62b16f31b1bdfd22cf) GCN 方法可以分为两大类:基于频谱(Spectral Methods)和基于空间(Spatial Methods)的方法。 ![dbf69433e1993f36fc231cb5d3409f84.png](/resources/805be40f19174f9689f0f620ef8511dc) ![14bd57625e65fd192aaf05c81b68612d.png](/resources/5c832cdf86ec43229ceed47403eb76f3) ### Graph Recurrent Networks ![c74795bea2b4216f63a5034c0850d5de.png](/resources/0efbc37b15f04b62b5490656b2417259) ![cfa3f6c2f4bfb5f0cf67db067cee0d73.png](/resources/e7ddd69586204c2b88ae0bf7f4c01477) ### Graph Attention Networks ![ca462af35e0ad799b7f17c5948e96811.png](/resources/5defbece8a2b45a1a8ce974940850259) GAT 中的注意力架构有如下几个特点: 1. 针对节点对的计算是并行的,因此计算过程是高效的。 2. 可以处理不同度的节点并对邻居分配对应的权重。 3. 可以容易地应用到归纳学习问题中去。 ### 应用 图神经网络已经被应用在监督、半监督、无监督和强化学习等多个领域。下图列举了 GNN 在不同领域内相关问题中的应用,具体模型论文请参考 Graph Neural Networks: A Review of Methods and Applications 原文。 ![af4a3dbe5bbfa08b2bf5cdfaa7b86067.png](/resources/c0915a48c79d479eada79dab06937d3f) ### 开源实现 <table> <thead> <tr> <th>项目</th> <th>框架</th> </tr> </thead> <tbody> <tr> <td><a href="https://github.com/rusty1s/pytorch_geometric" target="_blank">rusty1s/pytorch_geometric</a></td> <td><i class="icon icon-pytorch">PyTorch</i></td> </tr> <tr> <td><a href="https://github.com/dmlc/dgl" target="_blank">dmlc/dgl</a></td> <td><i class="icon icon-pytorch">PyTorch</i>, <i class="icon icon-tensorflow">TF</i> &amp; <i class="icon icon-mxnet">MXNet</i></td> </tr> <tr> <td><a href="https://github.com/alibaba/euler" target="_blank">alibaba/euler</a></td> <td><i class="icon icon-tensorflow">TF</i></td> </tr> <tr> <td><a href="https://github.com/alibaba/graph-learn" target="_blank">alibaba/graph-learn</a></td> <td><i class="icon icon-tensorflow">TF</i></td> </tr> <tr> <td><a href="https://github.com/deepmind/graph_nets" target="_blank">deepmind/graph_nets</a></td> <td><i class="icon icon-tensorflow">TF</i> &amp; <i class="icon icon-sonnet">Sonnet</i></td> </tr> <tr> <td><a href="https://github.com/facebookresearch/PyTorch-BigGraph" target="_blank">facebookresearch/PyTorch-BigGraph</a></td> <td><i class="icon icon-pytorch">PyTorch</i></td> </tr> <tr> <td><a href="https://github.com/tencent/plato" target="_blank">tencent/plato</a></td> <td></td> </tr> <tr> <td><a href="https://github.com/PaddlePaddle/PGL" target="_blank">PaddlePaddle/PGL</a></td> <td><i class="icon icon-paddlepaddle"></i> PaddlePaddle</td> </tr> <tr> <td><a href="https://github.com/Accenture/AmpliGraph" target="_blank">Accenture/AmpliGraph</a></td> <td><i class="icon icon-tensorflow">TF</i></td> </tr> <tr> <td><a href="https://github.com/danielegrattarola/spektral" target="_blank">danielegrattarola/spektral</a></td> <td><i class="icon icon-tensorflow">TF</i></td> </tr> <tr> <td><a href="https://github.com/THUDM/cogdl/" target="_blank">THUDM/cogdl</a></td> <td><i class="icon icon-pytorch">PyTorch</i></td> </tr> <tr> <td><a href="https://github.com/DeepGraphLearning/graphvite" target="_blank">DeepGraphLearning/graphvite</a></td> <td><i class="icon icon-pytorch">PyTorch</i></td> </tr> </tbody> </table>