Research On The Application Of Graph Neural Networks With Feature Smoothing In Node Classification

Graph Neural Networks(GNNs)are a class of deep learning models that are designed for graph data.Unlike traditional deep learning models,GNNs can handle non-Euclidean data,such as social networks,protein molecule structures,and syntactic parsing trees in natural language processing.The goal of GNNs is to learn node and edge embedding representations,allowing various tasks to be performed on graphs,including node classification,link prediction,and social network analysis.Currently,GNNs are one of the most promising and popular research directions in graph analysis.As research continues to deepen,more and more GNNs models are being proposed that not only improve the learning efficiency of algorithms but also optimize the algorithm’s expressive power.Graph Neural Networks learn the node representation of multi-hops through stacking layers.However,deep GNNs often suffer from over-smoothing,which drives people to the road of model simplification.With the deepening of research,it is found that the representation of nodes is more related to feature smoothing.More and more simplified models show that the nonparametric feature smoothing scheme can not only reduce computational complexity but also improve performance.Because the features of nodes in GNNs propagate along the edges,the denoising of graph data mainly focuses on the modification of graph topology.Following the idea of model simplification,we have conducted the following work:Firstly,to address the issue of noise diffusion along edges in graphs,we propose a feature smoothing scheme on the topology modification graph named Topology-modified Feature Smoothing(TMFS).TMFS utilizes similarity measurement of node features to modify the topology of the graph,which not only removes edges with low similarity that already exist in the original graph,but also adds edges with high similarity that do not exist in the original graph.Experiments show that the smoothed features calculated by TMFS can improve the performance of GNNs.Graph data usually have high-dimension features.Some feature dimensions contribute more to node classification,while others may only be the personality features of specific nodes.However,the existing propagation schemes cause all dimensional features to propagate along the edge at the same time.Such schemes as dropedge and addedge cannot change this situation.This feature propagation method is very mechanized.To solve this problem,we divide the dimension of features according to commonality nature,and modify the graph topology respectively,to realize the Dimension-divided Feature Smoothing(DDFS)of personalized propagation.Our experiments show that the deep features obtained by DDFS can not only improve the performance of GNNs but also be more stable.Our feature smoothing scheme can be seen as a plug-and-play module.On the Cora dataset,the smoothed features of our DDFS have improved the accuracy of MLP by 27.88% and other GNNs by 2.29%at most.