Home Latest Articles
Latest Articles
  • Xiaokai Lu, Jun Feng, Yongqiang Han, Hao Wang, Enhong Chen
    Journal of Computer Research and Development. 2024, 61(8): 1917-1929.

    In the domain of multi-behavior sequence recommendation, Graph Neural Networks (GNNs) have been widespreadly adopted, yet they have limitations, notably in terms of adequately modeling the collaborative signals that exist between different sequences and addressing the challenges posed by long-distance dependencies. To bridge these gaps, a novel framework named GraphMLP-Mixer has been introduced. This innovative framework begins by constructing a global item graph, which is designed to bolster the model’s capacity to encapsulate the collaborative signals that are present across sequences. It then merges the perceptron-mixer architecture with graph neural networks, resulting in a graph-perceptron mixer model capable of delving deep into the intricacies of user interests. GraphMLP-Mixer stands out for its two principal strengths: It not only succeeds in effectively capturing the global dependencies inherent in user behaviors but also manages to alleviate the issue of excessive information compression. Furthermore, the framework boasts remarkable improvements in terms of time and space efficiency, with its complexity scaling in a linear fashion with the number of user interactions, thus outperforming existing GNN-based models in the realm of multi-behavior sequence recommendation. The robustness and efficiency of GraphMLP-Mixer in tackling the complexities of multi-behavior sequence recommendation have been thoroughly validated through extensive experimentation on three diverse and publicly available datasets.

  • Jinyu Zhang, Chenxi Ma, Chao Li, Zhongying Zhao
    Journal of Computer Research and Development. 2024, 61(8): 1930-1944.

    Cross-domain sequential recommendation (CSR) aims to capture the behavioral preferences of users by modeling their historical interaction sequences in multiple domains, thus providing personalized cross-domain recommendations. Recently, researchers have started integrating graph convolution networks (GCNs) into CSR to model complicated associations among users and items. However, due to their complicated structure, most graph-based CSR methods are usually accompanied by high computational complexity or memory overhead, making them difficult to deploy on resource-constrained edge devices. Besides, existing lightweight graph-based CSR methods tend to employ single layer aggregating protocol (SLAP) to propagate embeddings on cross-domain sequential graphs (CSG). Such a strategy indeed aids the GCNs in circumventing cross-domain noise interference caused by high-order neighborhood aggregation strategies. However, it also shields GCN from mining high-order sequential relationships within individual domains. To this end, we introduce a lightweight tri-branches graph external attention network (TEA-Net). Specifically, we separate the original CSG into three parts including two inner-domain sequential graphs and an inter-domain sequential graph and devise a parallel tri-branches graph convolution network to learn the node representations. This structure can simultaneously consider the first-order inter-domain correlations and the high-order inner-domain connectivity without introducing additional cross-domain noises. Besides, we propose an improved external attention (EA) component without the nonlinear channel, which captures the sequential dependency among items at a lower cost and shares attention weights across multiple branches. We conduct extensive experiments on two large-scale real-world datasets to verify the performance of TEA-Net. The experimental results demonstrate the superiority of TEA-Net in both the lightweight performance and the prediction accuracy compared with several state-of-the-art methods.

  • Jing Shang, Zhihui Wu, Zhiwen Xiao, Yifei Zhang
    Journal of Computer Research and Development. 2024, 61(8): 1945-1956.

    Most computing systems utilize caching to reduce data access latency, speed up data processing and balance service load. The key to cache management is to determine the appropriate data to be loaded into or discarded from the cache, as well as the appropriate timing for cache replacement, which is critical to improving cache hit rate.The existing caching schemes face with two problems: In real-time and online caching scenarios, it is difficult to discern the heat information of user access to data while ignoring the complex high-order information among data-access-sequences. In this paper, we propose a GNN-based cache prefetching network named Graph4Cache. We model a single access sequence into a directed graph (ASGraph), where virtual nodes are used to aggregate the features of all nodes in graph and represent the whole sequence. Then a cross sequence undirected graph (CSGraph) is constructed from the virtual nodes of ASGraphs to learn cross-sequence features, which greatly complements the limited item transitions in a single sequence. By fusing the information of these two graphs , we learn the high-order correlations among sequences and get abundant user intents. Experimental results on multiple public data sets demonstrate the effectiveness of this method. Graph4Cache outperforms the existing cache prediction algorithms on P@20 and MRR@20.

  • Shaopeng Wei, Ting Liang, Yu Zhao, Fuzhen Zhuang, Fuji Ren
    Journal of Computer Research and Development. 2024, 61(8): 1957-1967.

    Credit risk assessment for enterprises is a critical issue, significantly impacting investor decisions. It also plays a crucial role in enabling government warnings and the handling of financial risks in a timely manner. Given the numerous heterogeneous relationships in the financial market, graph neural networks are naturally suitable for modeling enterprise credit risk. However, most existing research primarily focuses on modeling either the intra-risk of enterprises based on their financial information or the inter-enterprise contagion risk using simulation methods. Therefore, these approaches fail to fully capture the comprehensive credit risk of enterprises in complex financial networks. To address this limitation in current research, we propose a multi-perspective heterogeneous graph neural network method CRGNN for enterprise credit risk assessment. This method includes an enterprise intra-risk encoder and an enterprise contagion risk encoder, where the enterprise intra-risk encoder models the intra-risk based on enterprise feature information, and the enterprise contagion risk encoder consists of two sub-modules: a hierarchical heterogeneous graph Transformer network and a hierarchical heterogeneous graph feature attention network newly proposed in this paper. These two modules respectively explore contagion risks from the views of different neighbors and different feature dimensions. To fully utilize heterogeneous relationship information, both modules employ hierarchical mechanisms. With these designs, the model proposed in this study can adequately capture the comprehensive credit risk faced by enterprises. Extensive experiments are conducted on the SMEsD bankruptcy prediction dataset and the ECAD enterprise credit assessment dataset, resulting in an improvement of 3.98% and 3.47% in AUC compared with the best baseline model, respectively.

  • Fu Lin, Mingkang Li, Xuexiong Luo, Shuhao Zhang, Yue Zhang, Zitong Wang
    Journal of Computer Research and Development. 2024, 61(8): 1968-1981.

    Graph anomaly detection plays a crucial role in identifying abnormal patterns within complex data structures, and finds applications in various domains such as malicious molecule identification, financial fraud detection, and social network analysis. While existing research in graph anomaly detection predominantly focuses on node-level anomaly detection, there is a scarcity of methods specifically designed for graph-level anomaly detection. Moreover, these methods often fail to adequately explore anomalous graph data, are sensitive to anomaly labels, struggle to capture features of anomalous samples effectively, exhibit poor model generalization, and suffer from performance reversal issues. There is a need for improvement in anomaly detection capabilities. we propose an anomaly-aware variational graph autoencoder based graph-level anomaly detection algorithm (VGAE-D), which utilizes an anomaly-aware variational graph autoencoder to simultaneously extract features from normal and anomalous graph data. This algorithm distinguishes the encoding information of normal and anomalous graphs in the encoding space, further exploring the graph encoding information to compute anomaly scores. Experimental evaluations on eight publicly available datasets from diverse domains demonstrate the effectiveness of the proposed graph-level anomaly detection algorithm. The results indicate that VGAE-D can efficiently identify anomalous graphs in different datasets, outperforming mainstream graph-level anomaly detection methods. Additionally, the algorithm exhibits a capability for learning from few anomalous samples, mitigating the issue of performance inversion to a large extent.

  • Zhi Zeng, Shuqing Zhao, Huan Liu, Xiang Zhao, Minnan Luo
    Journal of Computer Research and Development. 2024, 61(8): 1982-1992.

    Rumor detection with propagation chain remains an important topic in the research of social network analysis. Previous studies mostly oversimplify this task as detecting rumor in propagation chains of comments. However, real-world news posts usually share complex user and event interactions, which can provide potential detection clues. Therefore, we propose an event-driven HyperGraph convolutional network (EHGCN), which makes the first attempt to model news, user and event correlations into a unified hypergraph convolutional network for rumor detection. Specifically, it exploits egocentric network of users to construct homogeneous users circles for enhancing user-aware rumor verification. Moreover, EHGCN jointly leverages the main event and sub-event patterns at the intra-event level for rumor detection. The extensive experimental results show that EHGCN could improve the performance of rumor detection. Studies also confirm that EHGCN can detect rumors at an early stage by acquiring rich user circle and event information.

  • Ping Li, Shuhan Song, Yuan Zhang, Huawei Cao, Xiaochun Ye, Zhimin Tang
    Journal of Computer Research and Development. 2024, 61(8): 1993-2007.

    In recent years, with the extensive application of graph neural network (GNN) technology in the fields such as social network, information, chemistry and biology, the interpretability of GNN has attracted widespread attention. However, prevailing explanation methods fail to capture the hierarchical explanation information, and these hierarchical information has not been fully utilized to improve the classification accuracy of graph tasks. To address this issue, we propose a hierarchical self-explanation graph representation learning model called HSEGRL (hierarchical self-explanation graph representation learning). This model, by discovering hierarchical information in the graph structure, predicts graph classifications while outputting hierarchical self-explanation results. Specifically, we design the basic unit for extracting hierarchical information—interpreters. These interpreters consist of an encoder that extracts node features, a pooling layer that perceives hierarchical explanation-aware subgraphs, and a decoder that refines higher-order explanation information. We refine the pooling mechanism with an explanation-aware strategy, enabling the hierarchical selection of subgraphs based on the evaluation of the model’s topology and feature importance, thereby facilitating hierarchical self-explanation in conjunction with graph classification. HSEGRL is a functionally comprehensive and transferable self-explanatory graph representation learning framework that can hierarchically consider the model’s topological information and node feature information. We conduct extensive experiments on datasets from molecular, protein, and social network, and demonstrate that HSEGRL surpasses existing advanced self-explanatory graph neural network models and graph neural network models in terms of graph classification performance. Furthermore, the visualization of layered explanation outcomes substantiates the credibility of our proposed explanation methodology.

  • Chuanzhen Zhu, Xuan Wang, Qiang Zheng
    Journal of Computer Research and Development. 2024, 61(8): 2008-2019.

    Currently, graph convolutional network (GCN) holds significant potential in processing graph data and other unstructured data. However, GCN faces challenges when dealing with densely connected graphs, as their node-based neighborhood information aggregation mechanism can lead to excessive smoothing, thereby weakening the expressive power of the network graph. The construction of sparse graphs can alleviate the phenomenon of excessive smoothing during the convolution process to some extent, but sparse graphs are prone to information loss and the sparsification process lacks unified standards, affecting the model’s consistency and interpretability. To address this, we propose element separation and holistic attention graph convolutional network framework (EH-GCN). This framework does not require the basis of sparse graphs and can learn the connectivity and node features of densely connected graphs separately. Moreover, it employs a global attention mechanism to integrate connectivity and node features, thus overcoming the limitations of traditional GCN frameworks in handling densely connected graphs and enhancing the feature expression capability of the network graph. We firstly construct fully connected brain networks on three brain imaging datasets: ADNI, ABIDE, and AIBL, verifying the effectiveness of the EH-GCN model in classifying densely connected graphs. Subsequently, the model is tested on the FRANKENSTEIN chemical molecular graph dataset, demonstrating its robust generalization capability. Additionally, the interpretability analysis of the framework aligns with previous neuropathological research, further substantiating the biological basis of the framework.

  • Peiyuan Lai, Cheng Li, Zenghui Wang, Changdong Wang, Dezhang Liao
    Journal of Computer Research and Development. 2024, 61(8): 2020-2029.

    Traffic flow prediction is a crucial foundational aspect in the development of smart cities, holding significant implications for urban traffic management and user travel planning. The expanding dimensions of both time and space contribute to the increasing volume of traffic flow data, with real-time updates presenting a challenge in deploying cost-effective forecasting models to meet diverse traffic prediction demands. Inspired by the success of the emerging paradigm of graph-based finetuning in downstream tasks of natural language processing, we introduce, for the first time to our best knowledge, graph based finetuning to enhance the generalization capabilities of traditional traffic flow prediction models, called TPGPF (traffic flow prediction based on graph prompt-finetuning), which could enhance the generality and effectiveness of self-supervised learning. In the context of spatiotemporal multidimensional traffic flow prediction models, our approach involves pretraining the model based on historical datasets and introducing learnable prompt vectors. With the pretrained model solidified, a self-supervised learning model is guided by the introduced prompt vectors to adapt to new data prediction tasks, thereby enhancing the generality and effectiveness of traffic flow prediction models. Extensive experiments on five real-world public datasets validate the effectiveness of our work, which provides an effective method to overcome the cost challenge brought by quasi real-time training of traffic flow data.

  • Yuanning Cui, Zequn Sun, Wei Hu
    Journal of Computer Research and Development. 2024, 61(8): 2030-2044.

    A knowledge graph (KG) is a structured knowledge base that stores a massive amount of real-world knowledge, providing data support for numerous knowledge-driven downstream tasks. KGs often suffer from incompleteness, with many missing facts. Therefore, the KG reasoning task aims to infer new conclusions based on known facts to complete the KG. With the research and development of knowledge engineering and its commercial applications, numerous general and domain-specific KGs have been constructed. Existing KG reasoning models mostly focus on completing a single KG but lack general reasoning capabilities. Inspired by the general capabilities of pre-trained large language models in recent years, some pre-trained universal KG reasoning models have been proposed. Addressing the issue of existing pre-trained model being unable to identify high-quality reasoning patterns, we introduce a rule-based pre-trained universal KG reasoning model called RulePreM. It discovers and filters high-quality reasoning rules to enhance the reasoning abilities. The proposed model first constructs a relational IO graph based on reasoning rules and uses an encoder, RuleGNN, to encode the relations. The encoded relations are then used as prompts to encode entities in the KG. Finally, candidate entities are scored for prediction. Additionally, an attention mechanism that combines rule confidence is introduced to further reduce the impact of low-quality reasoning patterns. Experimental results demonstrate that the proposed model exhibits universal reasoning abilities on 43 different KGs, with average performance surpassing existing supervised and pre-trained models.