Latest ArticlesCo-salient object detection (Co-SOD) aims to identify target regions from a set of related images that are not only visually salient but also semantically consistent across the group. The core challenge of Co-SOD lies in detecting visually prominent objects within individual images and determining which objects exhibit cross-image consistency among multiple images. Traditional Co-SOD methods mainly rely on low-level visual features to construct inter-image relationships. These approaches extract discriminative representations on the basis of handcrafted features,such as color,shape,and texture,to mine common salient objects. Although such methods perform reasonably well under simple backgrounds,they often fail in complex real-world scenarios with strong background clutter,severe occlusions,or multiple coexisting objects. In these cases,non-co-salient but visually salient objects can easily interfere with detection,leading to high false detection rates,poor robustness,and limited generalization. In recent years,with the rapid progress of deep neural networks,Co-SOD methods that are based on convolutional neural networks or vision Transformer have been proposed. By learning high-level semantic features across images,these methods substantially improve detection performance. However,they typically still rely on modeling image groups as the basis of detection without sufficiently incorporating explicit semantic priors. As a result,they lack the capability for proactive understanding of image categories or user-specific targets and therefore struggle in open-domain,multiobject scenarios or when fine-grained semantic distinctions are required. Moreover,when an image contains multiple visually salient but semantically irrelevant objects,these models often fail to distinguish them correctly,mistakenly including non-co-salient objects in the detection results,thus reducing the overall performance. For instance,in multiclass image datasets,such as CoCA,a single image often contains multiple visually prominent objects,but only a subset of them is semantically related and constitute co-salient targets. Other salient regions,although visually striking,act as semantic distractors. Without explicit semantic filtering mechanisms,traditional methods are often unable to distinguish which objects are the true co-salient targets,thus decreasing the accuracy of Co-SOD. To address these limitations,this study proposes a semantic-guided open-vocabulary Co-SOD framework. The proposed method leverages language prompts to guide the model’s attention toward target regions that are semantically aligned with image categories,thereby enabling semantic filtering of co-salient objects in complex multiobject scenarios and improving detection accuracy and semantic generalization ability.
The proposed semantic-guided open-vocabulary Co-SOD framework integrates three key components,namely,a CLIP-based group-consistent category generation method,the open-vocabulary object detection model OWLv2,and the universal segmentation model SAM,forming a complete pipeline that begins from semantic prompt generation to object detection and pixel-level segmentation. First,the system introduces a CLIP-based group-consistent category generation method to automatically derive the most representative group-consistent category for a given image set. This procedure eliminates the need for manually specifying class names,reduces human effort,and provides accurate and stable semantic prompts for subsequent detection. Specifically,the method computes cross-modal similarities between the visual features of each image in the group and candidate category text features and automatically generates the most representative category name that is consistent across the group to serve as a reliable input for the detection model. Second,the generated group-consistent category name is used as a natural language prompt and fed into the open-vocabulary object detection model OWLv2. OWLv2,which is pretrained on large-scale image-text pairs,possesses strong cross-modal semantic alignment and matching capabilities. By mapping image region and text prompt features into a unified semantic space,OWLv2 can identify target regions that are highly relevant to the natural language prompts. To further improve the robustness of semantic understanding,this work constructs multiple semantically related natural language phrases for each category name and adopts a multiprompt parallel input mechanism to feed them into OWLv2 simultaneously. This process enhances the model’s capacity to capture diverse semantic descriptions,improves stability and robustness in semantic matching,and effectively addresses uncertainties caused by language ambiguity. During the candidate region generation stage,similarities between region feature and text semantic vectors are calculated to identify candidate regions that are highly related to the input prompts,with the model outputting corresponding bounding boxes and confidence scores. A dynamic thresholding strategy is introduced to further improve detection flexibility and adaptability. This mechanism automatically adjusts detection thresholds on the basis of the confidence levels of semantic matches,thereby increasing the recall of low-confidence targets while maintaining precision. As a result,the framework can effectively detect occluded or weakly salient targets and avoid missed detections caused by overly strict thresholds. At the saliency segmentation stage,the bounding box regions filtered during the semantic detection stage are passed to segment anything model (SAM). SAM then performs pixel-level mask generation for each region of interest. Leveraging its powerful structural perception and boundary modeling capabilities,SAM produces high-quality segmentation results. The final system outputs salient masks that are structurally complete and have clear boundaries. This design effectively decouples the two subtasks of semantic perception and visual detail modeling,allowing each module to fully leverage its strengths,thereby enhancing the overall semantic guidance ability and object delineation quality of the system.
Experiments are conducted on three publicly available datasets: CoCA,CoSal2015,and CoSOD3k. The proposed method is compared with 15 state-of-the-art Co-SOD methods. On the CoCA dataset,our method achieves a 25.7% improvement in F measure and a 5.2% reduction in the mean absolute error (MAE) compared with the second-best model. On the CoSOD3k dataset,our method improves the F measure by 2.5%. On the CoSal2015 dataset,it improves the F measure by 2.2% and reduces MAE by 1.2%. These results comprehensively validate the strong ability of the proposed framework to recognize semantically relevant co-salient objects in multiobject open scenarios. Ablation experiments conducted on the CoSOD3k dataset further confirm the effectiveness of the proposed approach in enhancing Co-SOD performance.
This study proposes a semantic-guided open-vocabulary Co-SOD framework. The framework leverages a CLIP-based group-consistent category generation method to automatically generate semantic prompts for image groups and integrates OWLv2 for open-vocabulary object detection with SAM for universal segmentation. This process enables explicit semantic filtering of co-salient targets and fine-grained pixel-level segmentation. The proposed framework substantially enhances semantic generalization and target recognition robustness,enabling the effective localization of semantically consistent salient objects in multiobject and complex background scenarios. By unifying three critical components,namely,semantic prompt generation,open-vocabulary detection,and saliency segmentation,this framework provides an innovative and practical solution for advancing Co-SOD in open environments.
Specular highlight detection and removal,with the primary objective of accurately identifying highlight regions exhibiting mirror-like reflection characteristics and precisely recovering the underlying pixel information,constitute a fundamental research topic in computer vision and image processing. This technology demonstrates considerable practical value across various visual applications,including object detection,medical image analysis,industrial defect identification,and 3D imaging. From an optical perspective,the specular highlight phenomenon originates from the directional reflection behavior of incident light on smooth non-Lambertian surfaces,and its physical mechanism is theoretically describable through Fresnel equations. Traditional highlight removal methods typically rely on strict physical assumptions,which primarily encompass three classical approaches: 1) chromaticity space analysis-based techniques,2) illumination estimation-based algorithms,and 3) polarization information-utilizing solutions. However,these methods exhibit limited adaptability to complex and variable highlight removal requirements in real-world scenarios because of their constraints regarding specific scenes or object types. By contrast,deep learning-based highlight detection and removal techniques adopt a data-driven approach to automatically learn the complex nonlinear mapping relationships between highlight reflections and scene content,thereby effectively circumventing the dependency on prior assumptions inherent in traditional methods. The shifted window attention mechanism demonstrates unique advantages in highlight removal tasks and effectively addresses issues,such as texture information loss and color distortion,caused by specular highlights. This mechanism integrates local window partitioning with cross-window interaction,thus reducing computational complexity while maintaining global modeling capability. Building upon the exceptional modeling capability demonstrated by the shifted window attention mechanism during the feature extraction stage,this study proposes a two-stage mask-guided highlight removal network architecture. The proposed framework employs the shifted window attention mechanism to extract multiscale cross-channel features and utilizes highlight masks as prior knowledge to guide subsequent pixel recovery in highlight regions,thereby achieving highlight localization and removal. Notably,existing deep learning methods face challenges regarding insufficient training data. Current publicly available highlight datasets predominantly employ synthetic generation or laboratory-controlled lighting acquisition methods,failing to meet the requirements of real-world applications. To address this limitation,this study additionally constructs an in-situ automotive highlight dataset captured under multiple illumination conditions. This dataset has the following characteristics: 1) coverage of diverse natural illumination conditions,2) inclusion of complex background interference,and 3) precise pixel-level annotations,thereby providing a data foundation for enhancing model generalization performance in real-world scenarios.
In this study,we construct a real highlight dataset with cars as the main object,which is based on common cars in daily life with different highlight regions and intensities. Each pair of highlight images has its corresponding real highlight mask image. For highlight detection and removal,we propose a mask-guided two-stage highlight removal network (MG-TransUNet). This network explicitly divides the highlight detection and removal task into two phases. In the first phase,we train with a lightweight U-Net architecture to extract the highlight regions in the highlight images and generate the highlight mask map. In the second phase,a shifted window attention Transformer network that is based on the U-Net architecture is designed to recover the diffuse images of highlight regions by using the predicted highlight mask map as an a priori guide. Our experimental dataset is selected from three major public datasets (i.e.,paired specular-diffuse image dataset(PSD),specular highlight image quadruples(SHIQ) and synthetic specular highlight removal dataset(SSHR)) with our proposed automotive dataset. Among the four datasets,only SHIQ and automobile datasets provide highlight masks. To make our method trainable on the PSD and SSHR datasets,we subtract and threshold the highlight images and the corresponding specular no-highlight images from the two datasets to obtain the highlight mask for each pair of images. The highlight detection network is trained with the highlight images and masks at the first stage,and the obtained highlight masks are used as a priori information to guide the highlight removal task at the second stage. Our mask-guided highlight removal network is implemented by the Pytorch toolbox. The input images and ground truth maps are resized to 256 × 256 for training,the momentum parameter is set to 0.99,and the initial learning rate is set to 2 ×
Experiments are conducted on the proposed automotive dataset and three publicly available datasets to compare eight state-of-the-art methods. The quantitative evaluation metrics include the structural similarity index measure and peak signal-to-noise ratio (PSNR). Experimental results show that the PSNR value ranks second on the PSD dataset. It is improved by 1.11 compared with that in the model with second-best performance on the SHIQ dataset and by 0.38 compared with that in the model with the second-best performance on the SSHR dataset. Comparative experiments are also performed on automotive datasets to validate the effectiveness of the proposed dataset.
We propose a car highlight dataset for real scenarios and a mask-guided network incorporating a window-shift attention mechanism to perform the highlight removal task. The experimental results show that our highlight removal network can accurately recognize highlight regions and remove highlight images. The code link: https://github.com/chenWULUQI/MG-Trans_Unet.
The continuous iteration of virtual reality (VR) technology has driven the digital transformation of education,and its application in physics experiment teaching has gradually become a research hotspot. However,existing consumer-grade VR devices are limited by their tracking nodes; they fail to realize natural and smooth full-body motion reconstruction,leading to insufficient user immersion,discontinuous interaction experiences,and even visual discomfort (e.g.,motion sickness caused by conflicts between visual and vestibular perceptions). These issues severely restrict the application of VR systems in high-demand immersive physics experiment scenarios that require precise interactions and strong sense of presence. This study aims to 1) address the technical bottlenecks of poor full-body motion reconstruction and low interaction fidelity in current VR-based physics experiments; 2) optimize the biomechanical rationality,motion naturalness,and interaction accuracy of virtual embodiments while achieving dynamic proportion calibration for users with different body types and consistency adjustment for cross-platform models; 3) explore the mechanism by which virtual embodied interaction influences user experience,realizing the synergistic optimization of immersive experience enhancement and physiological comfort (i.e.,reducing motion sickness); and 4) provide a theoretical basis and practical guidance for the future implementation of multiuser collaborative virtual embodied interaction in the field of immersive physics education.
To achieve these objectives,this study proposes a virtual embodied motion-solving framework that integrates three core technologies: bone retargeting,inverse kinematics (IK),and data-driven motion matching. First,a hierarchical 3D human skeletal structure model is constructed. This model divides the human body into two biomechanically distinct subsystems,namely,spinal composite chains (pelvis-vertebrae-neck-head) and limb chains (upper limbs: shoulder-upper arm-lower arm-hand; lower limbs: pelvis-thigh-shank-foot),and adopts vertex skinning technology with blend shapes to avoid unnatural joint deformation caused by traditional linear blend skinning. For bone retargeting,a dual-calibration mechanism is designed. Global proportion calibration uses position data from head-mounted displays and hand controllers to calculate vertical and horizontal scaling factors; it adjusts the root joint position to match the user’s overall proportion while maintaining foot-ground contact. Local skeletal chain calibration adjusts the length of individual segments in five key chains (spinal chain,two arm chains,and two leg chains) while preserving internal length ratios to adapt to local body differences. For IK solving,a segmented strategy is adopted. An improved Gauss-Seidel algorithm (with joint angle constraints and multithreaded acceleration) is used for the head-spine composite chain to ensure stable convergence. A geometric analytical method with physiological limits (e.g.,elbow flexion 0°-150°) is applied to limb chains to avoid nonphysical phenomena,such as limb penetration. Meanwhile,a hybrid hand control scheme (integrating repositioning and motion correction) on the basis of the OpenXR skeleton system is implemented to ensure fine interaction accuracy. For data-driven motion matching,an animation database is built using an Xsens motion capture system; this database covers diverse gaits,speeds,and turning motions with key features,such as joint position and foot contact state. Real-time frame matching (via hierarchical indexing) and motion smoothing (via inertial interpolation) are realized to compensate for insufficient lower-limb tracking data. For evaluation,64 healthy college students from Beijing Normal University (31 males and 33 females aged 18-40,with no prior virtual embodiment experience) are stratified into an experimental group (using the improved virtual embodied interaction model) and a control group (using meta movement-based virtual embodiment) on the basis of scores from the visually induced motion sickness susceptibility questionnaire (VIMSSQ). The experiment is conducted on a hardware platform that has an Intel i7-12700F processor,NVIDIA RTX 3070 graphics card,and Meta Quest 3 HMD,and scenes are developed in Unity 2021.3.32f1c1 (frame rate > 90 frame/s to meet real-time requirements). Participants are asked to complete three basic tasks (i.e.,sitting on a chair,picking up a cup,button interaction with left/right hands) and a momentum-conservation physics experiment. Objective data (task completion time and completion rate) and subjective data (obtained via the embodiment questionnaire (EQ),igroup presence questionnaire (IPQ),and simulator sickness questionnaire (SSQ)) are collected and analyzed using MATLAB R2022b,Origin 2024b,and SPSS 27 (including independent samples t-test,Mann-Whitney U test,Pearson correlation,and multiple linear regression).
Comprehensive experimental results verify the effectiveness of the proposed framework. In terms of quantitative task performance,Task 1 (sitting) has both groups achieve 100% completion rate,with similar average times (experimental group: 32.25 s; control group: 32.85 s). In Task 2 (cup picking),the experimental group has a shorter average time compared with the control group (30.78 s vs. 32.00 s) and a stable completion rate (90% vs. 95%). Task 3 (button interaction) reveals the experimental group’s advantage,especially in nondominant left-hand operations (average time: 36.45 s vs. 38.36 s; completion rate: 70% vs. 55%). In terms of subjective experience,the EQ results show that the experimental group has significantly high scores in agency (p = 0.003,Cohen’s d = 1.028) and self-location (p = 0.037,Cohen’s d = 1.272) but no significant difference in ownership. The IPQ results indicate that the experimental group scores significantly high in general presence (p = 0.032),involvement (p = 0.012),and overall immersion (p = 0.045). Multiple linear regression (R² = 0.543,p < 0.001) shows that the experimental group has low SSQ scores (β = -0.495,p < 0.001); the IPQ scores negatively predict motion sickness (β = -0.493,p = 0.017). The interaction terms (VIMSSQ × Group,β = -0.365,p = 0.024; IPQ × Group,β = -0.326,p = 0.026) confirm that the framework weakens the effect of motion sickness susceptibility and strengthens immersion’s mitigating effect on discomfort.
The proposed virtual embodied motion solving framework effectively addresses the technical limitations of current VR-based immersive physics experiments. By integrating bone retargeting,IK,and data-driven methods,it substantially enhances the biomechanical rationality (avoiding nonphysical phenomena,such as limb penetration),motion naturalness (via hierarchical skeletal modeling and inertial interpolation),and interaction accuracy (through hand optimization and local chain calibration) of virtual embodiments. The framework improves users’ embodiment sense (especially agency and self-location),immersion,and spatial motion perception and reduces visual discomfort via a dual-path mechanism (direct experience enhancement through improved presence; compensatory mitigation of motion sickness via strengthened immersion). Future research may focus on three directions: exploring high-precision and personalized virtual embodiment generation (e.g.,physics experiment-specific motion libraries driven by large models),integrating physical laws and environmental factors to enhance interaction authenticity,and optimizing real-time performance for multiuser collaborative scenarios. This technology has broad application prospects in advancing immersive physics education and promoting the popularization of high-quality VR-based experimental teaching.
Cultural relics embody the brilliance of civilization, preserve historical heritage, and uphold the national spirit, serving as vivid manifestations of the confidence and depth of Chinese cultural identity. These artifacts are not merely historical remnants; they are living testaments to a nation’s cultural consciousness and aesthetic achievements. In the Chinese context, such artifacts encompass a wide array of forms——ceramics, bronzes, calligraphy, painting, architecture, and intangible heritage such as folk music and traditional theater——which jointly form a rich, continuous narrative of human development and collective memory. Through their material and symbolic importance, these cultural elements reflect and reinforce a shared sense of belonging and historical continuity. With the rapid development of artificial intelligence (AI), now empowering a broad spectrum of industries and becoming deeply integrated into everyday life, the field of cultural heritage is undergoing a fundamental transformation. This transformation is not only technical but also conceptual, redefining how we understand, protect, and interact with our cultural legacy. AI no longer functions solely as a tool for automation or computation; it now plays a central role in knowledge production, decision-making, and creative processes. These capacities are driving a paradigm shift in cultural heritage work——from reactive, static models to proactive, adaptive systems powered by data and learning. The cultural heritage sector, historically reliant on manual preservation, scholarly interpretation, and traditional dissemination methods, is currently being transformed by advanced algorithms, machine learning models, and intelligent data processing frameworks. The profound capabilities of AI——in areas such as image recognition, natural language processing (NLP), data mining, semantic segmentation, and 3D reconstruction——are increasingly being leveraged to support the digitization, restoration, analysis, management, and public engagement of cultural heritage. These developments, driven by advancements in artificial intelligence, are poised to reshape the entire lifecycle of cultural relics—from their initial discovery and documentation to their long-term preservation and dynamic presentation to the public. The key challenge that currently arises—and forms the central concern of this paper—is the effective, responsible, and innovative application of AI within the cultural heritage field. While the potential of AI is undeniable, its implementation must be carefully aligned with the values, sensitivities, and interdisciplinary nature of cultural preservation. In particular, the complex materiality, symbolic importance, and contextual uniqueness of cultural relics demand AI approaches that are interpretable, ethical, and inclusive of human expertise. Ethical considerations, such as bias in training data, the risks of over-reliance on automated interpretations, and the protection of indigenous knowledge systems, must be at the forefront of AI deployment in cultural domains. This paper explores five critical dimensions of AI applications in the cultural heritage sector: prevention, preservation, research, management, and utilization. The five aspects collectively form a holistic framework for understanding how AI technologies can support the sustained vitality and accessibility of cultural resources. In terms of prevention, AI can play a crucial role in developing early warning systems to identify environmental changes and potential threats to cultural relics. By integrating sensor networks with AI-driven monitoring tools, institutions can proactively detect fluctuations in humidity, temperature, light exposure, and other environmental factors that may contribute to material deterioration. Additionally, predictive models based on historical data can be employed to forecast risks and guide strategic conservation efforts. For instance, machine learning algorithms have been employed in several European museums to predict mold outbreaks in organic cultural relics based on microclimatic data, enabling timely interventions. In terms of preservation, AI contributes to digital restoration, 3D reconstruction, and non-invasive diagnostics. For example, deep learning models can help reconstruct missing parts of fragmented murals or manuscripts by learning visual patterns from intact sections. Additionally, hyperspectral imaging combined with AI analysis can uncover faded texts or underdrawings that are invisible to the human eye. These technologies not only extend the physical lifespan of cultural relics but also introduce innovative approaches to virtual preservation. Some institutions are already using AI in the reconstruction of historical architecture through photogrammetry and simulation of ancient environments for educational use. In the domain of research, AI notably enhances the capabilities of scholars to extract knowledge from vast, heterogeneous datasets. Natural language processing facilitates the digitization and analysis of ancient texts, while computer vision supports the classification of cultural relics based on style, origin, and function. Semantic knowledge graphs and AI-assisted databases promote cross-referencing across disciplines and collections, fostering highly integrated and interdisciplinary research outcomes. These tools are proving essential in digital humanities projects that aim to map large cultural corpora or trace stylistic influences across time and geography. The management of cultural heritage institutions and resources also benefits substantially from AI. Intelligent information systems can optimize inventory tracking, automate metadata tagging, and streamline exhibition logistics. Recommendation systems can be tailored to guide curatorial decisions and enhance user interaction. AI can also help balance conservation needs with public access by dynamically regulating visitor flow in sensitive exhibition areas. Moreover, the integration of blockchain with AI for provenance tracking is emerging as a promising area, enhancing the security and transparency of cultural relic records. In terms of utilization, AI is reshaping how cultural heritage is accessed and experienced—particularly in education, tourism, and public engagement. Virtual museums, intelligent chatbots, augmented reality (AR), and personalized content delivery are making cultural experiences highly interactive and accessible. AI-generated reconstructions and immersive simulations allow audiences to engage with history in immersive ways, expanding the reach of cultural heritage to new demographics and global audiences. Platforms such as Google Arts & Culture, along with various national museum initiatives, are increasingly leveraging AI for context-aware storytelling and multilingual access, making culture more inclusive and dynamic. Beyond practical applications, this paper also examines how traditional research methodologies are evolving in response to AI integration. The paper highlights the epistemological shifts occur as cultural interpretation moves from purely human-centered approaches to hybrid models that combine human expertise with computational inference. While AI presents powerful tools, it also raises critical questions about authenticity, authorship, and cultural sovereignty——especially when applied across diverse cultural contexts and communities. The co-construction of meaning between human curators and intelligent systems may enrich interpretations, but it also demands careful calibration of roles and responsibilities. Overall, the integration of AI into the field of cultural heritage presents an unprecedented opportunity and a profound responsibility. As we navigate this new landscape, balancing technological innovation and cultural sensitivity is essential, ensuring that AI serves as a tool for cultural empowerment, rather than erasure. This paper ultimately offers insights into the current landscape and future trajectory of AI in cultural heritage, advocating for collaborative, interdisciplinary efforts to harness the potential of AI while honoring the depth, diversity, and dignity of the world’s cultural legacies.
In recent years, single-object tracking in satellite videos has gained substantial attention and plays a pivotal role in military and civilian domains. This tracking has found applications in urban-scale disaster relief, public security surveillance, and the monitoring of emergency events, among others. However, due to a combination of factors, such as small target size, interference from similar targets, motion blur, and complex backgrounds, single-object tracking in satellite videos presents numerous challenges. Aiming to promote further exploration in this domain by scholars domestically and internationally, this paper comprehensively reviews and critically analyzes the current state of the art in satellite video-based single-object tracking. Considering challenges and advantages, video satellites offer an expansive field of view. Targets such as vehicles typically occupy only a few to a dozen pixels in satellite videos, with limited distinguishing features or textures. Additionally, satellite videos contain many targets, and the distinguishability between the targets of interest and interfering objects is poor, presenting a high degree of similarity. Moreover, target blurring may occur due to their rapid target movement or satellite platform jitter. When the moving target is inconspicuous and background information overshadows target features, tracking failure is likely to occur. However, compared to ground-based or low-altitude videos, satellite video-based object tracking offers certain advantages. For example, external factors related to the target, such as the camera perspective, are relatively stable, aiding tracking algorithms in maintaining a consistent lock on the target. Most objects in satellite videos are rigid and rarely undergo substantial deformation during tracking. Additionally, the aspect ratios of targets remain approximately consistent across video frames, reducing the potential for algorithmic confusion. The motion of targets is typically straightforward, with trajectories generally following straight lines or smooth curves, enabling the prediction of target positions based on historical motion data. Regarding the development of tracking methods, this paper reviews the evolution of single-object tracking methods for satellite videos and highlights typical tracking paradigms, including generative-based approaches, correlation filter-based methods, and deep learning-based techniques. Deep learning-based tracking methods can be further classified into convolutional neural network (CNN)-based and Transformer-based methods. In contrast to the hand-crafted features employed in correlation filter-based methods, CNNs can extract more comprehensive and robust features, thereby enhancing target tracking performance. In recent years, an increasing number of scholars have applied CNNs to satellite video object tracking tasks. However, when processing high-resolution images, long time-series data, and complex backgrounds, which are common in satellite videos, CNNs exhibit certain limitations. Aiming to address these limitations, Transformers have been gradually introduced into satellite video object tracking. Transformers can capture global spatial information and long-term temporal dependencies, offering a promising alternative for improving tracking accuracy in complex scenarios. Regarding datasets and evaluation metrics, this study compiles existing single-object tracking datasets for satellite videos, along with commonly adopted performance evaluation metrics. Prominent datasets in this field include XDU-BDSTU, video satellite objects(VISO), SatSOT, and the oriented object tracking benchmark(OOTB). Among them, the VISO dataset is the largest in scale, comprising training and test subsets. The XDU-BDSTU dataset features images with a large swath width, making it suitable for long-term tracking tasks. The OOTB dataset provides annotations using rotated bounding boxes, which accurately represents the actual target geometry. The main performance evaluation metrics include precision, success rate, and frame rate, which collectively assess tracking methods in terms of tracking accuracy and speed. Aiming to evaluate the applicability of various tracking algorithms across different scenarios, this paper selects 18 algorithms for performance evaluation and analysis on a self-constructed test set. Experimental results highlight the critical roles of motion estimation, temporal information utilization, and background information exploitation in satellite video object tracking. Specifically, the correlation filter with motion estimation(CFME) algorithm leverages historical motion information of the target to enhance tracking performance, while the Trdimp algorithm incorporates temporal and background information, yielding favorable outcomes. When a vehicle makes a turn, the hand-crafted features employed by the correlation filter-based method CFME lack rotational invariance and are poorly equipped to handle changes in the target’s bounding box due to rotation, resulting in suboptimal tracking performance. Conversely, methods such as Trdimp and Trsiam directly estimate the target’s bounding box, while approaches such as siamese region proposal network(SiamRPN) and SiamRPN++ predefine anchor boxes with different aspect ratios, effectively addressing the challenge of in-plane rotation. Finally, in terms of future perspectives, this paper outlines the anticipated trajectory of single-object tracking algorithms for satellite videos across several key dimensions: standardizing evaluation metrics for tracking results, developing large-scale and high-quality satellite video object tracking datasets, devising models specifically tailored to satellite video tracking challenges, and enabling robust long-term tracking capabilities. In the domain of general video target tracking, commonly used evaluation metrics include those from the OTB and VOT benchmarks. For satellite video target tracking, scholars predominantly adopt the precision and success rate metrics defined by the OTB evaluation framework. In the OTB metrics for general videos, the precision threshold is customarily set to 20 pixels, and the success rate is evaluated based on the area under the curve (AUC) of the overlap score. However, in satellite video target tracking, researchers often adopt varying threshold settings, which hinders the objective evaluation of algorithms under a unified standard. Thus, standardizing evaluation metrics for tracking results is essential for the advancement of satellite video single-object tracking. Before the emergence of large-scale test datasets, most studies in satellite video object tracking verified algorithms using only a few targets, which restricted comprehensive algorithm performance assessment. Moreover, the use of different test dataset across studies has further hindered direct comparisons between algorithms. Consequently, the development of large-scale, high-quality satellite video object tracking datasets is urgently needed, not only for effective model training, but also for model testing and performance benchmarking. Future research could benefit from rapidly assimilating the latest advancements in general video object tracking domain and adapting them to the unique characteristics of satellite videos. Given the rich background information and the continuous, linear nature of target motion trajectories between adjacent frames in satellite videos, these priors can be fully leveraged to explore global spatial and temporal information, thereby enhancing tracking accuracy. Furthermore, techniques such as knowledge distillation, network pruning, and neural architecture search hold considerable potential for autonomously constructing streamlined, low-complexity models specifically tailored to satellite video single-object tracking. These approaches can enable high-precision, real-time target tracking under constrained computation resources. In contrast to ground-based surveillance videos, satellite videos offer broad coverage, making it possible to track trajectories across entire urban areas. However, in such large-scale scenarios, multiple challenges, such as occlusion, interference from similar objects, motion blur, illumination variation, and target rotation, often occur simultaneously. Aiming to address the demands of real-world applications, the development of satellite video tracking algorithms capable of simultaneously addressing these challenges is imperative.
In recent years, large language models (LLMs) have achieved remarkable progress in natural language processing (NLP), demonstrating exceptional capabilities in language understanding and generation. These advancements have driven widespread applications in tasks such as text generation, machine translation, question answering, text summarization, and text classification. However, despite their impressive performance in handling and generating text, LLMs face notable limitations when handling highly complex multimodal tasks, particularly in the domain of video question answering (Video QA). Video QA is a particularly challenging task that requires models to comprehend and generate responses based on dynamic visual content, which often includes temporal and auditory information. Unlike static images or purely textual contents, video data contains inherent temporal dependencies, where the meaning of events and actions unfolds over time. This temporal dimension adds substantial complexity to the understanding process because models must not only interpret individual frames but also maintain coherent understanding across sequences of frames within the broader video context. Consequently, effective Video QA demands advanced temporal information processing capabilities that many LLMs, primarily designed for static text, often struggle to handle adequately. Moreover, the multimodal nature of video, which often involves the integration of visual, auditory, and occasionally textual cues, further complicates the task. Effective Video QA requires the model to seamlessly fuse information across these different modalities, ensuring accurate interpretation and response to questions regarding video content. This process involves understanding visual scenes, recognizing speech or background sounds, and correlating them with the corresponding textual information. The challenge lies not only in processing each modality independently but also in establishing meaningful connections between them to generate coherent and contextually appropriate responses. This paper presents a comprehensive review of the current state of research on Video QA models based on large language models. The technical characteristics, strengths, and weaknesses of non-real-time and real-time Video QA models are also investigated. Non-real-time Video QA models typically operate on pre-recorded video content, allowing them to access and analyze the entire video sequence before generating responses. These models can leverage global contextual information, making such models particularly effective for tasks that require video content analysis, such as video summarization or detailed scene interpretation. However, they may struggle with efficiency and scalability, particularly when handling long videos or large datasets. In contrast, real-time Video QA models are designed to process video streams as they are received, increasing their suitability for applications requiring immediate responses, such as live video monitoring or interactive video systems. However, these models must maintain a balance between processing speed and accuracy due to their frequently limited access to the full temporal context of the video. The paper discusses the challenges encountered by these models in maintaining performance under real-time constraints, including efficient computation and prediction capability based on partial information. Additionally, the paper explores the commonly used datasets in Video QA research, highlighting their features, limitations, and the types of tasks they are designed to address. The evaluation of Video QA models is also examined, focusing on the metrics and benchmarks used to assess their performance. Understanding the strengths and weaknesses of different datasets is crucial for advancing the field, helping in the identification of gaps in current research and guiding the development of robust and versatile models. Finally, the paper addresses the extensive challenges and bottlenecks in the field of Video QA, including the difficulties in scaling models to handle large and diverse video datasets, the need for efficient multimodal fusion techniques, and the computational demands associated with video data processing in real-time. The discussion is further extended to consider the potential future research directions in Video QA, with particular emphasis on improving the temporal reasoning capabilities of LLMs, enhancing their multimodal integration, and developing efficient model architectures that can operate effectively under resource constraints. Overall, while large language models have presented new possibilities in the field of video interpretation, considerable challenges remain in adapting these models to the specific demands of Video QA. Through the systematic review of the current advancements and the presentation of the key obstacles and future directions, this paper aims to contribute to the ongoing efforts to develop highly capable and intelligent multimodal AI systems. The field must continue innovations in the following areas: temporal modeling, where novel architectures that can effectively capture long-range dependencies in video sequences are needed; multimodal representation learning, where sophisticated approaches for integrating visual, auditory, and textual features could yield substantial improvements. Furthermore, the development of highly efficient training paradigms that can address the computational intensity of video processing while retaining model performance is essential for practical applications. Another critical area for future work focuses on the creation of highly comprehensive and challenging benchmark datasets that effectively reflect real-world scenarios, pushing the boundaries of what current models can achieve. As research in this area progresses, addressing these challenges will be crucial for realizing the full potential of LLMs in video interpretation applications. Achieving this goal will require AI systems that can interpret and reason about dynamic visual content with a level of proficiency comparable to human cognition. The integration of advanced techniques from computer vision, speech processing, and natural language understanding will be pivotal in developing truly multimodal systems capable of managing the complexity and variability in real-world video data. Through continued innovation and interdisciplinary collaboration, the field can overcome current limitations and drive the development of next-generation video understanding technologies with broad applicability across domains such as education, entertainment, surveillance, and human-computer interaction.
In recent years, deep learning networks for point clouds have achieved remarkable advancements, with their robust semantic understanding capabilities propelling research across the entire field of three-dimensional (3D) computer vision. These advancements have enabled accurate and efficient processing of 3D data, supporting applications in autonomous driving, robotics, remote sensing and mapping, and augmented reality. However, 3D point clouds often exhibit complex transformation symmetries, with rotation being a particularly challenging yet critical factor. The spatial coordinates of point clouds, which are the fundamental input to point cloud networks, undergo substantial changes, resulting in feature output variations. However, the semantic information embedded within point clouds theoretically remains consistent under various rotational transformations. This spatial variability substantially impacts the stability and reliability of conventional point cloud deep learning networks in semantic perception tasks, such as recognition, classification, and segmentation, reducing their effectiveness in real-world scenarios characterized by arbitrary orientations and poses. Early studies primarily relied on rotational data augmentation to enhance the robustness of point cloud networks against rotational variations. While data augmentation can improve generalization to some extent, it falls short of addressing the fundamental issue posed by the infinite and continuous nature of the rotation group. Acknowledging these limitations, an increasing number of researchers have shifted their focus toward designing rotation-invariant point cloud deep learning networks, which aim to mitigate the impact of rotation on feature extraction at the architectural level. Therefore, researchers seek to achieve consistent semantic perception regardless of point cloud orientation, thereby enhancing the applicability of deep learning models in real-world scenarios where data can be encountered in arbitrary poses. This paper presents a comprehensive survey of the current state of research on rotation-invariant point cloud networks. The research background is first outlined to highlight the importance of rotation invariance in 3D vision tasks and the challenges posed by rotational symmetries in point cloud data. Then, a systematic categorization of the prevailing mainstream methods is investigated. Particularly, the rotation-invariant point cloud networks can be broadly classified into the following three categories: 1) geometric-guided rotation-invariant methods: Using the traditional geometric analysis algorithms, these methods extract rotation-invariant geometric representations such as relative distances, angles, local reference frames, and canonical poses. These representations are then integrated into point cloud networks, facilitating learning of high-level semantic features and maintaining robustness to rotational transformations simultaneously. 2) Feature-guided rotation-invariant methods: These methods employ rotation-equivariant point cloud networks to extract point cloud representations that contain shape and pose information. Leveraging the inherent principles of equivariant networks, they subsequently remove the pose information from the rotation-equivariant representations, obtaining rotation-invariant point cloud features. 3) Training-guided rotation-invariant methods: These methods focus on designing sophisticated and highly generalizable rotational data augmentation training schemes, allowing non-rotation-invariant point cloud networks to gradually acquire robustness of rotations and achieve stable performance simultaneously. An in-depth analysis of the core concepts and algorithmic improvements that support these methods is provided for each category. The current research content on this issue and methodologies within the academic community are outlined, and the advantages and disadvantages of each method are summarized and compared. Subsequently, a comprehensive overview of the prevalent downstream tasks in the research of rotation-invariant point cloud networks is presented. These tasks include point cloud classification, point cloud segmentation, and point cloud retrieval. For each of these tasks, an in-depth discussion of the commonly employed datasets and evaluation metrics, which are essential for assessing network performance, is provided. Additionally, the quantitative performance metrics of mainstream rotation-invariant point cloud networks applied to these tasks are summarized and analyzed, offering a comparative perspective on their efficacy and robustness under rotational variations. Afterward, the downstream application prospects of rotation-invariant point cloud deep learning networks, including point cloud self-supervised representation learning, end-to-end point cloud registration, and point cloud completion, are examined and summarized. Finally, an outlook on future developments and research hotspots is presented. In addition to the ongoing development of new rotation-invariant point cloud networks, three primary issues warrant further research: 1) discrimination of effective geometric attributes. Current approaches are limited by the design of geometric attribute extraction algorithms. An in-depth discussion and determination of the effectiveness of different rotation-invariant geometric attributes within deep learning frameworks could yield novel insights and foster the development of innovative strategies to advance this field. 2) Highly integratable rotation-invariant mechanism. On the one hand, existing non-rotation-invariant point cloud networks continue to demonstrate strong performance on aligned data. The challenge lies in incorporating rotation invariance into these networks in a straightforward manner degrading their original performance. This challenge remains a key research topic because seamless integration requires innovative architectural designs and methodological approaches. On the other hand, rotation-invariant point cloud networks should also exhibit simplicity and reusability, enabling their direct application to downstream tasks with minimal adaptation. 3) High computational efficiency in invariant feature extraction modules. Although many existing methods demonstrate commendable performance, they often incur substantial time and computational costs, making it challenging to efficiently process large-scale point cloud data. Therefore, designing more efficient rotation-invariant point cloud networks that maintain robust feature extraction capabilities while minimizing computational overhead is crucial. Addressing the aforementioned challenges will notably enhance the effectiveness and practicality of rotation-invariant point cloud deep learning networks, facilitating their widespread adoption in complex 3D environments. This survey aims to provide researchers in 3D computer vision with a foundational understanding of current methodologies, highlight key challenges, and suggest potential avenues for future research.
Facial age estimation from images constitutes a prominent area of research within the field of computer vision, offering extensive potential applications in fields such as biometrics, digital marketing, healthcare, and human-computer interaction. Despite substantial efforts by numerous researchers in this field, achieving accurate facial age estimation remains a formidable challenge, primarily due to the lack of high-quality, large-scale labeled datasets for facial age estimation. The manual annotation of facial datasets necessitates considerable time and financial costs. Semi-supervised learning has emerged as a promising strategy for solving this problem because it enables the simultaneous utilization of labeled and unlabeled data. However, achieving satisfactory results in the domain of facial age estimation using semi-supervised learning methods is difficult. This difficulty arises from the limited accuracy of the pseudo-labels produced by these methods, as well as their susceptibility to the influence of outlier data. These factors hinder the effective utilization of unlabeled data, consequently limiting overall performance. Aiming to address these challenges, optimizing the capability of the model to extract features is essential. Such improvements will facilitate the effective acquisition of valuable representations from unlabeled data, thereby yielding highly precise pseudo-labels. Additionally, establishing a semi-supervised learning framework that can adeptly manage the challenges associated with outlier data while optimizing the utilization of the unlabeled dataset is crucial. Consequently, this study presents an open-set semi-supervised multi-task approach for facial age estimation.
This research presents the SwinLEDF model to optimize the capability of the model to extract local and global features from facial images. This model is based on the Swin Transformer architecture and integrates local enhanced feedforward (LEFF) modules along with dynamic filter networks (DFNs). The Swin Transformer demonstrates proficient capabilities in capturing long-range dependencies and global characteristics, particularly in the analysis of age-related trends and the overall morphology of facial structures. The LEFF module incorporates non-linear transformations at the feature level, facilitating the identification of local patterns within images or feature representations. This capability is essential for differentiating age-related attributes, including intricate details such as wrinkles and skin texture. The DFN module implements a dynamic filtering operation within the spatial dimension of the model’s output, thereby enhancing model flexibility and adaptability. Furthermore, this research presents an open-set semi-supervised multitask learning algorithm to optimize the use of labeled and unlabeled data. In this algorithm, the model assesses the probability of unlabeled data being classified as outliers by integrating the outcomes of a closed-set classifier and a multi-class binary classifier. Subsequently, the model generates pseudo-labels for non-outlier data that meet a specified confidence threshold. Additionally, the model simultaneously learns to estimate sex, race, and age using labeled and unlabeled data. Through this process, the model learns not only the unique characteristics associated with each specific task but also the interrelationships among gender, race, and age, thereby enhancing the capability of the model to process diverse data and increases its expressive power and robustness. Furthermore, the process enables the effective utilization of unlabeled datasets, addressing the challenge of limited labeled data in the field of age estimation. This study employs an adaptive threshold mechanism and a negative learning strategy to optimize the use of unlabeled data. The adaptive threshold mechanism dynamically adjusts the confidence threshold for pseudo-labels based on the model’s training performance across different categories, effectively addressing category imbalance and improving the precision of pseudo-label production. The negative learning strategy enhances the handling of unlabeled data by identifying categories to which the input data does not belong, thereby mitigating the adverse effects of false pseudo-labels on model performance.
This study assesses the proposed methodology using the MORPH and UTKface datasets. On the MORPH dataset, the model exhibits a mean absolute error (MAE) of 1.908 when trained solely on labeled data. This error is further reduced to 1.885 with the inclusion of labeled and unlabeled datasets. Similarly, for the UTKface dataset, the initial MAE is recorded at 4.343 using only labeled datasets, which subsequently reduces to 4.246 following the integration of labeled and unlabeled datasets. Compared to current facial age estimation methods, the proposed approach exhibits superior performance and further optimizes its accuracy by leveraging unlabeled facial datasets.
This study introduces an open-set semi-supervised multi-task learning method for facial age estimation. The proposed method effectively extracts gender, race, and age attributes from facial images while leveraging unlabeled data and appropriately handling potential outliers. This approach addresses the challenges associated with limited labeled data, thereby enhancing the accuracy of facial age estimation. Furthermore, the methodology presents innovative strategies for achieving precise results and holds strong potential for practical applications.
Most existing vision-based rail defect detection methods face challenges such as high parameter counts, computational complexity, slow detection speeds, and limited accuracy. Aiming to overcome these limitations, this paper introduces a lightweight pyramid cross-attention network (LPCANet) for orbital image defect detection using RGB images and depth images.
LPCANet adopts MobileNetv2 as its backbone network to extract multiscale feature maps from RGB images. Simultaneously, a lightweight pyramid module (LPM) is employed to extract similarly-sized feature maps from depth images. Each stage of the LPM comprises a sequence of operations including max pooling, a 3 × 3 convolutional layer, batch normalization, and ReLU activation, enabling efficient extraction of features from depth images. By leveraging deep learning, RGB-D technology, and salient object detection, LPCANet efficiently extracts multiscale feature representations from RGB and depth data. The LPM handles depth image features, while the backbone captures detailed pyramid features from RGB images. Subsequently, a cross-attention mechanism (CAM) is applied to integrate the feature maps from both modalities, enhancing the network’s focus on relevant defect regions. Additionally, a spatial feature extractor (SFE) is introduced to further boost defect detection performance. Finally, a “pixel shuffle” operation is used to restore the output to the original image resolution.
The proposed scheme was computationally evaluated using the PyTorch library in an environment equipped with an NVIDIA 3090 GPU, alongside several benchmark models for comparison. For the evaluation of LPCANet, three publicly available unsupervised RGB-D rail datasets were used: NEU-RSDDS-AUG, RSDD-TYPE1, and RSDD-TYPE2. Experimental results on the NEU-RSDDS-AUG dataset indicate that LPCANet achieves excellent efficiency, with 9.90 million parameters, a computational complexity of 2.50 G, a model size of 37.95 MB, and a running speed of 162.60 frames per second. Compared to 18 existing rail defect detection schemes, LPCANet exhibits superior lightness in performance. In particular, when compared against CSEPNet, the current best-performing model, LPCANet achieves improvements across several evaluation metrics: +1.48% in Sα, +0.86% in intersection over union (IOU), +0.14% in Fβmax, +0.03% in mean average precision (mAP), and +1.77% in mean absolute error (MAE). An ablation study was conducted on four upsampling methods (interpolation, transposed convolution, patch merging, and “pixel shuffle”) to evaluate their effectiveness within the LPCANet framework. Among these, the “pixel shuffle” method demonstrated clear advantages and was found to be the most suitable for the LPCANet model. Further ablation studies were conducted on four different components (backbone network, LPM, SFE, and CAM). The results indicate that CAM and SFE notably enhance the detection performance of LPCANet. An in-depth analysis of various backbone networks confirmed that LPCANet model is not only compatible with existing backbone networks but also consistently achieves superior detection results. Aiming to evaluate the model’s generalization capability beyond rail datasets, experiments were also conducted on three non-rail defect datasets: DAGM2007, MT, and Kolektor-SDD2. The results show that LPCANet delivers improved performance across three key metrics: mAP, MAE, and IOU, demonstrating its potential for general-purpose defect detection tasks.
The LPCANet model proposed in this study effectively combines the advantages of traditional and deep learning approaches, demonstrating strong practical value in the field of rail defect image processing. In the future, this scheme will focus on further reducing the model size to achieve rapid detection speeds while ensuring further improvements in performance quality.
RGB-D salient object detection (SOD) combines complementary information from RGB and depth images, offering substantially enhanced performance in complex and challenging scenes compared to RGB-only models. This technique has gained considerable attention in the academic community due to its capability to effectively capture salient objects by leveraging visual and spatial information. However, existing RGB-D detection models face several key challenges. First, efficiently utilizing and fusing multi-modal information from RGB and depth inputs remains a difficult task due to the inherent differences between the two modalities. RGB images provide rich color and texture details but lack depth information, whereas depth maps offer spatial cues but are often noisy or of low quality. Second, achieving accurate boundary detection is particularly challenging in cluttered or noisy environments. Noisy depth maps and cluttered backgrounds can obscure object contours, making it difficult to predict sharp and precise boundaries. These challenges highlight the urgent need for a robust model that can effectively integrate RGB and depth information while simultaneously addressing noise and enhancing boundary precision.
Aiming to address these challenges, a novel method, the cross-modal feature fusion and detail-enhanced RGB-D salient object detection network (CFADNet), is introduced. The proposed network incorporates two innovative modules: the cross-modal attention fusion enhancement module (CAFEM) and the boundary feature extraction module (BFEM). The CAFEM is designed to enhance the integration of RGB and depth features by leveraging attention mechanisms that emphasize the most informative aspects of each modality. Specifically, channel attention is applied to the RGB features to suppress noise and enhance critical color and texture details. Similarly, spatial attention is applied to the depth features to emphasize spatial regions that are relevant for salient object detection. This attention-based fusion mechanism ensures that the model effectively retains global semantic information from the depth map while preserving fine-grained details from the RGB image. The fusion process is structured in multiple layers, progressively integrating features at different scales to fully utilize the complementary strengths of RGB and depth modalities. In contrast, the BFEM is specifically designed to improve the accuracy of salient object boundaries. Accurate contour detection is crucial for generating high-quality saliency maps; thus, BFEM leverages low-level CNN features, which are rich in edge and texture information. These features are refined through channel attention, which filters out noise and irrelevant details, enhancing the clarity of boundary-related cues. The refined features are then used to guide cross-modal feature decoding, ensuring that the final saliency maps exhibit sharp and accurate boundaries. By combining the edge-extraction capabilities of low-level CNN features with the semantic richness of cross-modal features, BFEM notably improves boundary precision in RGB-D salient object detection.
Aiming to evaluate the performance of CFADNet, extensive experiments are conducted on four widely used RGB-D salient object detection datasets: NJU2K, NLPR, STERE, and SIP. These datasets encompass a wide range of diverse and challenging scenes, making them ideal for evaluating the generalization capability of the proposed model. CFADNet is compared against 16 state-of-the-art RGB-D salient object detection methods, including DCF, CIRNet, and CAVER, using standard quantitative metrics such as mean absolute error (MAE), F-measure(Fβ), and structural similarity (Sα). CFADNet demonstrated superior performance across all datasets, particularly excelling in the MAE metric. Specifically, this network outperformed the second-best method by 6.9%, 10.5%, 9.7%, and 2.4% on the NJU2K, NLPR, STERE, and SIP datasets, respectively. These substantial improvements highlight the effectiveness of the attention-based fusion strategy and edge refinement mechanisms. Furthermore, CFADNet consistently achieved higher F-measure and Sα scores, indicating that the model not only reduces pixel-level errors but also more accurately preserves the overall structure and shape of salient objects compared to competing methods. In addition to quantitative evaluations, qualitative comparisons are conducted to visually assess the performance of CFADNet in various challenging scenarios. Results show that the proposed method generates saliency maps with sharp and accurate boundaries, even in cases where salient objects exhibit complex edges or are embedded in cluttered and noisy backgrounds. This finding demonstrates the robustness of CFADNet in handling difficult scenes by effectively separating salient objects from their background while preserving fine boundary details. The visual results further confirm that CFADNet successfully captures global semantic information and local detail, ensuring accurate identification and clear isolation of salient objects from the background.
This paper presents CFADNet, a cross-modal feature fusion and detail-enhancement network for RGB-D SOD, designed to address the two major challenges: effective multimodal feature fusion and accurate boundary detection. CFADNet introduces two novel modules, the CAFEM and the BFEM. CFADNet effectively integrates RGB and depth information while notably enhancing the precision of salient object boundaries. The attention mechanisms used in the CAF0EM enable the network to fully leverage the complementary information from RGB and depth modalities. Simultaneously, the BFEM module focuses on refining edge details, resulting in sharper and more accurate saliency predictions. Extensive experiments conducted on four benchmark datasets demonstrate that CFADNet consistently outperforms existing state-of-the-art methods, achieving superior performance across key evaluation metric, including MAE, F-measure, and structural similarity index. These findings highlight the robustness and strong generalization capability of CFADNet in diverse and challenging environments. By combining attention-based feature fusion with effective edge refinement, CFADNet emerges as a powerful and reliable solution for RGB-D salient object detection into complex scenarios. Future research could explore extending this approach to other multi-modal tasks, such as RGB-Thermal or multi-spectral image processing, where challenges related to multi-modal fusion and boundary detection are also prevalent. Additionally, optimizing the computational efficiency of CFADNet for real-time deployment represents a potential research direction, enabling its application in time-sensitive applications such as autonomous driving and robotics.