Home Journals Articles Updates About
CN
image
收藏切换
DEMA-3D TSP: An Enhanced Reinforcement Learning with DEMA Attention in Sequence Optimization for Safflower Picking Robot
收藏切换
PDF
Menghao LI1, Xiaorong WANG1, 2, 3, Zihe LIU1, Mengyu DUAN1, Zhengyang JIN1
Smart Agriculture | 2026, 8(2) : 200 - 219
Less
收藏切换
Smart Agriculture | 2026, 8(2): 200-219
• Intelligent Equipment and Systems •
DEMA-3D TSP: An Enhanced Reinforcement Learning with DEMA Attention in Sequence Optimization for Safflower Picking Robot
Full
Menghao LI1, Xiaorong WANG1, 2, 3, Zihe LIU1, Mengyu DUAN1, Zhengyang JIN1
Affiliations
  • 1.School of Mechanical Engineering, Xinjiang University, Urumqi 830017, China
  • 2.Agriculture and Animal Husbandry Robot and Intelligent Equipment Engineering Research Center of Xinjiang Uygur Autonomous Region, Urumqi 830017, China
  • 3.Engineering Training Center of Xinjiang University, Urumqi 830017, China

    • LI Menghao, E-mail:

Published: 2026-03-30 doi: 10.12133/j.smartag.SA202506004
Outline
收藏切换

[Objective] There are several critical challenges in automated safflower harvesting, particularly the inefficiencies in path planning, suboptimal route quality, and limited decision-making capability under dynamic and complex environments. To solve these issues, the problem was formulated as a three-dimensional traveling salesman problem and an enhanced reinforcement learning model named actor-critic reinforcement learning pointer network (AC-RL-PtrNet) was proposed, specifically designed for deployment on intelligent safflower picking robots in agricultural settings. [Methods] First, to address the inherent limitations of conventional attention mechanisms in dynamic environments with complex spatial structures, an enhanced attention module was proposed based on the dynamic exponential moving average framework. By combining multi-head attention, spatial distance encoding, and adaptive exponential smoothing, the improved design allowed the model to better capture long-range dependencies and spatial context among safflowers. Meanwhile, to minimize computational cost while preserving inference quality, a structured pruning approach was adopted, which selectively removed redundant connections in the long short-term memory gates and fully connected layers. In parallel, the critic network was redesigned to improve learning stability and accuracy. This was achieved through the inclusion of batch normalization, residual feature aggregation, and a multi-layer value estimation head, all of which contributed to a tighter actor-critic synergy during policy training. [Results and Discussions] To quantitatively assess the impact of each component, ablation experiments were conducted across various configurations. The results confirmed that each module contributed distinct benefits, while their combination yielded the highest improvements in both planning precision and inference efficiency. This coordinated actor-critic design effectively enhanced both trajectory quality and decision stability, which were critical in sequential robotic picking tasks. Experimental results also demonstrated that, compared with traditional swarm intelligence algorithms particle swarm optimization (PSO), ant colony optimization (ACO), and non-dominated sorting genetic algorithm, the proposed AC-RL-PtrNet model achieved a planning time improvement ranging from -2.63% to 61.87% on the 25-target dataset and from 22.93% to 59.1% on the 31-target dataset. Meanwhile, the optimized paths were significantly shortened across different planning instances, indicating robust generalization capability under varied problem scales. Furthermore, field experiments provided concrete validation of the model's practical applicability. When deployed on a mobile picking robot in real safflower fields, the AC-RL-PtrNet achieved a 9.56% reduction in path length and 5.43% time saved for a 25-target picking task, and a 20.17% path reduction and 29.70% time saving for a 31-target scenario involving a different safflower variety. Overall, these results all indicated that the proposed method exhibited significant advantages in enhancing path planning efficiency and optimizing path quality. [Conclusions] This study offers a practical solution for achieving efficient and robust automatic picking by safflower picking robots and provides new insights into solving 3D combinatorial optimization problems.

dynamic exponential moving average mechanism  /  structural pruning  /  reinforcement learning  /  3D traveling salesman problem  /  safflower picking  /  robot
Menghao LI, Xiaorong WANG, Zihe LIU, Mengyu DUAN, Zhengyang JIN. DEMA-3D TSP: An Enhanced Reinforcement Learning with DEMA Attention in Sequence Optimization for Safflower Picking Robot[J]. Smart Agriculture, 2026 , 8 (2) : 200 -219 . DOI: 10.12133/j.smartag.SA202506004
Full Text
Less
0 Introduction
Less
Safflower (Carthamus tinctorius L.), a distinctive economic crop with medicinal, culinary, and industrial value, has witnessed a significant increase in its market value[1-3]. As one of the primary producers of safflower, China, particularly the Xinjiang Uygur Autonomous Region (Xinjiang region), has emerged as a core supply center[4, 5]. To enable efficient picking within the plant's growth cycle, mechanized picking has become a prominent focus of research[6-8]. In particular, the application of robotic technologies offers promising solutions for the automated picking of safflower filament[9].
To address the sequencing problem encountered in the picking point planning process of safflower picking robots, it is essential to recognize its inherent similarity to the traveling salesman problem (TSP). The TSP aims to determine the shortest path that visits a set of designated locations exactly once before returning to the starting point[10-12]. Drawing on this principle, a combinatorial optimization model based on the three-dimensional traveling salesman problem (3D TSP) was developed for safflower picking. Traditionally, swarm intelligence algorithms have been widely employed to solve TSP-related problems[13, 14]. UTAMIMA and REINERS[15] proposed a hybrid algorithm combining genetic algorithm (GA), tabu search (TS), and ant colony optimization (ACO), which effectively addressed the path planning problem in multi-field and multi-machine agricultural scenarios. The method reduced travel distance by an average of 16.21% compared to traditional approaches and significantly shortened computation time. GAO et al.[16] proposed an improved particle swarm optimization (PSO) for apple picking robot path planning, which enhanced obstacle avoidance and significantly improved picking efficiency. FANG et al.[17] proposed a spraying path planning method based on the vector modeling method, which effectively ensures full boundary coverage while minimizing redundant overlaps and turning points. This approach significantly improved the operational efficiency and coverage precision of unmanned helicopter pesticide spraying tasks. These algorithms simulated the collective behavior mechanisms observed in nature, enabling them to find near optimal solutions. However, as the number of individuals increases, swarm intelligence algorithms must recompute the path from scratch for each iteration. This leads to low computational efficiency in dynamic environments, rendering them less suitable for safflower picking tasks.
In contrast, reinforcement learning (RL) offers the advantage of offline learning[18,19]. By training on simulated data, RL models can acquire efficient path planning strategies[20]. In the context of safflower picking, RL models can rapidly adapt to changes in the number of target flowers, thereby enhancing picking efficiency, flexibility, and robustness. For example, ZHANG et al.[21] proposed a model-based temporal proximity soft actor-critic algorithm, integrating a long short-term memory (LSTM) model to optimize the maize threshing process by enhancing threshing quality and reducing damage rates. YANG et al.[22] proposed a path planning method for agricultural robots based on an improved RL approach. By integrating a residual network structure with a multi-step temporal difference error mechanism, the method significantly improved real-time decision-making capabilities in dynamic environments. However, its collaborative optimization of perception and obstacle avoidance in three-dimensional complex terrains, such as densely planted crop areas, requires further investigation. LIN et al.[23] developed a path planning framework based on recurrent deep deterministic policy gradient, in which an LSTM structure was used to retain historical state information, and continuous action outputs enabled collision free path generation. This method demonstrated superior obstacle avoidance and path stability under dynamic conditions, although its computational complexity remains relatively high, leaving room for optimization in large-scale picking scenarios. Despite progress in applying deep reinforcement learning to agricultural path planning, several challenges persist in handling complex and dynamic environments, including inadequate state representation, insufficient real time responsiveness, and low training efficiency.
To address these issues, researches have recently begun integrating pointer network architectures with RL[24]. The RL pointer network processes input sequences directly and outputs optimized decision sequences. This not only improves state representation but also leverages offline learning to reduce computational costs during online inference. BELLO et al.[25] were the first who introduced RL via policy gradient methods into pointer networks to TSP in an end-to-end, unsupervised learning setting. GU and YANG[26] proposed a deep learning framework based on pointer networks trained with a hybrid strategy combining supervised learning and reinforcement learning to solve the NP-hard Max-Cut problem. Their results demonstrated that deep neural networks can effectively approximate solutions to large-scale combinatorial optimization problems. However, applying such models directly to safflower picking where target distributions change rapidly still suffers from suboptimal real-time decision making efficiency, primarily due to excessive search space and the resulting computational latency. To address this, LIN et al.[27] proposed an enhanced RL pointer network structure with a refined sequence planning strategy, which effectively reduced the computational burden in high-density environments and improved the rationality of picking sequences. Compared to traditional optimization methods, their approach reduced the average path length by 11.3% and achieved a 2.4× improvement in inference speed, highlighting the efficiency advantages of reinforcement learning in complex agricultural scenarios. Nevertheless, due to the unique growth patterns and picking requirements of safflower, real-world applications still face challenges such as dynamically changing flower distributions and complex picking paths. Although the aforementioned studies have progressively enhanced the performance of RL-based pointer networks in combinatorial optimization tasks, key limitations remain: Excessive path redundancy in dynamic environments, limited spatial search capacity of conventional pointer networks, reduced decision-making efficiency, and prolonged inference time. These issues are particularly critical in robotic safflower picking, where the spatial layout of targets is non-uniform and decision latency directly impacts task success. Moreover, insufficient coordination between the actor and critic networks can lead to unstable training and suboptimal policy convergence.
To address the aforementioned challenges, an actor-critic reinforcement learning pointer network algorithm (AC-RL-PtrNet) was developed for safflower picking scenarios. In this framework, three main enhancements were designed. First, an enhanced dynamic exponential moving average (DEMA)-based attention module with distance encoding was introduced, enabling more effective modeling of both local and global spatial structures among safflower targets. Second, a structured pruning strategy was applied to LSTM gates and dense layers to reduce network redundancy and inference latency, while preserving decision performance under dense or dynamically changing picking configurations. Third, the critic network was restructured with input normalization, compact non-linear layers, and residual connections, allowing more stable value estimation and improved actor-critic optimization during policy learning in complex field environments.
1 Materials and methods
Less
1.1　Data preparation
1.1.1　Safflower picking robot and working principle
In this study, a safflower picking robot based on a parallel robotic arm was employed. The system consists of a high-clearance mobile chassis, a parallel robotic arm, an end effector, a negative pressure safflower filament collection module, a visual recognition system, and a control system. The overall dimensions of the robot are 1 600 mm×1 280 mm×1 400 mm (length×width×height), and the operational workspace of the parallel robotic arm is defined by a cylindrical volume with a radius of 300 mm and a height of 300 mm. The working principle of the parallel safflower picking robot is illustrated in Fig. 1. During each picking task, the robot first identifies and localizes the safflower filament using its vision system and image processing algorithms[28]. The detected coordinates are then transformed from the camera coordinate frame to the robotic arm coordinate frame. Subsequently, the optimal sequence is determined using a path planning algorithm. Finally, as shown in Fig. 1c and Fig. 1d, the robotic arm follows the planned trajectory under the control of the onboard system. The end effector, in conjunction with the negative pressure safflower filament collection module, performs the picking and collection of the safflower filament.
1.1.2　Safflower data
During the safflower picking season from July to September, a field survey was conducted in Jimusaer county, Xinjiang. The investigation revealed that safflower is cultivated in rigid rows, with an inter-row spacing of 600 mm and an intra-row plant spacing of 150 mm, respectively. Within the reachable workspace of a single robotic arm, the number of safflower capitula was statistically found to range between 31 and 50. Based on this, 40 flower heads were chosen as a representative reference for training and evaluation.
Table 1 to Table 3 present the spatial distributions and corresponding coordinate points of 25, 31, and 43 safflower targets, respectively. To construct the dataset, a binocular stereo vision system mounted on an actual safflower-picking robot was employed. As illustrated in Fig. 2, the system first captured RGB images of safflower plants under field conditions. These included scenarios with both occluded and non-occluded safflower heads. The image recognition and localization algorithm then processed the images and computed the corresponding 3D coordinates of each detected safflower head. The recorded values represent the three-dimensional positions (X, Y, Z) of the safflower heads relative to the stereo camera's reference frame. To enhance computational efficiency and enable more stable learning during model training and inference, all spatial coordinates were further normalized to a [0,1] range after acquisition. This normalization ensures consistent input scaling and facilitates the decision-making process of the reinforcement learning model. The resulting dataset serves as a real-world test set that simulates irregularly distributed picking targets, providing a robust benchmark for evaluating the proposed path planning algorithm under complex spatial conditions.
1.2　Combinatorial optimization problem formulation
Input definition: For the three-dimensional traveling salesman problem (3D-TSP), the input is defined as a set of 3D coordinates representing the positions of safflower filaments, denoted as X={x1, x2,…, xN}, where xi=(xi1, xi2, xi3)∈ℝ3 indicates the spatial location of the i-th safflowers.
Output definition: The model aims to output a visiting sequence π=(π1, π2, …, πN), which satisfies the Hamiltonian circuit constraint, that is, each point is visited exactly once and minimizes the total tour length, defined as Equation (1):
L(π)=∑t=1N‖xπt-xπt+1‖2
Where, Lπ denotes the total tour length; N is the total number of points.
Fig. 3 provides a detailed illustration of the process in which the safflower data, serving as the problem input, is processed by a RL pointer network model based on the actor-critic architecture, ultimately resulting in the output of the picking sequence.
1.3　Overview of the RL pointer network based on the actor-critic architecture
In solving combinatorial optimization problems, the integration of RL with pointer networks has demonstrated powerful modeling and decision-making capabilities. This approach adopts an end-to-end learning paradigm, enabling the autonomous exploration of high-quality path planning strategies in unknown environments. This section sequentially presents the LSTM based encoder-decoder architecture, the formulation of the Markov decision process (MDP), the policy gradient method, and the specific implementation of the actor-critic dual network collaborative optimization within this framework.
1.3.1　Encoder-decoder architecture
1) Encoder: Spatiotemporal feature extraction with LSTM traditional sequence modeling methods struggle to capture complex spatial relationships in three-dimensional space. In this study, an LSTM network was employed to process the input state sequence. Leveraging its recurrent structure, the LSTM can progressively integrate spatial neighborhood information across layers[29]. Given an input sequence xi, the encoder generates a sequence representation by recursively computing the hidden states, as shown in Equation (2):
htenc=LSTM(xi,ht-1enc)
Where, LSTM∙ denotes the LSTM network used to update the decoder state; htencdenotes the hidden state corresponding to the t-th coordinate, which captures the contextual information of all picking points from the beginning up to the current step. After processing by the encoder, all hidden states are aggregated into a matrix, which serves as the input for the subsequent attention mechanism and decoding process. The initial hidden state h0enc was set to a zero vector. To determine an appropriate hidden layer dimension, an ablation study was conducted with three configurations: 64, 128 and 256. The models were evaluated based on total training time, best path length achieved, and model size. As shown in Table 4, the configuration with 128 hidden units achieved the best trade-off between optimization quality and computational cost. Therefore, a hidden size of 128 was adopted in the final model design.
2) Decoder: The decoder adopts an attention-driven LSTM structure, which takes as input the output from the previous time step and utilizes the contextual information produced by the encoder to generate an action probability distribution. The initial hidden state of the decoder,d0=hNenc, was set to the final hidden state of the encoder. The decoding process at time step t involves the following steps:
(a) Attention weight calculation is shown in Equation (3) :
ut,i=vTtanh(W1hienc+W2dt-1)
Where, W1, W2∈ℝh×d, v∈ℝd are learnable parameters; hienc denotes the hidden state of the encoder at position; i and d denotes the hidden layer dimension.
(b) Probability distribution generation is shown in Equation (4):
P(πt=iπ1:t-1,X)=softmax(ut,i)
Where, Pπt=i|π1∶t-1, X denotes the probability of selecting node i at step t, conditioned on the previously visited sequenceπ1:t-1 and the input feature set X.
(c) State update is shown in Equation (5):
dt=LSTM(Embedding(πt),dt-1)
Where, dt-1 represents the hidden state of the decoder at the previous time step, and Embedding(⋅) maps the index of the selected node to an embedding vector. To prevent repeated visits, a masking mechanism is employed during the calculation of P(πt=i), where the logits corresponding to already visited nodes are assigned a value of -∞, thereby ensuring that only feasible paths are generated.
1.3.2　MDPmodeling
RL enables agents to interact with their environment to learn optimal strategies. In the context of the TSP, the problem solving process can be formulated as a MDP. Specifically, the state space is defined as the set of unvisited safflower coordinates at each step. For example, the state at time step t is defined as: st={xii∉π1:t-1} indicating the set of nodes not yet visited up to step t. Transitions between states correspond to selecting an unvisited node to visit next. For instance, given the current state st, executing an action (selecting a new target node) results in the next state: st+1=st\{xi}.
In the reinforcement learning framework, the reward function is defined based on the negative Euclidean distance between consecutive nodes, as shown in Equation (6):
rt=-‖xπt-xπt+1‖2
Where, πN+1=π1 represents the return to the starting node. The immediate reward rt denotes the negative squared Euclidean distance between two consecutive nodes. The total return Rπ is the negative sum of travel distances along the path as Equation (7):
R(π)=∑t=1Nrt=-L(π)
Where, L(π) denotes the length of the current path under policy π.
To guide the agent's behavior, a neural network based on parameterized stochastic policy function is adopted as Equation (8):
πθ(atst)=P(πt=iπ1:t-1,X)
Where, X represents the set of all safflower coordinates; πθat|st  denotes the stochastic policy parameterized by θ, which gives the probability of selecting action at under the current state st. The policy outputs a probability distribution over the available actions (unvisited nodes) and determines the likelihood of selecting each one at the current step.
By combining the policy network with a value function estimator, the training is performed using the advantage actor-critic algorithm, which allows for efficient gradient based policy optimization.
1.3.3　Policy gradient method
The policy gradient method optimizes the policy parameters θ directly to maximize the expected cumulative reward. The core idea is to increase the probability of actions leading to high-return trajectories, while suppressing those associated with lower returns. The objective function is defined as the expected return, as shown in Equation (9):
Jθ=EπθRπ
Where,Jθ denotes the expected cumulative reward under policy πθ; θ represents the learnable parameters of the policy network.
According to the policy gradient theorem[30], the gradient can be written as shown in Equation (10):
∇θJθ=Eπθ∑t=1N∇θlog πθatst⋅Qπθst,at
Where, Qπθst,at denotes the action-value function under policy πθ, representing the expected return after taking action at in state st. Since directly computing Q requires trajectory rollout, which is computationally expensive, it is often approximated by the empirical return, as shown in Equation (11):
Qπθst,at≈∑k=tNrk
Thus, the gradient update can be simplified as shown in Equation (12):
∇θJθ≈1B∑i=1B∑t=1N∇θlog πθatisti⋅∑k=tNrki
Where, B is the batch size. However, this estimation often suffers from high variance, which may hinder stable convergence. To mitigate this issue, a baseline function was introduced to reduce variance without biasing the gradient, as expressed in Equation (13):
∇θJθ=Eπθ∑t=1N∇θlog πθatst⋅Qπθst,at-           bst
1.3.4　Actor-critic architecture and policy
To address the complexity of 3D safflower picking, this study adopts a collaborative optimization framework based on the actor-critic architecture. The agent interacts with the environment to continuously improve its policy without requiring accurate labeled data. The overall interaction between the environment, the actor network, and the critic network is illustrated in Fig. 4, which demonstrates the flow of information, decision making, and policy update processes involved in this reinforcement learning framework.
The actor network is implemented using a pointer network, essentially serving as a parameterized policy function responsible for generating the probability distribution over actions for dynamic path planning (as in Equation (4)). In the context of the 3D TSP, the actor leverages the attention mechanism in the decoder (as described in Equation (3)) to capture global spatial features extracted by the encoder. It then combines these features with the current state to produce a prioritized ranking of candidate nodes. Unlike traditional greedy algorithms, the actor selects the next node through probabilistic sampling. For example, during training, a multinomial distribution is used to sample actions, ensuring sufficient exploration of the solution space. The policy gradient signal in reinforcement learning (as defined in Equation (12)) directly influences this probability distribution, increasing the likelihood of actions associated with high-reward trajectories while suppressing the generation of inefficient paths.
The critic network Vϕs functions as an independent evaluation module, responsible for estimating the expected return ERπst under the current state st and policy πθ. Structurally, it resembles the encoder, but employs a parameter separated LSTM network (nonshared with the actor encoder). By aggregating the hidden representations of unvisited nodes (as in Equation (2)), the critic produces a global value representation. A key role of the critic is to provide a dynamic baseline (Equation (3)), which transforms the original Monte Carlo return Rπ into the advantage function, as shown in Equation (14):
Ast,at=Rπ-Vϕst
Where, Ast,at denotes the advantage of taking action at at state st under policy π; Vϕst represents the critic's estimate of the expected return from state st with parameters ∅. This formulation effectively reduces the variance of gradient estimation and enhances the stability of policy optimization.
The critic loss function aims to minimize the mean squared error between the predicted value function Vϕs and the actual expected return, thereby driving Vϕs to approximate the expected return more accurately, as defined in Equation (15) :
Lcritic=1B∑i=1BRπi-Vϕs2
Where, Rπi is the total return of the i-th sampled trajectory.
The actor loss function maximizes the advantage weighted log probability (Equation (16)), adjusting the policy optimization direction based on the advantage value:
Lactor=-1B∑i=1B∑t=1NAπi⋅log πθatisti
Where, Aπi denotes the advantage function of the i-th trajectory; the operator log refers to the natural logarithm applied to the policy probability, which is used to compute the policy gradient in the actor-critic framework.
2 Algorithm improvement
Less
In the original RL based pointer network for path planning, the attention mechanism adopts a classical singlehead linear transformation structure. However, this design suffers from the following issues:
1) Static weight allocation: All safflower positions share the same attention computation logic, making the model prone to focusing on local optima rather than the global optimal path.
2) Limited representational capacity: A single attention head struggles to simultaneously capture efficient traversal patterns in dense regions and the priority features of edge positioned flowers. When the flower density varies significantly in the central region, the traditional mechanism often produces intersecting paths with repeated coverage rates as high as 15%~20%[31].
3) Slow inference and decision making: The model exhibits latency during path generation.
To address these issues, this chapter replaces the original attention mechanism with a DEMA attention, which enhances the model's ability to capture spatial information. Additionally, pruning techniques are applied to the LSTM network to further improve inference efficiency and overall model performance.
2.1　Dynamic exponential moving average attention mechanism
The introduction of the EMA-based attention mechanism enables the model to balance current observations with historical attention trends, thereby enhancing temporal stability, smoothing attention distributions, and improving robustness in dynamic spatial environments[32]. As illustrated in Fig. 5 for the improved DEMA, to improve spatial sensitivity, the improved DEMA attention mechanism incorporates distance encoding directly into the computation process. Initially, the input undergoes multi-head partitioning, during which spatial distance information is embedded to enrich feature representation. This is followed by an adaptive reweighting phase driven by dynamic exponential moving average calculations. Subsequently, a nonlinear projection layer refines the aggregated context into the final attention output. Through the integration of present contextual cues, temporal dynamics, and spatial layout, the module is better equipped to model inter-flower relationships and generate more precise path planning outcomes. The key components of this improved attention pipeline are elaborated in the subsequent subsections.
2.1.1　Redefinition of multi head self attention
The improved attention module divides the embedding dimensions into multiple subspaces, enabling the model to capture diverse environmental features in parallel, such as sharp distributional changes and local density variations. Meanwhile, a dynamic decay parameter is initialized and constrained within a predefined range to balance the influence of the current attention with that of the historical global average attention.
2.1.2　Incorporation of distance encoding
To incorporate spatial topology information into the attention mechanism, a distance-encoding module was introduced. Specifically, the Euclidean distances between flower positions are used as additional inputs, transformed into vector representations through a linear projection, and then fused with the query vectors to compute the attention scores. It is as follows Equation (17):
ψdij=Wd⋅dij+bd∈Rdhead
Where, dij denotes the Euclidean distance between the i-th and j-th safflower positions, Wd represents the learnable projection weight matrix, bd∈Rdhead is the corresponding bias vector.
This design enables the attention weights to reflect not only semantic similarity but also spatial distance, thereby enhancing the model's ability to capture relative positional relationships between flowers in path planning.
2.1.3　Adaptive EMA weight adjustment
Traditional attention mechanisms typically rely solely on the current state to compute attention scores, without incorporating historical statistical information. To address this, an adaptive EMA weight adjustment strategy is introduced, defined as in Equation (18):
EMA_weightst=βt⋅attnt+1-βt⋅attnt¯
where, βt is a dynamic decay factor, and attnt represents the attention scores at the current step. Specifically, attnt¯ represents the attention scores from the previous time step t-1 to make βt responsive to spatial layout variations. It is defined as a function of local target density, as shown in Equation (19):
βt=11+γ⋅ρt
Where, ρt represents the spatial density of picking targets around the current query position at time stept, and γ is a tunable scaling parameter. This formulation allows the model to emphasize past attention in high-density regions (smaller βt) while prioritizing current observations in sparse areas (larger βt), thereby enhancing stability and adaptability in dynamic environments. This EMA-based adjustment balances the current state with past attention trends, enabling the model to adaptively respond to abrupt environmental changes, maintaining a more stable and globally aware attention distribution. This leads to smoother and more effective path planning.
2.1.4　Nonlinear transformation of output
The EMA-adjusted attention scores are used to compute a weighted sum of the value vectors, producing the attention context, as shown in Equation (20):
Contexti=∑jEMA_weightst⋅Vj
Where, Contexti represents the attention context at time step t; EMA_weightst denotes the EMA-adjusted attention weights; Vj refers to the value vectors associated with each input.
The resulting context vector is then passed through a nonlinear transformation using a ReLU activation to enhance feature representation, as shown in Equation (21):
z=ReLUWout1⋅Context+bout1Output=Wout2⋅z+bout2
The terms Wout 1, Wout 2 and bout 1, bout 2 denote the weights and biases of the first and second fully connected layers, respectively. This nonlinear transformation further enhances the feature composition capability, enabling the network to better capture complex inter object relationships in the picking task.
2.2　Network pruning
In recent years, the increasing complexity and computational cost of deep neural network models have become major challenges. To reduce the consumption of computational resources without significantly compromising model performance, network pruning techniques have been extensively studied[33, 34]. Among them, structured pruning has attracted considerable attention due to its ability to directly eliminate redundant structures in the computational graph, thereby facilitating hardware acceleration[35-37]. In this work, a structured pruning method is proposed for the gated architecture of LSTM networks, focusing on pruning the input and output gates. Additionally, L1-based pruning is applied to the fully connected layers, aiming to reduce model parameters and accelerate inference.
2.2.1　LSTM gate importance based pruning strategy
Given the structural characteristics of LSTM components in recurrent neural networks, this pruning strategy selectively targets the input and output gates, where parameter redundancy is notably more prevalent. This decision is grounded in the following theoretical considerations:
(1) Parameter distribution analysis: Examination of the gate weight matrices indicates a heavy-tailed distribution, particularly within the input and output gates, suggesting that many weights contribute minimally to the model's expressive capacity.
(2) Criticality of the forget gate: Empirical evidence from initial tests shows that even small perturbations in the forget gate's parameters can lead to a marked drop in performance, implying that its preservation is essential for maintaining temporal stability.
(3) Functional complementarity: The input and output gates are responsible for encoding and exposing temporal information, respectively. Their interdependent functions permit synchronized pruning without compromising the LSTM's representational capability.
2.2.2　Structured pruning implementation for gate structures
For a given weight matrix W (i.e., Wih or Whh) and the selected gate indices g⊂1,…,4h, the pruning procedure is carried out as follows. First, determine the range of gate indices for the input gate gin=1, …, h and the output gate gout=3h+1, …, 4h.
Next, the pruning threshold is computed. For the selected gate, let Wg denote the corresponding weight parameter vector, and define the pruning ratio. The number of parameters to be pruned is given by Equation (22):
k=α⋅Wg
Where, k is the number of pruned parameters, and α represents the pruning ratio that determines the overall sparsity level.
The pruning threshold τ is computed as the maximum among the smallest k absolute weight values, as shown in Equation (23):
τ=topkw:w∈Wg,k,largest=False-1
Based on τ a pruning mask M is generated as follows, as shown in Equation (24):
Mi=0,if |wi|≤τ,1,otherwise.
Only the parameters within the target gate indices are pruned, while weights outside this scope remain unchanged.
Finally, the weight matrix is updated by applying the pruning mask, so that the pruned weight matrix W' is expressed as:
W'=Wbefore⊕(wg⊙M)⊕Wafter
Where, ⊕ denotes the concatenation of the unpruned segments; ⊙ denotes element wise multiplication.
The pruning operation is applied separately to the input and output gates for both Wih and Whh. Experimental validation shows that the encoder adopts a pruning ratio of 35% for both its input and output gates, while the decoder uses a pruning ratio of 25% for these gates.
2.3　Structural enhancements of the critic network
To further improve the value estimation capability for planned paths, this work introduced structural-level enhancements within the critic network. Although these enhancements do not directly impact the decoder's decision-making process, they play a vital role in supplying more stable, structure-aware prediction signals. This indirectly boosts the learning efficiency of the actor module and enhances the overall synergy of the actor-critic framework.
2.3.1　Enhanced input embedding with normalization mechanisms
To increase the expressive power of the original spatial coordinates in high-dimensional latent space, the critic integrates a normalization-augmented embedding layer at the input stage. Specifically, Batch Normalization is applied to raw inputs, followed by two fully connected layers with ReLU activations. This is further regularized by Layer Normalization and Dropout to improve discriminative power and generalization under spatial variability. The embedding process is formulated as follows, as shown in Equation (26):
x˜i=ReLU(W1xi+b1)ei=LayerNorm(W2x˜i+b2)
Where,xi∈ℝ3 represents the raw coordinate of the inode; ei∈ℝd is the embedded feature; W1, W2 are trainable weights. Layer normalization and dropout jointly stabilize the feature distribution and mitigate overfitting.
2.3.2　Contextual aggregation from LSTM encoder
The critic network adopts the same LSTM encoder as the actor to generate a sequence of hidden representations for the path, as formulated in Equation (27):
H=[h1,h2,…,hn]=LSTM(e1,e2,…,en)
Where H∈ℝB×n×dencodes the entire sequence and hfinal=hn denotes the final hidden state. This serves as a condensed global representation of the path, which is then used as the query in the subsequent attention-based value refinement module.
2.3.3　Lightweight attention-based context fusion
To enhance the critic's sensitivity to critical waypoints along the path, a lightweight attention fusion mechanism is introduced to amplify the response to important spatial cues. This module learns to attend selectively to key positions within the LSTM-encoded trajectory. First, the sequence output H is projected using a 1D convolutional layer to produce reference features, as shown in Equation (28):
Uref=Wref⋅HT
Where, Wref represents the learnable convolutional weight matrix that projects the hidden representations into the reference feature space, while HT is the transposed sequence output obtained from the shared LSTM encoder.
Simultaneously, the query vector hfinal is mapped to the same dimensionality, as shown in Equation (29):
Uq=Wqhfinal
Where, Uq represents the transformed query feature that aligns with the reference feature space, enabling compatibility computation with Uref, Wq denotes the learnable projection matrix used to map the final hidden state into the query space.
A joint compatibility function is then computed via, as expressed in Equation (30):
U=tanh (Uq+Uref)
Attention weights are derived using a learnable vector V∈ℝ1×d, as defined in Equation (31):
α=softmax(V⋅U)
These weights are used to obtain a context vector c via weighted aggregation, as described in Equation (32):
c=∑i=1nαihi
Where,c denotes the context vector obtained through weighted aggregation of all hidden representations. The final output for value estimation is obtained by combining the context vector with the original query and feeding it into a prediction MLP, as shown in Equation (33):
L^=MLP(LayerNorm(c+hfinal))
This design allows the critic to capture both the global structure and local saliency of the path, improving the accuracy of cost prediction and facilitating better guidance for policy updates in the actor network.
2.4　Algorithm learning method
In light of the aforementioned modifications, the improved AC-RL-PtrNet model was employed. Each time a path sequence is generated, the DEMA attention mechanism automatically computes the attention scores, thereby yielding more reasonable picking decisions. The pruning operations also improve the training speed while maintaining model performance with minimal loss. Algorithm 1 outlines the pseudocode for the training process.
In the training task, n is set to 40. The experiments were conducted on a Windows 1 064-bit machine equipped with an NVIDIA GeForce RTX 4060 Ti GPU, an Intel Core i5-14600KF CPU @ 3.5 GHz, and 32 GB of RAM. The implementation utilizes PyTorch 2.0 with CUDA 12.1 under Python 3.12.7. Training samples are randomly generated from [0.1]×[0.1]×[0.1] space. To ensure good generalization performance, the model was trained for 2 000 epochs, with each epoch comprising 10 steps. The batch size B was set to 256 and the initial learning rate was 0.001, with a decay factor of 0.96 applied every 5 000 steps. Both the actor and critic networks were trained via the Adam optimizer to minimize their respective loss functions. To clearly describe the optimization process of the proposed model, the detailed training steps of the actor-critic framework were presented in the below algorithm.
3 Experiments and results
Less
To validate the effectiveness of the proposed model in addressing the safflower picking sequence planning problem, a simulation-based analysis was conducted. The performance of the model was evaluated using metrics such as path length and average runtime. In this chapter, all safflowers coordinates were normalized to enhance numerical stability and mitigate gradient explosion. In section 3.5, the actual three-dimensional picking paths were reconstructed to provide a visual representation of the real trajectories.
3.1　Impact of DEMA on the model
To evaluate the influence of the DEMA attention mechanism on model performance, analyses were conducted during both the training and testing phases. The baseline model refers to the original unmodified network. In the training phase, comparative experiments were carried out with the baseline model, graph attention network (GAT), efficient multi-scale attention (EMSA), seer attention mechanism (SeA), DEMA without distance information (NoDist-DEMA), and the DEMA-enhanced model. Fig. 6 illustrates the convergence curves for these models during training. The results indicate that the DEMA-based model achieves superior improvements in terms of path length compared to the other methods. Moreover, it demonstrates faster convergence at approximately 200 epochs and avoids getting trapped in local optima, thereby attaining a better convergence value. It is noted, however, that increasing the number of training epochs necessitates more training time.
Based on the inherent randomness in the number of safflower picks per run, the model was tested with n=20, 28, 37, and 46 (as shown in Table 5). The results indicate that, for n=20 and n=37, the improved SeA attention mechanism yields path lengths comparable to those of the DEMA-enhanced model. However, in terms of average runtime, the SeA mechanism requires 1.5 to 2 times longer than the DEMA model. In comparison to the baseline model, the proposed approach not only significantly reduces the path length but also nearly doubles the average inference speed. Compared to the NoDist-DEMA variant, which excludes distance encoding, the full DEMA model consistently achieves marginally shorter path lengths and faster inference across all test cases. This demonstrates that integrating distance information enhances both spatial perception and planning efficiency, further validating the design of the DEMA attention mechanism.
As shown in Table 5, the numerical results have demonstrated the performance differences of various attention mechanisms in terms of path length and computation time across multiple test points. To further visualize these differences and highlight the advantages of the proposed method, Fig. 7 presents a color matrix that fully reflects the differences in path planning quality and robustness among various attention mechanisms at different test points. The numerical values in the figure represent the differences in path performance relative to the baseline model, with larger positive values indicating greater improvements. In terms of path length, the DEMA model demonstrates a more substantial enhancement, especially when the number of safflower picking points ranges from 37 to 50, yielding improvements between 0.20 and 0.41 cm. Moreover, the DEMA model consistently maintains deeper color values across most test points, indicating its superior performance in path quality. Although the SeA model exhibits performance comparable to the DEMA model in certain scenarios, Table 5 shows that its runtime is inferior to that of the DEMA approach. These results indicate that the incorporation of the DEMA attention mechanism can significantly enhance both the planning efficiency and the accuracy of safflower picking.
3.2　Impact of pruning on the model
Different pruning strategies based on the importance of the gates were designed and evaluated during both the training and testing phases. In this study, three pruning strategies were compared:
Group A: Both the encoder and decoder input and output gates were pruned by 35%.
Group B: Both the encoder and decoder input and output gates were pruned by 25%.
Group C: The encoder input and output gates were pruned by 35%, while the decoder gates were pruned by 25%.
Table 6 presents the comparative results for these three strategies. Preliminary sensitivity experiments indicated that when the pruning ratio was lower than 25%, the computational benefits were negligible, and when it exceeded 35%, the model experienced severe information loss and degraded performance. Therefore, these three representative configurations were selected for analysis.
Analysis shows that the model under Group A achieves an offline training duration of less than 3 minutes; however, the excessive pruning applied to the decoder in Group A leads to significant information loss, causing the model to become trapped in local optima. In contrast, Group C adopted in this study yields a parameter sparsity of approximately 5.88%, effectively removing redundant information and enhancing training speed by about 15%, while simultaneously reducing model size and inference overhead. Therefore, implementing pruning operations on the LSTM not only optimizes computational speed but also decreases memory usage.
3.3　Ablation study
To further evaluate the individual and cumulative contributions of each proposed enhancement, including the DEMA attention mechanism, the structured pruning strategy, and the improved critic network, an ablation study was conducted. Specifically, four configurations were compared: 1) the baseline model without any enhancement, 2) the model with DEMA only, 3) the model with DEMA and pruning, and 4) the full model integrating DEMA, pruning, and the enhanced critic. To this end, we validated this ablation experiment on test sets with 25, 31, and 43 safflowers.
As shown in Table 7, although the full model exhibits slightly longer inference time compared to the previous variant under the 25-target scenario, it consistently achieves superior performance across other datasets in terms of path length reduction and inference robustness. These results indicate that the proposed model enhancements are well-suited for sequential path planning in safflower picking tasks.
3.4　Comparison with swarm intelligence algorithms
The performance of the proposed model (before and after improvement) was compared with traditional swarm intelligence algorithms, including PSO, the non-dominated sorting genetic algorithm (NSGA), and ACO, in the task of safflower picking path planning. The evaluation was conducted using two test cases with safflower quantities of n=25 and n=31, focusing on metrics such as path length, computational time, and speed improvement.
As shown in Table 8, swarm intelligence algorithms tend to require significantly longer runtimes in real-world deployment scenarios. Using AC-RL-PtrNet as the baseline for improvement rate comparisons, test cases with n = 25 and n = 31 safflowers were evaluated. The proposed model achieved inference speed improvements ranging from -2.63% to 61.87% for the 25-safflower case and 22.93% to 59.10% for the 31-safflower case, along with path length reductions between 4.24% and 61.47%, compared to traditional swarm intelligence algorithms such as PSO, ACO, and NSGA. Improvement rate (%) represents the relative time-saving of AC-RL-PtrNet compared to each method, calculated as (Tmethod-TAC-RL)/Tmethod×100%. A higher value indicates that AC-RL-PtrNet provides a more significant improvement over the other methods. To assess the statistical significance of these improvements, independent two-sample t-tests were performed on 30 repeated runs. The results in Table 8 indicate that this method achieves statistically significant path length reductions over all baselines (p < 0.05), confirming the robustness of the observed gains.
In the test case with 25 safflowers, although the NSGA algorithm achieves a shorter runtime than the improved AC-RL-PtrNet model, the latter yields a 9.56% improvement in path optimization, demonstrating a significantly higher planning efficiency. It is important to note that reinforcement learning operates in an offline training and online inference paradigm. This means that as the number of safflower targets increases, this model does not require retraining for each new instance, unlike swarm intelligence algorithms, which need to re-optimize from scratch for different configurations. This advantage makes this approach more suitable for real-time, responsive applications in safflower picking scenarios.
Furthermore, as shown in Table 8, the AC-RL-PtrNet generates shorter paths than swarm intelligence algorithms in both the n=25 and n=31 test cases, with statistically significant improvements. It reduces the path length by 0.258 and 0.557 cm units compared to the baseline, respectively. Notably, the pruning strategy introduced in this model does not result in significant loss of positional information, thereby achieving a desirable balance between path optimization and inference efficiency.
3.5　Field experiment
3.5.1　Field setup and real-world planning examples
To validate the practical feasibility of the proposed method, real-world field experiments were conducted in Jimusaer county, Xinjiang, using this safflower-picking robot in an open agricultural environment. As shown in Fig. 8a, the robot was deployed in a safflower field and executed picking path planning in real time. Two representative test cases involving 25 and 31 safflower blossoms were selected for demonstration, corresponding to different safflower varieties, as illustrated in Fig. 8b and Fig. 8c, respectively. These scenarios provide a practical basis for evaluating the performance of this model under different spatial configurations and picking densities.
3.5.2　Analysis of sequence planning results
To further evaluate the real-world effectiveness of the proposed model, we conducted a comparative analysis against NSGA, the best-performing baseline among the traditional optimization algorithms, across two representative safflower varieties and picking scenarios－25 and 31 blossoms of Yuhong No.1 and Yunhong No.5, respectively. The results, summarized in Table 9, demonstrate that the AC-RL-PtrNet model consistently outperformed NSGA in both path and time efficiency. Specifically, this model achieved reductions of 11.52% and 20.17% in path length, as well as 5.43% and 29.70% in picking time across the two scenarios.
The corresponding sequence planning visualizations are presented in Fig. 9. Fig. 9a and Fig. 9d correspond to the sequence planning results for 25 and 31 safflowers, respectively. Figures 9b, 9c, 9e, 9f illustrate the comparison between NSGA and AC-RL-PtrNet under the two scenarios. The visual comparison highlights that the paths generated by the AC-RL-PtrNet model are not only shorter but also more structured and efficient than those produced by the NSGA algorithm, which tends to generate redundant and crossover-prone paths. In contrast, the AC-RL-PtrNet model demonstrates superior balance between global path optimization and local adjustment, producing more regular and structured paths. The node connections are more consistent with the spatial distribution of the targets, revealing a more ideal 3D TSP planning capability, as well as enhanced intelligence and practical applicability. These visual results further confirm that the proposed approach can effectively generate optimal picking sequences even in complex environments characterized by densely clustered or unevenly distributed safflowers.
In summary, the improved model exhibits notable advantages in extracting spatial distribution features of safflowers, while the introduced pruning strategy effectively reduces computational redundancy and enhances decision-making efficiency. These strengths make it a robust, stable, and efficient solution for intelligent safflower picking tasks.
4 Conclusion
Less
This study focuses on the task of automatic safflower picking and, by considering the structural characteristics of a parallel picking robot platform, proposes a sequence planning algorithm based on a reinforcement learning pointer network under the actor-critic framework. The proposed method is specifically designed for integration into safflower-picking robots, addressing the complex path planning needs encountered in unstructured agricultural environments. To address redundant paths and low time efficiency in traditional methods, a DEMA attention mechanism with distance encoding was integrated into the actor network, enhancing its ability to model spatial relationships among safflowers. A structured pruning strategy was also applied to the LSTM gating units and fully connected layers, effectively reducing model complexity while preserving performance. Furthermore, a novel enhancement to the critic network was introduced. This involved a refined embedding and attention formulation, incorporating input normalization, multi-layer residual connections, and an improved prediction module, significantly improving value estimation accuracy and training stability. The complementary design between actor and critic components ensures more consistent policy optimization during learning. In the experimental section, the sequential safflower picking problem was reformulated as a three-dimensional traveling salesman problem. Ablation studies reveal that each of the three enhancements, DEMA attention, LSTM pruning, and critic refinement, contributes incrementally to overall performance gains in both inference time and path quality. Furthermore, empirical comparisons with established swarm intelligence algorithm, such as PSO, NSGA and ACO, demonstrated that this method consistently delivers shorter traversal routes and improved planning efficiency under different target distributions. In real-world validation involving datasets of 25 and 31 safflowers, the proposed approach surpasses the strongest baseline NSGA, confirming its practical advantages. These results highlight the framework's applicability in real-time field deployment and its effectiveness in improving path planning capabilities of safflower-picking robots. Additionally, due to the generality of the 3D TSP formulation and the modular design of the AC-RL-PtrNet architecture, this method has strong potential for transferability to other agricultural applications such as tomato, strawberry, or pear picking. The DEMA attention and pruning strategies can also be reconfigured to accommodate different spatial complexities, object densities, and environmental conditions, making the proposed framework a promising solution for a wider class of 3D sequence planning tasks in precision agriculture. These findings affirm the robustness and adaptability of the AC-RL-PtrNet framework in complex agricultural environments, emphasizing its potential for enhancing automated safflower picking performance.
Funding
Less
  • 新疆维吾尔自治区青年科学基金项目(2023D01C190)
  • 新一代人工智能国家科技重大专项(2022ZD0115801)
References
Less
[1]
LU J X, ZHANG C X, HU Y, et al. Application of multiple chemical and biological approaches for quality assessment of Carthamus tinctorius L. (safflower) by determining both the primary and secondary metabolites[J]. Phytomedicine, 2019, 58: 152826.
[2]
WANG L, CHEN Z, HAN B, et al. Comprehensive analysis of volatile compounds in cold-pressed safflower seed oil from Xinjiang, China[J]. Food Science & Nutrition, 2020, 8(2): 903-914.
[3]
MA B J, XIA H, GE Y, et al. A method for identifying picking points in safflower point clouds based on an improved PointNet++ network[J]. Agronomy, 2025, 15(5): 1125.
[4]
WANG X R, ZHOU J P, XU Y, et al. Location of safflower filaments picking points in complex environment based on improved YOLOv5 algorithm[J]. Computers and Electronics in Agriculture, 2024, 227: 109463.
[5]
ZHANG Z G, WANG Y Z, XU P, et al. WED-YOLO: A detection model for safflower under complex unstructured environment[J]. Agriculture, 2025, 15(2): 205.
[6]
LI Y J, FENG Q C, LIU C, et al. MTA-YOLACT: Multitask-aware network on fruit bunch identification for cherry tomato robotic harvesting[J]. European Journal of Agronomy, 2023, 146: 126812.
[7]
JIANG Y W, CHEN J, WANG Z W, et al. Research progress and trend analysis of picking technology for Korla fragrant pear[J]. Horticulturae, 2025, 11(1): 90.
[8]
ZHAO C J, FAN B B, LI J, et al. Agricultural robots: Technology progress, challenges and trends[J]. Smart Agriculture, 2023, 5(4): 1-15.
[9]
DONG Z, ZHANG X H, YANG W J, et al. Ant colony optimization-based method for energy-efficient cutting trajectory planning in axial robotic roadheader[J]. Applied Soft Computing, 2024, 163: 111965.
[10]
CHEN D W, IMDAHL C, LAI D, et al. The Dynamic Traveling Salesman Problem with Time-Dependent and Stochastic travel times: A deep reinforcement learning approach[J]. Transportation Research Part C: Emerging Technologies, 2025, 172: 105022.
[11]
GUO Z W, FU H, WU J H, et al. Dynamic task planning for multi-arm apple-harvesting robots using LSTM-PPO reinforcement learning algorithm[J]. Agriculture, 2025, 15(6): 588.
[12]
LIU C J, ZHONG Y L, WU R L, et al. Deep reinforcement learning based 3D-trajectory design and task offloading in UAV-enabled MEC system[J]. IEEE Transactions on Vehicular Technology, 2025, 74(2): 3185-3195.
[13]
JATI G K, KUWANTO G, HASHMI T, et al. Discrete Komodo algorithm for traveling salesman problem[J]. Applied Soft Computing, 2023, 139: 110219.
[14]
SOITINAHO R, VÄYRYNEN V, OKSANEN T. Heuristic cooperative coverage path planning for multiple autonomous agricultural field machines performing sequentially dependent tasks of different working widths and turn characteristics[J]. Biosystems Engineering, 2024, 242: 16-28.
[15]
UTAMIMA A, REINERS T. Navigating route planning for multiple vehicles in multifield agriculture with a fast hybrid algorithm[J]. Computers and Electronics in Agriculture, 2023, 212: 108021.
[16]
GAO R L, ZHOU Q J, CAO S X, et al. Apple-picking robot picking path planning algorithm based on improved PSO[J]. Electronics, 2023, 12(8): 1832.
[17]
FANG S P, RU Y, HU C M, et al. Planning of takeoff/landing site location, dispatch route, and spraying route for a pesticide application helicopter[J]. European Journal of Agronomy, 2023, 146: 126814.
[18]
LI X M, GENG L B, LIU K Z, et al. Model-based offline reinforcement learning for AUV path-following under unknown ocean currents with limited data[J]. Drones, 2025, 9(3): 201.
[19]
SHEN J, CHEN M C, ZHANG Z C, et al. Model-based offline policy optimization with distribution correcting regularization[C]// Machine Learning and Knowledge Discovery in Databases. Research Track. Cham, Germany: Springer, 2021: 174-189.
[20]
SHARMA G, SINGH A, JAIN S. DeepEvap: Deep reinforcement learning based ensemble approach for estimating reference evapotranspiration[J]. Applied Soft Computing, 2022, 125: 109113.
[21]
ZHANG Q, FANG X W, GAO X D, et al. Optimising maize threshing process with temporal proximity soft actor-critic deep reinforcement learning algorithm[J]. Biosystems Engineering, 2024, 248: 229-239.
[22]
YANG J C, NI J F, LI Y, et al. The intelligent path planning system of agricultural robot via reinforcement learning[J]. Sensors, 2022, 22(12): 4316.
[23]
LIN G C, ZHU L X, LI J H, et al. Collision-free path planning for a guava-harvesting robot based on recurrent deep reinforcement learning[J]. Computers and Electronics in Agriculture, 2021, 188: 106350.
[24]
SANTIYUDA G, WARDOYO R, PULUNGAN R. Solving biobjective traveling thief problems with multiobjective reinforcement learning[J]. Applied Soft Computing, 2024, 161: 111751.
[25]
BELLO I, PHAM H, LE Q V, et al. Neural combinatorial optimization with reinforcement learning[EB/OL]. arXiv: 2016.
[26]
GU S S, YANG Y. A deep learning algorithm for the max-cut problem based on pointer network structure with supervised learning and reinforcement learning strategies[J]. Mathematics, 2020, 8(2): 298.
[27]
LIN G C, XIONG J T, ZHAO R M, et al. Efficient detection and picking sequence planning of tea buds in a high-density canopy[J]. Computers and Electronics in Agriculture, 2023, 213: 108213.
[28]
WANG X R, XU Y, ZHOU J P, et al. Safflower picking recognition in complex environments based on an improved YOLOv7[J]. Transactions of the Chinese Society of Agricultural Engineering, 2023, 39(6): 169-176.
[29]
BELHADI A, DJENOURI Y, BELBACHIR A N, et al. Shapley visual transformers for image-to-text generation[J]. Applied Soft Computing, 2024, 166: 112205.
[30]
SUTTON R S, MCALLESTER D, SINGH S, et al. Policy gradient methods for reinforcement learning with function approximation[C]// Proceedings of the 13th International Conference on Neural Information Processing Systems. New York, USA: ACM, 1999: 1057-1063.
[31]
BRAUWERS G, FRASINCAR F. A general survey on attention mechanisms in deep learning[J]. IEEE Transactions on Knowledge and Data Engineering, 2023, 35(4): 3279-3298.
[32]
LIU Y, ZHANG C, HANG B, et al. An audio attention computational model based on information entropy of two channels and exponential moving average[J]. Human-Centric Computing and Information Sciences, 2019, 9(1): 7.
[33]
HE Y, XIAO L G. Structured pruning for deep convolutional neural networks: A survey[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46(5): 2900-2919.
[34]
WANG Z, LI C C, WANG X Y. Convolutional neural network pruning with structural redundancy reduction[C]// 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway, New Jersey, USA: IEEE, 2021: 14908-14917.
[35]
JIANG P C, XUE Y, NERI F. Convolutional neural network pruning based on multi-objective feature map selection for image classification[J]. Applied Soft Computing, 2023, 139: 110229.
[36]
CHEN J L, ZHAO P, CAO X L, et al. Lightweight YOLOv8s-based strawberry plug seedling grading detection and localization via channel pruning[J]. Smart Agriculture, 2024, 6(6): 132-143.
[37]
ZHU K H, HU F Y, DING Y B, et al. A comprehensive review of network pruning based on pruning granularity and pruning time perspectives[J]. Neurocomputing, 2025, 626: 129382.
Appendix
Less
Year 2026 volume 8 Issue 2
PDF
70
27
Cite this Article
BibTeX
Article Info
doi: 10.12133/j.smartag.SA202506004
  • Receive Date：2025-05-19
  • Online Date：2026-07-08
  • Published：2026-03-30
Article Data
Affiliations
History
  • Received：2025-05-19
Funding
新疆维吾尔自治区青年科学基金项目(2023D01C190)
新一代人工智能国家科技重大专项(2022ZD0115801)
Affiliations
    1.School of Mechanical Engineering, Xinjiang University, Urumqi 830017, China
    2.Agriculture and Animal Husbandry Robot and Intelligent Equipment Engineering Research Center of Xinjiang Uygur Autonomous Region, Urumqi 830017, China
    3.Engineering Training Center of Xinjiang University, Urumqi 830017, China

Corresponding:

WANG Xiaorong, E-mail:
References
Share
https://castjournals.cast.org.cn/joweb/zhny/EN/10.12133/j.smartag.SA202506004
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family		 属数
Number of
genus		 种数
Number of
species		 占总种数比例
Percentage of
total species (%)		 属
Genus		 种数
Number of
species		 占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT
Links
Articles
Latest Articles
Most Read
Collections
Updates
Events
News
Multimedia
About
About Us
Contact
No. 86 Xueyuan South Road, Haidian District, Beijing
100081
010-62199257
qkjq@cast.org.cn

Copyright © 2025 China Association for Science and Technology. All rights reserved. For all open access content, the relevant licensing terms apply.
Sponsored by the Office of the Leading Group for Cybersecurity and Informatization of CAST, and supported by Science and Technology Review Publishing House