To meet the demand for optimizing long-term maintenance decisions in intelligent bridge operation and maintenance, considering the characteristics of time-varying bridge deterioration under a finite horizon, financial discounting of maintenance costs, and difficulty in long-term reward propagation, a life-cycle maintenance decision model incorporating non-homogeneous deterioration and discounting effects was developed. The bridge deterioration process was characterized by non-homogeneous Markov state transitions. Based on discrete health states and maintenance actions, maintenance costs and risk costs were integrated into a unified cost function, while cash-flow discounting was introduced into the decision-making process. To address the limitations of conventional reinforcement learning methods in handling finite-horizon stage-wise decision tasks, non-homogeneous state transitions, and unstable training, a reinforcement learning framework combining state augmentation and backward curriculum learning was proposed. Expanded state representation enhanced the policy’s capability to capture finite-horizon characteristics, while backward curriculum learning gradually extended the training interval to improve learning stability and convergence efficiency. Numerical results demonstrated that the proposed method effectively adapted to finite-horizon maintenance decision problems under non-homogeneous bridge deterioration and achieved favorable performance in both policy quality and training stability, thereby providing methodological support for maintenance planning in life-cycle bridge operation and maintenance management.
| 科 Family | 属数 Number of genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) | 属 Genus | 种数 Number of species | 占总种数比例 Percentage of total species (%) |
|---|---|---|---|---|---|---|
| 鹅膏菌科Amanitaceae | 2 | 11 | 5.26 | 鹅膏菌属 Amanita | 10 | 4.78 |
| 小菇科 Mycenaceae | 2 | 12 | 5.74 | 丝盖伞属 Inocybe | 5 | 2.39 |
| 多孔菌科 Polyporaceae | 8 | 14 | 6.70 | 蜡蘑属 Laccaria | 5 | 2.39 |
| 红菇科 Russulaceae | 3 | 23 | 11.00 | 小皮伞属 Marasmius | 6 | 2.87 |
| 小菇属 Mycena | 11 | 5.26 | ||||
| 光柄菇属 Pluteus | 5 | 2.39 | ||||
| 红菇属 Russula | 17 | 8.13 | ||||
| 栓菌属 Trametes | 5 | 2.39 |