收藏切换
Significant wave height forecasts integrating ensemble empirical mode decomposition with sequence-to-sequence model
收藏切换
PDF
Lina Wang1, 2, Yu Cao1, Xilin Deng1, Huitao Liu1, Changming Dong2, 3, *
Acta Oceanologica Sinica | 2023, 42(10) : 54 - 66
Less
收藏切换
Acta Oceanologica Sinica | 2023, 42(10): 54-66
Physical Oceanography, Marine Meteorology and Marine Physics
Significant wave height forecasts integrating ensemble empirical mode decomposition with sequence-to-sequence model
Full
Lina Wang1, 2, Yu Cao1, Xilin Deng1, Huitao Liu1, Changming Dong2, 3, *
Affiliations
  • 1 School of Artificial Intelligence (School of Future Technology), Nanjing University of Information Science & Technology, Nanjing 210044, China
  • 2 Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai), Zhuhai 519080, China
  • 3 School of Marine Sciences, Nanjing University of Information Science & Technology, Nanjing 210044, China
Published: 2023-10-25 doi: 10.1007/s13131-023-2246-y
Outline
收藏切换

As wave height is an important parameter in marine climate measurement, its accurate prediction is crucial in ocean engineering. It also plays an important role in marine disaster early warning and ship design, etc. However, challenges in the large demand for computing resources and the improvement of accuracy are currently encountered. To resolve the above mentioned problems, sequence-to-sequence deep learning model (Seq-to-Seq) is applied to intelligently explore the internal law between the continuous wave height data output by the model, so as to realize fast and accurate predictions on wave height data. Simultaneously, ensemble empirical mode decomposition (EEMD) is adopted to reduce the non-stationarity of wave height data and solve the problem of modal aliasing caused by empirical mode decomposition (EMD), and then improves the prediction accuracy. A significant wave height forecast method integrating EEMD with the Seq-to-Seq model (EEMD-Seq-to-Seq) is proposed in this paper, and the prediction models under different time spans are established. Compared with the long short-term memory model, the novel method demonstrates increased continuity for long-term prediction and reduces prediction errors. The experiments of wave height prediction on four buoys show that the EEMD-Seq-to-Seq algorithm effectively improves the prediction accuracy in short-term (3-h, 6-h, 12-h and 24-h forecast horizon) and long-term (48-h and 72-h forecast horizon) predictions.

significant wave height  /  wave forecasting  /  ensemble empirical mode decomposition (EEMD)  /  Seq-to-Seq  /  long short-term memory
Lina Wang, Yu Cao, Xilin Deng, Huitao Liu, Changming Dong. Significant wave height forecasts integrating ensemble empirical mode decomposition with sequence-to-sequence model[J]. Acta Oceanologica Sinica, 2023 , 42 (10) : 54 -66 . DOI: 10.1007/s13131-023-2246-y
The significant wave height (SWH) is the actual wave height calculated in a certain way. SWH is an important parameter used to measure the marine climate and plays a crucial role in marine disaster prediction (Ardhuin et al., 2019), marine engineering construction (Vanem, 2016) and ship design (Caires and Sterl, 2005). The accurate and quick prediction of the SWH has become a considerable problem in the development of modern ocean technology. Currently, the SWH forecasting can be divided into three categories: numerical wave, machine learning and deep learning models. Given appropriate SWH forecasting models, the accuracy of prediction depends on the forecast time span. The longer the prediction time is, the lower the accuracy of prediction is. With the rapid development of computer science and technology, more attention has been paid to the numerical wave models. The third-generation numerical wave prediction models (e.g., Wave Modeling, Wave Watch III Model, and Simulating Waves Nearshore Model) are the most widely used numerical wave models. The machine learning methods can fit complex nonlinear processes and solve complex nonlinear problems of the physical mechanism without prior knowledge of the system. Therefore, these methods are widely applied to SWH prediction. One is the single prediction model, such as artificial neural network (Deo and Naidu, 1998), support vector machine (Mahjoobi and Mosabbeb, 2009), M5′ model tree (Etemad-Shahidi and Mahjoobi, 2009); and the other is the composite prediction model, such as hybrid empirical mode decomposition support vector regression model (Duan et al., 2016), a fuzzy KNN-based model (Nikoo et al., 2018). Here, traditional machine learning methods usually require manual feature engineering. If important features cannot be learned, then the prediction accuracy of the model will be significantly reduced. As a result, manually selecting feature is a laborious task. The development of computer technology in recent years realizes the possible application of complex models. Deep learning algorithms such as the simulating waves nearshore (SWAN)-long short-term memory (LSTM) (Fan et al., 2020), convolutional neural network (Yang et al., 2021), convolutional LSTM network (ConvLSTM) (Zhou et al., 2021a) and convolutional neural network-bidirectional LSTM-attention mechanism model (CNN-BiLSTM-attention) (Wang et al., 2022), can automatically learn data features and achieve successful results in the field of ocean prediction. However, the above methods do not fully mine the signal characteristics of the SWH. The original data sequence is decomposed into a set of intrinsic mode functions (IMFs) by signal decomposition technology to reduce the non-stationarity of wave height data, and then the model is constructed for prediction at each intrinsic mode function sub-sequence. Oh and Suh (2018) proposed a hybrid model combining the empirical orthogonal function and wavelet analysis with the neural network algorithm (EOFWNN) and predicted the wave height values of eight wave observation stations along the coast of the Sea of Japan. Compared with the wavelet and neural network hybrid models, EOFWNN performed effectively despite the decomposition level of wavelet analysis. Zhou et al. (2021b) proposed the forecasting algorithm using a joint empirical mode decomposition LSTM (EMD-LSTM) model, in which the EMD algorithm is applied to decompose the SWH, and the decomposed IMF sub-sequences are trained by the LSTM network. Effective results are achieved in the SWH from two buoys in the Atlantic Ocean, east of the Bahamas. Raj and Brown (2021) jointly adopted a hybrid Boruta random forecast ensemble EMD (EEMD) bidirectional LSTM algorithm to predict SWH over 24 h along the coastal areas of Queensland, Australia. Considering the prediction of different forecast windows, Sutskever et al. (2014) proposed a sequence-to-sequence deep learning model (Seq-to-Seq) based on encoder–decoder, in which one recurrent neural network (RNN) network encodes the input information and the other RNN network decodes the encoded information, which can demonstrate increased continuity for long-term prediction. The Seq-to-Seq has been applied to long-term prediction problems in different fields, such as ocean waves (Pirhooshyaran and Snyder, 2020), wind power (Zhang et al., 2020), power load (Gong et al., 2019) and semantic trajectories (Karatzoglou et al., 2018), and achieved high prediction accuracy.
The accuracy of SWH at the long forecast windows is low. Thus, SWH prediction integrating EEMD with Seq-to-Seq (EEMD-Seq-to-Seq) model is proposed. Noise characteristics are applied to EEMD, which can effectively suppress modal aliasing caused by EMD decomposition, and EEMD improves prediction accuracy whilst reducing the difficulty of modeling (Wu and Huang, 2009). The Seq-to-Seq module applies to long-term prediction, which comprises the encoder and the decoder. The encoder and decoder adopt LSTM-based multi-layer network structures (Graves, 2012), and an attention module is added between them (Vaswani et al., 2017). The attention mechanism can avoid the information compression problem caused by the Seq-to-Seq model in source sequence encoding. Therefore, the decoder can review the entire source sequence at each step of decoding. Consequently, predicted performance of the Seq-to-Seq model is improved. An improved algorithm of the EEMD-Seq-to-Seq is proposed in this paper based on EMD-LSTM model. The proposed algorithm can decompose the original wave height signal and train the decomposed stationary mode signal to obtain different time-window prediction models. The algorithm is then applied to establish SWH forecasting models under multiple forecast windows, and the experimental results on different buoys verify the effectiveness of the method.
Observations of significant wave height are acquired by National Data Buoy Center from four buoys deployed in the Atlantic Ocean, east of the Bahamas. These buoys are as follows: Station 41040 (14.542°N, 53.341°W), Station 41044 (21.582°N, 58.630°W), Station 41046 (23.822°N, 68.384°W) and Station 41047 (27.514°N, 71.494°W), as shown in Fig. 1. The acquired data range from 2019 to 2020 and are provided at 1-h resolution.
Uncertain factors in the process of data acquisition lead to data loss. EEMD algorithm needs a data stream without missing values; thus, spline interpolation is performed to supplement the missing values from the time series before entering the EEMD module. All buoy statistics, relate to geographical positions, water depth and the number of observations before and after interpolation, are shown in Table 1.
EMD is an adaptive time-frequency data analysis method which can decompose complex signals into a series of IMFs according to the signal characteristics. The decomposed IMF contains local features of the original signal at different time scales. Applied in marine forecasting, EMD converts a non-stationary wave height sequence into wave height components with a definite pattern, which are predictable and can significantly improve prediction accuracy. The algorithm steps are as follows.
(1) Identify the local extreme values for the original signal $ x\left(t\right) $. Interpolate the local extreme values by a cubic spline function to obtain the upper envelope ${e}_{{\rm{max}}}\left(t\right)$ and the lower envelope ${e}_{{\rm{min}}}\left(t\right)$.
(2) The mean of the upper and lower envelopes $ m\left(t\right) $ is:
$ m\left(t\right)=\frac{1}{2}({e}_{{\rm{max}}}\left(t\right)+{e}_{{\rm{min}}}(t\left)\right) . $
(3) Subtract the mean value $ m\left(t\right) $ from $ x\left(t\right) $ to obtain an IMF candidate $ h\left(t\right) $:
$ h\left(t\right)=x\left(t\right)-m\left(t\right) . $
(4) Judge whether $ h\left(t\right) $ meets the IMF conditions by the value of standard deviation (SD). The SD is calculated as follows:
$ {\rm{SD}}=\sum _{t=1}^{T}\frac{{\left|{h}_{j-1}\left(t\right)-{h}_{j}\left(t\right)\right|}^{2}}{{h}_{j-1}^{2}\left(t\right)} , $
where T is the time vector; $ {h}_{j-1}\left(t\right) $ and $ {h}_{j}(t) $ represent the signals after shifting $ j-1 $ and $ j $ times, respectively. If the value of SD is between 0.2 and 0.3, an IMF component $ {h}_{j}\left(t\right) $ is selected. Namely, $ {h}_{j}\left(t\right) $ is defined as $ {C}_{j}\left(t\right) $.
(5) To obtain a new signal $ r\left(t\right) $, subtract $ {C}_{j}\left(t\right) $ from $ x\left(t\right) $:
$ r\left(t\right)=x\left(t\right)-{C}_{j}\left(t\right) . $
(6) Repeat Steps (1)−(5) until $ {r}_{n}\left(t\right) $ cannot be further decomposed into IMFS. The residual of the original signal is given by $ {r}_{n}\left(t\right) $. The original signal $ x\left(t\right) $ is finally decomposed into a series of IMFs and a residual.
$ x\left(t\right)=\sum _{j=1}^{n}{C}_{j}\left(t\right)+{r}_{n}\left(t\right) , $
where $ n $ is the number of IMFs, and $ {r}_{n}\left(t\right) $ is the residual of the signal $ x\left(t\right) $.
Modal aliasing exists in the conventional EMD method. Modal aliasing reduces the decomposition accuracy when the signal distribution is uneven. Huang et al. (1998) proposed an improved algorithm, that is, EEMD, to solve modal aliasing. Depending on the uniform frequency distribution characteristics of the white noise spectrum, the problem of modal aliasing is solved by adding white noise in the EEMD method to separate a signal to its adapted reference scale automatically. Due to the nature of zero mean noise, white noise is added to the calculation procedure of the signal data (Yang and Wang, 2021). The final IMF signal in EEMD decomposition is the mean value of IMFs obtained in the noise test. The specific decomposition process is as follows: (1) input the preprocessed wave height signal, initialize the number of tests M and set m=1; (2) in the mth test, white noise sequence $ {n}_{m}\left(t\right) $ is added to the original signal $ {x}_{m} $, ${x}_{m}=x\left(t\right)+ $nm(t); (3) the newly obtained signal $ {x}_{m}\left(t\right) $ is decomposed by the EMD model, and the obtained IMF is denoted as ${C}_{j, m}$; (4) repeat Steps (2) and (3). Each test uses new white noise sequences until the number of tests M is achieved. The integrated IMF signals are estimated by averaging IMFs obtained with trials of new noises, as shown in Eq. (6).
$ {{\rm{IMF}}}_{j}\left(t\right)=\frac{1}{M}\sum _{m=1}^{M}{C}_{j,m},\;\;j=\mathrm{1,\;2},\cdots ,n . $
The white noise sequences added in the tests cancel each other out in the corresponding integrated IMF due to the nature of zero mean noise (Bokde et al., 2020). The addition of a white noise signal provides signal continuity at different scales, changes the characteristics of the signal extreme point and promotes anti-aliasing decomposition. The mean value of the obtained IMFs is taken as the final result, and the flow chart of the EEMD algorithm is shown in Fig. 2.
The sequence-to-sequence (Seq-to-Seq) prediction model can map input sequences to output sequences with variable lengths. This model has been widely applied to machine translation, sequence prediction and other fields, and mainly comprises an encoder and a decoder. The encoder reads the input sequence to generate a vector with a fixed dimension as the hidden state of the input sequence, whilst the decoder decodes the state into a predicted result. However, the encoder will lose valuable information when the input sequence is excessively long (Ye et al., 2022). Bahdanau et al. (2014) proposed a Seq-to-Seq model with an attention mechanism and added an attention module into the model to solve this problem. The attention mechanism enables the decoder to select a subset of the input sequence adaptively for subsequent prediction by weighting the encoded input source data. Figure 3 shows the structure of the Seq-to-Seq model with the attention module and gives the detailed design of the model framework.
The prediction model includes three parts: encoder layer, decoder layer and attention layer, as shown in Fig. 3. The encoder learns its hidden features from the input sequence xtl+1, xtl+2, ···, xt through LSTM network. And construct historical sequence through context generation vector and attention vector, that is, encoded attention vector CAt. The decoder is based on the encoded attention vector and decode through LSTM networks. Finally, the prediction target is attained.
LSTM network has been proved to be the most effective model for learning dependence characteristics of time series data. LSTM is better at processing sequential signal data than the basic RNN by adding forgetting gate, input gate, and output gate, i.e., deciding how much information should be retained by a sigmoid function. In the structure of LSTM neuron, it is first decided by a forgetting gate whether old information from the previous time step should be lost or not. Then it is determined which new information will be stored in the cell state, and through an input gate, a candidate vector activated by tanh and the state vector of the previous layer determine the current cell state. The final output cell state and the vector pass through the output gate to determine. The structure of LSTM neuron is shown in Fig. 4.
The various functions and gates within LSTM are calculated as follows:
$ {f}_{t}=\sigma ({W}_{f}\cdot \left[{h}_{t-1},{x}_{t}\right]+{b}_{f}) , $
$ {i}_{t}=\sigma ({W}_{i}\cdot \left[{h}_{t-1},{x}_{t}\right]+{b}_{i}) , $
$ {\stackrel{~}{C}}_{t}={\rm{tanh}}({W}_{C}\cdot [{h}_{t-1},{x}_{t}]+{b}_{C}) , $
$ {C}_{t}={f}_{t}°{C}_{t-1}+{{i}_{t}}^{\circ}{\widetilde{C}}_{t} , $
$ {o}_{t}=\sigma ({W}_{o}\cdot [{h}_{t-1},{x}_{t}]+{b}_{o}) , $
$ {h}_{t}={{o}_{t}}^{\circ} {\rm{tanh}}\left({C}_{t}\right) , $
where $ \sigma (\cdot ) $ and tanh(·) are sigmoid and tanh activation functions, respectively; $ {x}_{t} $ is the input for the current time step; $ {f}_{t} $ is the output of the forget gate; $ {i}_{t} $ is the output of the input gate, which determines the acceptance of the candidate state $ {\widetilde{C}}_{t} $; $ {o}_{t} $ is the output of the output gate; $ {C}_{t} $ is the state vector of the current time step, and obtained by the dot product; $ {h}_{t-1} $ is the hidden state vector of the output at time $ t-1 $; $ {W}_{f} $, $ {W}_{i} $, $ {W}_{C} $, and $ {W}_{o} $ are the weights; $ {b}_{f} $, $ {b}_{i} $, $ {b}_{C} $, and $ {b}_{o} $ are the bias; ° is the Hadamard product operator. The final output result $ {h}_{t} $ is obtained by the Hadamard product of $ {o}_{t} $ and ${\rm{tanh}}\left({C}_{t}\right)$.
The attention mechanism simulates the human brain focusing on a particular area at a particular time, selectively acquiring more useful information, and ignoring useless information. It can strengthen the influence of key information and enhance the accuracy of model judgment by assigning different weight values to the hidden layer units of a neural network. Adopting the attention mechanism enables the model to learn reasonable vector representations and makes the key information dominate the prediction process, thereby improving the prediction accuracy of the model. ht and Ct are respectively the hidden state and coding context vector at time t. CAi is the encoded attention vector at time i, which is calculated by the weighted average value of the hidden state vector ht. f is a nonlinear mapping function (Keneshloo et al., 2020).
$ {h}_{t},{C}_{t}=f({x}_{t},{h}_{t-1},{C}_{t-1}) , $
$ {{\rm{CA}}}_{i}=\sum _{j=1}^{l}{a}_{ij}{h}_{j} . $
In the attention part, a small neural network is added and activation function of the output layer is softmax, which is a normalized exponential function. The weight corresponding to the hidden state of each encoder is calculated as follows.
$ {a}_{ij}=\frac{{\rm{exp}}\left({e}_{ij}\right)}{\displaystyle\sum _{k}{\rm{exp}}\left({e}_{ik}\right)} , $
where $ {e}_{ij} $ is a function of correlation calculation, which mainly includes dot product, bilinear product, connection and multi-layer perception (MLP). Herein, MLP is selected. It mainly calculates the hidden state of the decoder at the previous time, and the hidden state of the encoder at the current time by matrix multiplication with their respective parameters.
$ {e}_{ij}=v\times {\rm{tanh}}({w}_{1}{s}_{i-1}+{w}_{2}{h}_{j}) , $
where $v,{w}_{1}\;{\mathrm{a}\mathrm{n}\mathrm{d}\;w}_{2}$ are the trainable parameters; $ {s}_{i-1} $ is the hidden state of the decoder at time $ i-1 $; hj is the hidden state of the encoder at time $ j $.
The decoder with LSTM network is based on the output of the target sequence, $ {Y}_{t-1} $, the hidden state vector of the decoder at time $ t-1 $, $ {s}_{t-1} $, and the encoded attention vector, $ {{\rm{CA}}}_{t} $, for decoding computing. $ g $ is a nonlinear mapping function. The hidden state vector of the decoder $ {s}_{t} $ at time $ t $ is calculated by Eq. (17).
$ {s}_{t}=g({Y}_{t-1},{s}_{t-1},{{\rm{CA}}}_{t}) . $
Finally, output the predicted result Yt through a fully connected network layer.
$ {Y}_{t}=\sigma ({s}_{t},{{\rm{CA}}}_{t}) . $
The Seq-to-Seq SWH prediction model based on EEMD decomposition is shown in Fig. 5. Firstly, the signal data are divided into multiple stationary sub-sequences (multiple IMFs and the residual) through the EEMD module, and then the decomposed signal at each IMF and the residual is sent to the Seq-to-Seq prediction module, and then the model is obtained through training. The encoder and decoder in the Seq-to-Seq module respectively adopt multi-layer LSTM network structure, and an attention module is added between them. In the decoding stage, the attention mechanism assigns different weights to each hidden vector of the source sequence. Therefore, the decoder can obtain the important information of the source sequence to produce improved decoding results. The prediction values at each IMF and the residual are summed to obtain the final prediction results. The time step was set to six as the maximum allowed time step as established by Fan et al. (2020), and the SWHs of 3-h, 6-h, 12-h, 24-h, 48-h and 72-h forecast windows are taken as the output. The training set is trained by the EEMD-Seq-to-Seq model, and the prediction performance is verified in the test set.
Firstly, the wave data are divided into training and test sets, and then are preprocessed. Next, the normalized signal data in training and test sets are separately divided into multiple stationary IMFs and the residual by the EEMD algorithm. In the training phase, training set is applied for modeling, and the decomposed signals at each IMF and the residual are organized as the training and the predicted data separately. Then, the training data at each IMF and the residual are sent to the encoder, and the encoder reads the input sequence to generate a vector with a fixed dimension as the hidden state of the input sequence, whilst the decoder decodes the state into a predicted result. Furthermore, the hidden states are assigned different weights combined with an attention mechanism through the encoder coding for hidden state vector. In the following decoding phase, the hidden state vector is decoded, and SWHs of different forecast windows are outputted. During the training process, the dropout layer is used to discard characteristics randomly to improve the robustness of the model, and the predicted data at each IMF and the residual are used to calculate the value of loss function for obtaining the optimal parameters of the prediction model. So the Seq-to-Seq prediction model at each IMF and the residual are obtained. In the test phase, the test set is applied for testing the prediction performance, and the decomposed signals at each IMF and the residual are organized as the test data separately. The obtained predicted values at each IMF and the residual in the test set are outputted, and then add them to get the final forecast value. Finally, the error analysis between the predictive and observation values is provided. The flowchart of the model is shown in Fig. 6.
The SWH data of four Buoys 41040, 41044, 41046 and 41047 from January 1, 2019 to December 31, 2020 are selected as the input dataset. The experimental environment is Windows 11 operating system, Intel Core i7-11800H CPU, 16 GB memory and NVIDIA RTX 3060 graphics card. Python 3.9 is selected as the development language, and the experiment is run on the basis of the Tensorflow-GPU 2.8 framework. LSTM, a forecasting algorithm using EMD-LSTM, EMD-Seq-to-Seq and EEMD-Seq-to-Seq are used to predict the SWH. The number of epochs at the stage of model training is set to 50.
The buoy data in 2019 are selected as the training set and the buoy data in 2020 as the test set. The training set is normalized before model training, as shown below, to improve the model performance.
$ {X}_{N}=\frac{X-\mathrm{m}\mathrm{i}\mathrm{n}\left(X\right)}{\mathrm{m}\mathrm{a}\mathrm{x}\left(X\right)-\mathrm{m}\mathrm{i}\mathrm{n}\left(X\right)} , $
where $X_N$ is the standardized data; $X$ is the observed training data; $ \mathrm{m}\mathrm{i}\mathrm{n}\left(X\right) $ is the minimum of the training data and $ \mathrm{m}\mathrm{a}\mathrm{x}\left(X\right) $ is the maximum of the training data. And the test set is also needed to normalize with the same rule. Normalized data at Buoy 41044 are decomposed into 13 IMFs through EEMD, including 12 IMFs and a residual, and normalized data at the three other buoys are decomposed into 14 IMFs through EEMD, including 13 IMFs and a residual. Compared with EMD decomposition, the EEMD algorithm solves the problem of modal aliasing problem due to EMD decomposition, and the decomposed stationary signal is suitable for prediction.
The loss function of the model is the mean square error (MSE) as presented by Eq. (20).
$ \mathrm{M}\mathrm{S}\mathrm{E}=\frac{1}{n}\sum _{i=1}^{n}{({x}_{i}-{y}_{i})}^{2} , $
where n is the total number of cases, xi is the ith observed SWH and yi is the ith predicted SWH.
The gradient of the loss function is optimized by the adaptive moment estimation (Adam) algorithm, which uses the adjustable attenuation of the adjustable learning rate to realize the robust convergence of the optimization through back propagation calculation.
The different models are evaluated by using mean absolute error (MAE), root mean square error (RMSE), mean absolute percentage error (MAPE) and Pearson correlation coefficient (R) in the test set to assess the error and deviation between the prediction and the observed values and measure the linear correlation between these values. The specific expressions are as follows:
${\rm{ MAE}}=\frac{1}{n}\sum _{i=1}^{n}|{x}_{i}-{y}_{i}| , $
$ {\rm{RMSE}}=\sqrt{\frac{1}{n}\sum _{i=1}^{n}{({x}_{i}-{y}_{i})}^{2}} , $
$ {\rm{MAPE}}=\frac{1}{n}\sum _{i=1}^{n}\left|\frac{{x}_{i}-{y}_{i}}{{x}_{i}}\right|\times 100\mathrm{\%} , $
$ R=\frac{\displaystyle\sum _{i=1}^{n}({x}_{i}-\bar{x})({y}_{i}-\bar{y})}{\sqrt{\displaystyle\sum _{i=1}^{n}{({x}_{i}-\bar{x})}^{2}\times \displaystyle\sum _{i=1}^{n}{({y}_{i}-\bar{y})}^{2}}} , $
where $ {x}_{i} $ and $ \bar{x} $ respectively refer to the observed and mean values of SWH; $ {y}_{i} $ and $ \bar{y} $ are respectively the predicted and corresponding mean values of SWH; and $ n $ is the number of test cases. The prediction error increases with RMSE, MAE, and MAPE. R represents the correlation between the predicted and observed values.
The prediction advantages of integrating EEMD algorithm and the Seq-to-Seq model are compared in this section. LSTM, EMD-LSTM, EMD-Seq-to-Seq and EEMD-Seq-to-Seq models are adopted to predict the SWHs of four buoys. Tables 25 respectively demonstrate the prediction performances of different models for Buoys 41040, 41044, 41046 and 41047 at different forecast windows.
The tables below reveal that the evaluation indices of the EEMD-Seq-to-Seq model are superior to those of other algorithms. The advantages of different algorithms are as follows. (1) The EMD decomposition algorithm reduces the non-stationarity of data, and prediction performance of the EMD-LSTM is significantly improved compared with the LSTM algorithm; (2) the interconnection of the output sequence is adopted in the Seq-to-Seq model, which is superior to the LSTM network at a long-time-window forecast, and prediction performance of the EMD-Seq-to-Seq is further improved compared with the EMD-LSTM algorithm; (3) compared with EMD, the solution of the EEMD algorithm to the EMD decomposition-induced modal aliasing has superior performance, and prediction performance of the EEMD-Seq-to-Seq is further improved compared with the EMD-Seq-to-Seq algorithm. Prediction indices calculated by the EEMD-Seq-to-Seq algorithm for four different buoys are close over the 3-h, 6-h, 12-h, 24-h, 48-h and 72-h forecast window, and obtain the best prediction performance. The orders of prediction performance of EMD-Seq-to-Seq and EMD-LSTM algorithms are 2nd and 3rd, respectively, and the LSTM algorithm performs worst. At the 3-h forecast window, the predicted RMSE for four buoys is most in range of 0.08–0.10 m, 0.11–0.12 m, 0.11–0.13 m and 0.17–0.25 m in the EEMD-Seq-to-Seq, EMD-Seq-to-Seq, EMD-LSTM and LSTM models, respectively. Similarly, MAE in the EEMD-Seq-to-Seq model is 0.06 m and the MAPE is less than or equal to 3.91% at all buoys, which is better than the forecast indices of other algorithms. This finding indicates that the EEMD-Seq-to-Seq algorithm performs best. As the forecast window increases, RMSE, MAE and MAPE in different algorithms increase whilst R decreases. It shows that the prediction performance is deteriorating. At the 72-h forecast window, the EEMD-Seq-to-Seq model achieved the lowest RMSE, MAE and MAPE among all the algorithms for the four buoys and the highest correlation coefficient. Thus, the EEMD-Seq-to-Seq algorithm achieves the optimum predictive value.
The predicted SWHs of different models from September 10, 2020 to October 10, 2020 are shown in Figs 710. Figures 710 respectively show the SWH forecasts of Buoys 41040, 41044, 41046 and 41047 at 3-h, 6-h, 12-h, and 24-h windows.
Figures 710 reveal that predicted values in all the models in the area where waves change gently (as shown in Fig. 7, from September 20 to September 30, 2020) are close to the observation values. However, as the prediction interval is increased, the deviation of SWH obtained by LSTM algorithm occurs when wave height changes significantly, as shown in Fig. 7c and d, respectively. The EMD-Seq-to-Seq algorithm performs better than LSTM and EMD-LSTM for predicted wave heights close to the observed values in most cases. The EMD-Seq-to-Seq and EEMD-Seq-to-Seq algorithms obtain similar prediction results at the four buoys. However, the stability of the EMD-Seq-to-Seq algorithm is worse than that of the EEMD-Seq-to-Seq algorithm, especially for the prediction of a high SWH value that rapidly changes. Figure 7d shows that the predicted value of EMD-Seq-to-Seq near September 17, 2020 has a considerable deviation from the observation values. However, the EEMD-Seq-to-Seq algorithm is substantially accurate for SWH forecasts on high-value points. The deviation appears with the increase of forecast windows when the EMD-LSTM algorithm is used to predict the high value of SWH, further demonstrating lower prediction accuracy. The LSTM algorithm is the worst because different levels of deviation between the predicted and observed values occur at all forecast windows. The predicted values obtained by the EEMD-Seq-to-Seq model for all buoys are optimal among all the algorithms mentioned.
The interconnection of the output sequence is adopted in the Seq-to-Seq model, which is superior to the LSTM network at a long-time forecast window. EMD-LSTM and EMD-Seq-to-Seq models are selected to compare the LSTM and Seq-to-Seq models and analyze the advantages of the Seq-to-Seq model. The Seq-to-Seq model provides the dependence of output sequence data on each other through the iterative output of a decoder, whilst the LSTM model does not capture the dependence between the output information. Therefore, the predicted error of the Seq-to-Seq model is smaller. The histograms of prediction errors of the EMD-LSTM and EMD-Seq-to-Seq models at Buoy 41047 are plotted in Fig. 11. This figure reveals in the test set, the total frequency of the occurrence in an error of a particular magnitude between the predicted value from the EMD-LSTM and EMD-Seq-to-Seq models and the observed value. The numbers of test data in all error magnitudes conform to a normal distribution, and the vast majority of test data are distributed at around the 0 m mark. As the absolute value of error increases, the number of test data distributed at around the 0 m mark decreases at the 3-h, 6-h, 12-h and 24-h forecast windows, as shown in Figs 11ad. By contrast, EMD-Seq-to-Seq forecast errors are unevenly distributed at around the 0 m mark. In most cases, the frequency of absolute error greater than 0.15 m is lower than EMD-LSTM error frequencies at the 3-h, 6-h and 12-h forecast windows. In Fig. 11d, at the 24-h forecast window, EMD-Seq-to-Seq forecast errors are unevenly distributed at around the 0 m mark, whilst the frequency of error between 0.1 m and 0.3 m is slightly higher than that of EMD-LSTM model. Therefore, the EMD-Seq-to-Seq maintains good robustness at the different forecast windows. This finding shows that the series of the Seq-to-Seq method not only has higher prediction accuracy than the LSTM model, but also avoids the important influence of time delay on prediction accuracy.
Modal aliasing exists in signal decomposition with discontinuities for EMD. Intermittent signals are high-frequency signals with small amplitudes at a certain time or within a remarkably small time interval. The obtained IMF is meaningless in the presence of mode aliasing. The EEMD algorithm adds white noise to improve the modal aliasing caused by EMD decomposition and avoids high-frequency signals with small amplitudes after the decomposition of EEMD. The corresponding decomposed sequence signal is relatively stable, and the prediction accuracy of the algorithm is further improved. Since noise data are added into EEMD algorithm, the IMF values after the decomposition of EMD and EEMD algorithms are different. EMD-Seq-to-Seq and EEMD-Seq-to-Seq models for Buoy 41040 are selected to analyze the prediction performance at different IMFs sub-sequences through the EMD and EEMD algorithms, as shown in Fig. 12.
Figures 12a and e depict the prediction performance of the 2nd high-frequency IMFs decomposed by EMD and EEMD algorithms, respectively. Figure 12e shows that the predicted values obtained by the Seq-to-Seq model are close to the observation values through EEMD decomposition. Meanwhile, the Seq-to-Seq model can only capture major trends after EMD decomposition, ignoring important details and failing to predict observations, as shown in Fig. 12a. As the decomposed signal frequency gradually decreases, the fitting between the predicted and the observed values on the corresponding IMF sub-sequences continues to improve, and the prediction performance is significantly enhanced, as shown in Figs 12bd (EMD algorithm) and fh (EEMD algorithm). The prediction of the third IMF through EEMD decomposition (Fig. 12f) is superior to the corresponding prediction through EMD decomposition (Fig. 12b), whilst the absolute predicted value is significantly less than the observed extreme point value around the 100 h and 400 h after EMD decomposition, leading to the decrease in prediction accuracy. Figure 12h shows that the prediction on SWH of the 5th IMF decomposed by the EEMD algorithm is close to the observation and better than that of the 5th IMF decomposed by the EMD algorithm. By contrast, the prediction performance through EEMD decomposition is further improved.
To compare the fitting degree between predicted and observed values in different models, the scatter diagrams of predicted and observed values at the 3-h, 6-h, 12-h, and 24-h forecast windows are depicted by taking Buoy 41040 as an example, as shown in Fig. 13. Among the four models, the EEMD-Seq-to-Seq model demonstrates the best performance under the same forecast window. The predicted values of each algorithm begin to spread outwards with the increase of the forecast window, but the dispersion of the EEMD-Seq-to-Seq model is the least. Consequently, the prediction performances of EMD-Seq-to-Seq and EMD-LSTM algorithms are respectively the 2nd and 3rd, and the LSTM algorithm has the most significant dispersion between predicted and the observed values, and demonstrates the worst performance. At the 24-h forecast window, the predicted values obtained by the EEMD-Seq-to-Seq model fit well with the observed values, and the predicted values obtained by other models have varying degrees of dispersion. The predicted values of SWH above 2 m are scattered in the EEMD-Seq-to-Seq model, whilst those around 1 m are dispersed for the three other models. For the EEMD-Seq-to-Seq model, the fitting line is optimal among all forecast windows, and its value of Pearson correlation coefficient is highest (larger than 0.95) among all forecast windows.
The SWH forecast is of considerable importance for oceanography and its application. Owing to the limitation of the prediction performance of current algorithms, the prediction performance of SWH is improved by studying the symbiotic relationship and effectiveness of the EEMD algorithm and the Seq-to-Seq network. EEMD adopts noise characteristics based on EMD decomposition to suppress modal aliasing caused by EMD decomposition effectively. Compared with the LSTM model, the Seq-to-Seq model comprises an encoder and a decoder. Multi-layer LSTM networks exist in an encoder and a decoder. Based on LSTM, the dependence between continuous predicted values increases in the Seq-to-Seq model, and the attention module is also considered. The attention mechanism allocates different weights to the source sequence in the decoding stage. Therefore, the decoder can maximize the important information of the source sequence to obtain better prediction performance than the LSTM model at multiple forecast windows. The results indicate that the Seq-to-Seq model integrated EEMD is superior to EMD-Seq-to-Seq, EMD-LSTM and LSTM considering prediction accuracy. As EEMD can decompose the original nonlinear SWH signal into a series of stationary IMFs; thus, the Seq-to-Seq model can effectively capture the changes with the dependent trend. The proposed EEMD-Seq-to-Seq model is optimal from the perspectives of the predictive evaluation indices (RMSE, MAE, MAPE and Pearson coefficient).
The EEMD-Seq-to-Seq model significantly improves the prediction accuracy under short-term prediction. However, the prediction accuracy at 48-h and 72-h forecast windows must be further improved due to prediction errors probably caused by instrumentation (i.e., buoys) and other noise. The additional error may be due to the use of only wave height to predict waves and the effect of ocean currents on waves generated by wind (wind speed and direction) or modulation, which is an important barrier to further improvement. These factors not only improve the prediction accuracy of SWH but also enhance the response speed to extreme wave height. In future studies, addition information about the local climate may be used to improve the prediction accuracy.
  • The Project Supported by Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai) under contract No.SML2020SP007; the National Natural Science Foundation of China under contract Nos 42192562 and 62072249.
Ardhuin F, Stopa J E, Chapron B, et al. 2019. Observing sea states. Frontiers in Marine Science, 6: 124, doi: 10.3389/fmars.2019.00124
Bahdanau D, Cho K, Bengio Y. 2014. Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv: 1409.0473
Bokde N, Feijóo A, Al-Ansari N, et al. 2020. The hybridization of ensemble empirical mode decomposition with forecasting models: application of short-term wind speed and power modeling. Energies, 13(7): 1666, doi: 10.3390/en13071666
Caires S, Sterl A. 2005. 100-year return value estimates for ocean wind speed and significant wave height from the ERA-40 data. Journal of Climate, 18(7): 1032–1048, doi: 10.1175/JCLI-3312.1
Deo M C, Naidu C S. 1998. Real time wave forecasting using neural networks. Ocean Engineering, 26(3): 191–203, doi: 10.1016/S0029-8018(97)10025-7
Duan W Y, Han Y, Huang L M, et al. 2016. A hybrid EMD-SVR model for the short-term prediction of significant wave height. Ocean Engineering, 124: 54–73, doi: 10.1016/j.oceaneng.2016.05.049
Etemad-Shahidi A, Mahjoobi J. 2009. Comparison between M5′ model tree and neural networks for prediction of significant wave height in Lake Superior. Ocean Engineering, 36(15−16): 1175–1181, doi: 10.1016/j.oceaneng.2009.08.008
Fan Shuntao, Xiao Nianhao, Dong Sheng. 2020. A novel model to predict significant wave height based on long short-term memory network. Ocean Engineering, 205: 107298, doi: 10.1016/j.oceaneng.2020.107298
Gong Gangjun, An Xiaonan, Mahato N K, et al. 2019. Research on short-term load prediction based on Seq2seq model. Energies, 12(16): 3199, doi: 10.3390/en12163199
Graves A. 2012. Supervised Sequence Labelling with Recurrent Neural Networks. Heidelberg: Springer Berlin, 37–45
Huang N E, Shen Zheng, Long S R, et al. 1998. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences, 454(1971): 903–995
Karatzoglou A, Jablonski A, Beigl M. 2018. A Seq2Seq learning approach for modeling semantic trajectories and predicting the next location. In: Proceedings of the 26th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems. Washington, Seattle: ACM
Keneshloo Y, Shi Tian, Ramakrishnan N, et al. 2020. Deep reinforcement learning for sequence-to-sequence models. IEEE Transactions on Neural Networks and Learning Systems, 31(7): 2469–2489
Mahjoobi J, Mosabbeb E A. 2009. Prediction of significant wave height using regressive support vector machines. Ocean Engineering, 36(5): 339–347, doi: 10.1016/j.oceaneng.2009.01.001
Nikoo M R, Kerachian R, Alizadeh M R. 2018. A fuzzy KNN-based model for significant wave height prediction in large lakes. Oceanologia, 60(2): 153–168, doi: 10.1016/j.oceano.2017.09.003
Oh J, Suh K D. 2018. Real-time forecasting of wave heights using EOF–wavelet–neural network hybrid model. Ocean Engineering, 150: 48–59, doi: 10.1016/j.oceaneng.2017.12.044
Pirhooshyaran M, Snyder L V. 2020. Forecasting, hindcasting and feature selection of ocean waves via recurrent and sequence-to-sequence networks. Ocean Engineering, 207: 107424, doi: 10.1016/j.oceaneng.2020.107424
Raj N, Brown J. 2021. An EEMD-BiLSTM algorithm integrated with Boruta random forest optimiser for significant wave height forecasting along coastal areas of Queensland, Australia. Remote Sensing, 13(8): 1456, doi: 10.3390/rs13081456
Sutskever I, Vinyals O, Le Q V. 2014. Sequence to sequence learning with neural networks. In: Proceedings of the 27th International Conference on Neural Information Processing Systems. Cambridge: MIT Press
Vanem E. 2016. Joint statistical models for significant wave height and wave period in a changing climate. Marine Structures, 49: 180–205, doi: 10.1016/j.marstruc.2016.06.001
Vaswani A, Shazeer N, Parmar N, et al. 2017. Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. Red Hook: Curran Associates Inc
Wang Lina, Deng Xilin, Ge Peng, et al. 2022. CNN-BiLSTM-attention model in forecasting wave height over South-East China Seas. Computers, Materials & Continua, 73(1): 2151–2168
Wu Zhaohua, Huang N E. 2009. Ensemble empirical mode decomposition: a noise-assisted data analysis method. Advances in Adaptive Data Analysis, 1(1): 1–41, doi: 10.1142/S1793536909000047
Yang Shaobo, Deng Zegui, Li Xingfei, et al. 2021. A novel hybrid model based on STL decomposition and one-dimensional convolutional neural networks with positional encoding for significant wave height forecast. Renewable Energy, 173: 531–543, doi: 10.1016/j.renene.2021.04.010
Yang Yu, Wang Jun. 2021. Forecasting wavelet neural hybrid network with financial ensemble empirical mode decomposition and MCID evaluation. Expert Systems with Applications, 166: 114097, doi: 10.1016/j.eswa.2020.114097
Ye Lin, Dai Binhua, Pei Ming, et al. 2022. Combined approach for short-term wind power forecasting based on wave division and Seq2Seq model using deep learning. IEEE Transactions on Industry Applications, 58(2): 2586–2596, doi: 10.1109/TIA.2022.3146224
Zhang Yu, Li Yanting, Zhang Guangyao. 2020. Short-term wind power forecasting approach based on Seq2Seq model using NWP data. Energy, 213: 118371, doi: 10.1016/j.energy.2020.118371
Zhou Shuyi, Bethel B J, Sun Wenjin, et al. 2021. Improving significant wave height forecasts using a joint empirical mode decomposition–long short-term memory network. Journal of Marine Science and Engineering, 9(7): 744, doi: 10.3390/jmse9070744
Zhou Shuyi, Xie Wenhong, Lu Yuxiang, et al. 2021. ConvLSTM-based wave forecasts in the South and East China Seas. Frontiers in Marine Science, 8: 680079, doi: 10.3389/fmars.2021.680079
Year 2023 volume 42 Issue 10
PDF
81
45
Cite this Article
BibTeX
Article Info
doi: 10.1007/s13131-023-2246-y
  • Receive Date:2023-06-10
  • Online Date:2025-11-22
  • Published:2023-10-25
Article Data
Affiliations
History
  • Received:2023-06-10
  • Accepted:2023-08-15
Funding
The Project Supported by Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai) under contract No.SML2020SP007; the National Natural Science Foundation of China under contract Nos 42192562 and 62072249.
Affiliations
    1 School of Artificial Intelligence (School of Future Technology), Nanjing University of Information Science & Technology, Nanjing 210044, China
    2 Southern Marine Science and Engineering Guangdong Laboratory (Zhuhai), Zhuhai 519080, China
    3 School of Marine Sciences, Nanjing University of Information Science & Technology, Nanjing 210044, China

Corresponding:

* E-mail: ;leader author, E-mail: wangln@nuist.edu.cn
References
Share
https://castjournals.cast.org.cn/joweb/aos/EN/10.1007/s13131-023-2246-y
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数

Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)

Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT