12th International Conference on Applications of Statistics and Probability in Civil Engineering, ICASP12 Vancouver, Canada, July 12-15, 2015 1Operational Modal Analysis using Variational Bayes Binbin Li PhD Student, Dept. of Civil and Environmental Engineering, University of California, Berkeley, USA Armen Der Kiureghian Taisei Professor, Dept. of Civil and Environmental Engineering, University of California, Berkeley, USA ABSTRACT: Operational modal analysis is the primary tool for modal parameters identification in civil engineering. Bayesian statistics offers an ideal framework for analyzing uncertainties associated with the identified modal parameters. However, the exact Bayesian analysis is usually intractable due to the high computation demanding in obtaining the posterior distributions of modal parameters. In this paper, the variational Bayes is employed to provide an approximated solution. Working with the state space representation of a dynamic system, the joint distribution of the state transition matrix and observation matrix as well as the joint distribution of the process noise and measurement error are firstly obtained analytically using conjugate priors, then the distributions of modal parameters are extracted from these obtained joint distributions based on sampling because no closed form solution exists. A numerical simulation example demonstrates the performance of the proposed approach. The variational Bayes yields a consistent estimation of modal parameters although the variability is slightly under-estimated. Moreover, the variational Bayes is more flexible than the Laplace approximation and much more efficient than Monte Carlo sampling. 1. INTRODUCTION Modal parameters (i.e. modal frequencies, damping ratios and mode shapes) are the characteristic properties of linear structural model. They are directly related to the mass and stiffness distribution, which are influenced by changes in support and continuity conditions as well as material properties. The identification of modal parameters has become a standard tool for model updating, damage detection and condition assessment. Controlled dynamic test usually yields accurate estimation of modal parameters, but it is not often applicable to civil structures due to their huge size, high load capacity and noisy operational conditions. Therefore, the operational modal analysis (OMA), which utilizes only the stochastic dynamic response, becomes the primary modal testing method in civil engineering. The basic assumption in OMA is that sources of excitations are broad-band stochastic processes adequately modeled by band-limited white noise. Since the main source of random vibration in civil structures comes from wind, traffic, ground tremor and low magnitude of earthquake, this assumption could be generally satisfied. Modal identification has been a subject of extensive research, and a recent review can be found in Reynders (2012). Since the signal-to-noise ratio cannot be directly controlled and various uncertainties impact on different stages of OMA, the uncertainty associated with the identified modal parameters should be a primary concern. The impact of uncertainties on operational modal identification has been seriously studied, e.g. Ciloglu, et al. (2006), and they showed that both the aleatory and epistemic uncertainties have significant influence on OMA. Realizing this, many researchers began to improve some original deterministic algorithms to provide the uncertainty information using 12th International Conference on Applications of Statistics and Probability in Civil Engineering, ICASP12 Vancouver, Canada, July 12-15, 2015 2perturbation method, e.g. Reynders, et al. (2008), Lam and Mevel (2011). These perturbation-based methods are limited to estimating variance but the variance itself is insufficient to determine confidence intervals if the modal parameters exhibit non-normal distributions. In addition, Bayesian approach is also applied to determine the uncertainty in identified modal parameters. Both Yuen and Katafygiotis (2001) and Au (2013) applied the Laplace approximation to identify modal parameters from the time domain and frequency domain, respectively. In this paper, a more flexible approximation called variational Bayes (VB) is employed for the purpose of modal identification. The VB is a deterministic approach to analytically approximate the posterior distribution of parameters, and the fundamental principle is to find a surrogate distribution close to the true posterior while making inference tractable. In statistics, Beal (2003) applied the VB framework to identify of state space model (SSM), in which, however, the prior setting does not respect the invariance under coordinate transformation and is not allowed online identification. In control-related area, Fujimoto, et al. (2011) introduced a conjugate prior for the full covariance matrix to fix the aforementioned drawbacks for the input-output system identification. However, in all previous formulations, the state transition matrix and observation matrix are assumed to be statistically independent as well as the process and measurement noise. Since the SSM is invariant under coordinate transformation, these assumptions seems inappropriate. In addition, the VB works in an iterative way and the prior is also updated in each iteration in previous setting, which can incur the under-estimation of variability. Therefore, focusing on output-only modal identification, we formulate a new VB algorithm to include the aforementioned statistical correlations by introducing the matrix variate distribution, and modify the updating procedure to alleviate the under-estimation of variability. 2. VARIATIONAL BAYES This section is intended to provide a broad overview of the variational Bayes algorithm in a general setting. The fundamental idea of VB is to approximate the posterior distribution by a tractable surrogate distribution, and it is suitable to infer the latent variable model. To be more precise, let’s see a simple linear model, ൌ ࢨ 1) ࣕ) in which ∈ Թ is the observed variable, ∈Թ is the latent variable, ࣕ ∈ Թ represents the measurement error, ࢨ ∈ Թൈ is the model parameter, which is a random matrix. The above model can also be represented as a probabilistic graphic model (PGM) shown Figure 1, in which each node is associated with a random variable and directed link refers to a conditional dependence. Figure 1: Probabilistic Graphical Model. The problem is to infer the posterior distribution |ࢨሺ|ࣂሻ given the data and the prior distribution ࢨߨሺࣂ, ሻ. Since ࢨ and are coupled in this model, there are rare cases that can be solved analytically. Instead, we try to find a surrogate distribution ࢨݍ∗ ሺࣂ, ሻ from a predetermined family ℚ to minimize the distance from the true posterior distribution |ࢨሺࣂ, |ሻ in the measure of Kullback-Leibler (KL) divergence. Formally, ࢨݍ∗ ሺࣂ, ሻ ൌ minࢨ KL ሾࢨݍሺࣂ, ሻ|||ࢨሺࣂ, |ሻሿ ൌ minࢨ ∬ࢨݍሺࣂ, ሻ lnࢨሺ,ࣂሻ|ࢨ൫ࣂ, ห൯ ݀2) ݀ࣂ) Usually, it’s hard to evaluate the KL divergence in Eq. (2), but we can find an alternative way to minimize it without direct evaluation. The log marginal likelihood of the observed variable gives ln ሺሻ ൌ ∬ࢨݍሺࣂ, ሻ ln ሺሻ ݀݀ࣂ ൌ ∬ࢨݍሺࣂ, ሻ ln ࢨሺ,,ࣂሻ|ࢨ൫ࣂ, ห൯ ݀݀ࣂ 12th International Conference on Applications of Statistics and Probability in Civil Engineering, ICASP12 Vancouver, Canada, July 12-15, 2015 3ൌ ∬ࢨݍሺࣂ, ሻ ln ࢨሺ,ࣂሻ|ࢨ൫ࣂ, ห൯ ݀݀ࣂ ∬ࢨݍሺࣂ, ሻ ln ࢨ|ሺ,ࣂ|ሻగࢨሺ,ࣂሻࢨሺ,ࣂሻ ݀݀ࣂ ≜ KLሾࢨݍሺࣂ, ሻ|||ࢨሺࣂ, |ሻሿ Fሾࢨݍሺࣂ, ሻሿ (3) Since the log marginal likelihood keeps constant given the model, minimizing the KL divergence is equivalent to maximizing the free energy Fሾࢨݍሺࣂ, ሻሿ. On the other hand, the free energy works as a lower bound of the log mar-ginal likelihood since the KL divergence is always non-negative; therefore, we can regard the variational Bayes as maximizing the marginal likelihood by increasing its lower bound. Because ࢨ and are still coupled in Eq. (2), mean field approximation are further introduced to make an independence assumption between ࢨ and , i.e. ࢨݍሺࣂ, ሻ ൌ ࢨݍሺࣂሻݍሺሻ . Although this assumption may seem abrupt, one may think of it as replacing stochastic dependence between ࢨ and by deterministic dependencies between relevant moments of two sets of variables. If we further specify independent priors for ࢨ and , Eq. (3) can be rewritten as Fሾࢨݍሺࣂ, ሻሿ ൎ Fሾࢨݍሺࣂሻ, ݍሺሻሿ ൌ ∬ࢨݍሺࣂሻݍሺሻ lnࢨ|ሺࣂ|, ሻ ݀݀ࣂ െࢨݍሺࣂሻ ln ࢨሺࣂሻగࢨሺࣂሻ ݀ࣂ െ ݍሺሻ lnሺሻగሺሻ ݀ ൌ Eࢨൣln ࢨ|ሺࣂ|, ሻ൧ െ KLሾࢨݍሺࣂሻ||ࢨߨሺࣂሻሿ െKLሾݍሺሻ||ߨሺሻሿ (4) where Eࢨሾ∙ሿ means the expectation operator with respect to the joint distribution of ࢨ and . Then in order to maximizing the free energy Fሾࢨݍሺࣂሻ, ݍሺሻሿ , we have to reduce the KL divergences between the approximating distributions and prior distributions and simultaneously increase the expected log conditional likelihood, which can be done using the following theorem, and the updating procedures are illustrated in Figure 2. Theorem 1. Variational Bayesian EMP (VB-EMP) Let ࣧ be a statistical model with parameter ࢨ giving rise to an observed data set with corresponding latent variable . The free energy Fሾࢨݍሺࣂሻ, ݍሺሻሿ given in Eqn. (4) can be iteratively optimized by performing the following updates, using superscript ݐ to denote iteration step: VB Expectation step (VBE): ݍሺ௧ାଵሻሺሻ ൌܼିଵߨሺ௧ሻሺሻ expሾ ࢨݍሺ௧ሻሺࣂሻ ln ࢨ|ሺࣂ|, ሻ ݀ࣂሿ VB Maximization step (VBM): ࢨݍሺ௧ାଵሻሺࣂሻൌ ܼିࢨଵࢨߨሺ௧ሻሺࣂሻ expሾනݍሺ௧ሻሺሻ ln ࢨ|ሺࣂ|, ሻ ݀ሿ VB Prior-updating step (VBP): ࢨߨሺ௧ାଵሻሺࣂሻ ൌ ࢨݍሺ௧ାଵሻሺࣂሻ; ߨሺ௧ሻሺሻ ൌ ݍሺ௧ାଵሻሺሻ. where ܼ and ܼࢨ are normalizing constants. Moreover, each step will increase Fሾࢨݍሺࣂሻ, ݍሺሻሿ monotonically, and converge to a local maximum. Due the limited length of the paper, all proofs are neglected. The preceding theorem shows that the VB-EMP algorithm is guaranteed to converge to local maximum monotonically, and in particular, for the exponential family, Wang & Titterington (2004) have proved that it is consistent, i.e. converging to the true value in asymptotic sense, whenever the starting value is sufficiently near the true. It also can be seen that the priors are updated in each iteration, so that it becomes narrower and narrower, resulting in the under-estimation of variability. Figure 2: Variational Bayes EMP. 3. STOCHASTIC SSM The equation of motion of a discrete, linear, and time-invariant dynamical system with ௗܰ degrees of freedom (DOFs) under stochastic external force and ground motion is described by 12th International Conference on Applications of Statistics and Probability in Civil Engineering, ICASP12 Vancouver, Canada, July 12-15, 2015 4ሷ ሺݐሻ ௗሶ ሺݐሻ ሺݐሻ ൌ ሺݐሻ െሷ ሺݐሻ; ሺ0ሻ ൌ , ሶ ሺ0ሻ ൌ ሶ (5) where ∈ Թேൈே , ௗ ∈ Թேൈே and ∈Թேൈே are the mass, damping and stiffness matrices, respectively; ሺݐሻ ∈ Թே , ሶ ሺݐሻ ∈ Թே and ሷ ሺݐሻ ∈ Թே are the nodal displacement, velocity and acceleration responses relative to the ground motion; ሺݐሻ ∈ Թே is the external force vector; ∈ Թேൈே is the load coefficient matrix representing the spatial influence of the external force; ሷ ሺݐሻ ∈ Թே is the ground acceleration vector, and ∈ Թேൈே is the corresponding influence matrix. ∈ Թே and ሶ ∈ Թே are the initial relative displacement and velocity vectors. Note that we consider both of external force and ground motion to represent the general source of random excitation. For system identification, it’s convenient to convert Eq. (5) into a state-space model. After discretization in time, the state space equation of motion takes the form (Reynders, 2012), ାଵ ൨ ൌ ቂቃ ቂ ቃ (6) where ൌ ൣ ሶ ൧ ∈ Թேೞ ( ௦ܰ ൌ 2 ௗܰ ) is the state vector, ∈ Թே is the recorded response at time ݇ ௦ܶ for ݇ ൌ 1,2, … ,ܰ, ௦ܶ is the sampling period. represents the joint effect of model error and unknown input and stands for the joint effect of measurement error and input uncertainty, and they can be modeled as zero-mean Gaussian band-limited white noise with unknown covariance ࢳ ൌ ሾ, ; , ሿ .More specifically, the state transition matrix ∈Թேೞൈேೞ and the observation matrix ∈ Թேൈேೞ have the following form if only accelerations are recorded: ൌ exp ൬ ௦ܶ ே ேെିଵ െିଵௗ൨൰ ൌ ሾെିଵ െିଵௗሿ (7) in which ∈ Թேൈே is a selection matrix to represent we can only measure ܰሺ ௦ܰሻ DOFs of the structure. It is well-known that the state transition matrix and observation matrix are only unique up to similarity transformation, i.e. for one input-output pair or output only, there are possibly infinite pairs of ’s and ’s satisfying Eq. (6). However, the modal parameters are invariant under similarity transformation, therefore they could be uniquely determined from the measured data.The modal parameters can be extracted from and using the following steps: (1) Take the eigenvalue decomposition: ൌିࢸࢫࢸଵ; (2) Partition the eigenvalue and eigenvector matrices: ࢫ ൌ ቂࣅ ࣅതቃ, ࢸ ൌ ሾ ഥሿ (3) Calculate modal parameters: ߱ ൌ |ln ߣ|/ ௦ܶ, ߦ ൌ ܴ݁ሺln ߣሻ/|ln ߣ|, ࣘ ൌ where ߱ , ߦ and ࣘ are the ݅ th modal frequencies, damping ratios and mode shapes; ߣ and are the ݅ th diagonal element and ݅ th column of ࣅ and ; ࣅത and ഥ are the complex conjugates of ࣅ and , respectively. 4. APPICATION OF VB IN SSM Since modal parameters can be extracted from SSM, the problem becomes how to identify the model parameters ࢣ ൌ ሾ ሿ and covariance matrix ࢳ given the observed sequence ଵ:ே ≜ ሼଵ, … , ேሽ. Note that matrices and in Eq. (7) share some common terms, leading them to be statistically correlated; therefore, the parameter ࢣ is considered as a matrix random variable in our formulation. If the covariance matrix ࢳ is also a matrix random variable, we can use the PGM shown in Figure 3 to represent the stochastic SSM in Eq. (6). As is the usual case in latent variable model, the parameter ࢨ ≜ሼࢣ, ࢳሽ and latent variable ଵ:ேାଵ ≜ሼଵ, … , ேାଵሽ are coupled, leading the exact Bayesian inference analytically intractable. Now, we apply the variational Bayes framework to crack this difficulty, i.e. to find the factorized distributions ࢳࢣݍሺࢽ, ሻݍభ:ಿశభሺଵ:ேାଵሻ to approximate the true posterior ࢳࢣభ:ಿశభ|భ:ಿሺࢽ, , ଵ:ேାଵ|ଵ:ேሻ. 12th International Conference on Applications of Statistics and Probability in Civil Engineering, ICASP12 Vancouver, Canada, July 12-15, 2015 5 Figure 3: PGM representation for stochastic SSM Before applying the theorem 1, let’s define conjugate priors for parameters ࢣ and ࢳ . Conjugate priors are commonly used in Bayesian statistics in order to get a closed-form solution for posteriors. For the PGM in Figure 3, we assume a matrix normal (MN), inverse Wishart (IW) distribution, i.e. ࢳࢣߨሺࢽ, ሻ ൌ ࢳ|ࢣߨሺ|ࢽሻࢳߨሺሻ ൌ ܰܯሺࢣࣆ, ࢰ,ࢳሻܹܫሺ݀,ሻ (8) where ܰܯሺࢣࣆ, ࢰ,ࢳሻ is the probability density function (PDF) of matrix normal distribution with mean matrix ࢣࣆ ∈ Թሺேೞାேೞሻൈேೞ , left and right covariance ࢳ ∈ Թሺேೞାேሻൈሺேೞାேሻ and ࢰ ∈Թேೞൈேೞ , respectively. ܹܫሺ݀,ሻ means the PDF of inverse Wishart distribution with ݀ DOFs and scale matrix . For the distribution of latent variables ଵ:ேାଵ, we only need to specify a prior for ଵ , then this information will propagate to ଶ:ேାଵ automatically through the chain structure. Then, we specify a multivariable normal distribution with unknown mean ࣆଵ and covariance ଵ, i.e. భ ൌ ܰሺࣆଵ, ଵሻ. As stated in Section 2, the uncertainty would be underestimated if the priors are updated in each iteration, so that we choose not to update the prior of ࢣ and ࢳ but only the prior of ଵ. Similar to the Theorem 1, we can apply the basic procedure of variational Bayes to the more complicated stochastic SSM, and this is achieved by the following theorem. Theorem 2. Considering the PGM shown in Figure 3 and prior distributions of parameters ࢣ and ࢳ in Eq. (8), and denote ൌ ൣାଵ ൧, the following statements hold: (1) The free energy function Fሾࢳࢣݍሺࢽ, ሻ, ݍభ:ಿశభሺଵ:ேାଵሻሿ is given by Fൣࢳࢣݍሺࢽ, ሻ, ݍభ:ಿశభሺଵ:ேାଵሻ൧ ൌ െ∬ࢳࢣݍሺࢽ, ሻ ln ࢳࢣሺ,ࢽሻగࢳࢣሺ,ࢽሻ ݀݀ࢽ െݍభ:ಿశభሺଵ:ேାଵሻ lnభ:ಿశభሺభ:ಿశభሻగభሺభሻ݀ଵ:ேାଵ ∭ࢳࢣݍሺࢽ, ሻݍభ:ಿశభሺଵ:ேାଵሻ ∑ ln ೖ|ࢳࢣೖሺݖ|ࢽ, , ଵ:ேାଵሻேୀଵ ݀݀݀ࢽଵ:ேାଵ (2) Fሾࢳࢣݍሺࢽ, ሻ, ݍభ:ಿశభሺଵ:ேାଵሻሿ can be iteratively optimized by performing the following updates, using superscript ݐ to denote iteration step: VBE step: ݍభ:ಿశభሺ௧ାଵሻ ሺଵ:ேାଵሻ ∝ exp ൜െ ଵଶ ቀଵ െ ࣆଵሺ௧ሻቁ ଵሺ௧ሻቀଵ െ ࣆଵሺ௧ሻቁ ݀ሺ௧ሻ ∑ ቀࢠ െ ࢣࣆሺ௧ሻቁሺ௧ሻିଵቀࢠ െ ࢣࣆሺ௧ሻቁேୀଵ ሺ ௦ܰ ܰሻࢰሺ௧ሻ൨ൠ VBM step: |ࢳࢣݍభ:ಿሺ௧ାଵሻ ሺࢽ, |ଵ:ேሻ ൌ MN൫ࣆሺ௧ାଵሻ, ࢰ,ࢳሺ௧ାଵሻ൯IWሺ݀ሺ௧ାଵሻ, ሺ௧ାଵሻሻ with ࢰሺ௧ାଵሻ ൌ ൣିࢰଵ ∑ Eೖ|భ:ಿ൫൯ୀ ൧ିଵ , ࢣࣆሺ௧ାଵሻ ൌ ൣ∑ Eೖ:ೖశభ|భ:ಿ൫ࢠ൯ୀ ିࢰࢣࣆଵ൧ࢰሺ௧ାଵሻ, ݀ሺ௧ାଵሻ ൌ ݀ ܰ, ሺ௧ାଵሻ ൌ ∑ Eೖశభ|భ:ಿ൫ࢠ൯ୀ ࢣࣆሺ௧ሻࢰሺ௧ሻିଵࢣࣆሺ௧ሻ െ ࢣࣆሺ௧ାଵሻࢰሺ௧ାଵሻିଵࢣࣆሺ௧ାଵሻ. VBH step: 1ࣆ൫ݐ1൯ ൌ E1|1:ܰ൫1൯, ଵሺ௧ାଵሻ ൌ Eభ|భ:ಿሾሺଵ െ ࣆෝଵሺ௧ାଵሻሻሺଵ െ ࣆෝଵሺ௧ାଵሻሻ ሿ. Initialized by setting ࣆଵሺଵሻ ൌ ࣆଵ , ଵሺଵሻ ൌ ଵ , ࢣࣆሺଵሻ ൌ ࢰ ,ࢣࣆሺଵሻ ൌ ࢰ, ݀ሺଵሻ ൌ ݀ and ሺଵሻ ൌ . Moreover, each step will increase Fሾࢳࢣݍሺࢽ, ሻ, ݍభ:ಿశభሺଵ:ேାଵሻሿ monotonically, and converge to a local maximum. 12th International Conference on Applications of Statistics and Probability in Civil Engineering, ICASP12 Vancouver, Canada, July 12-15, 2015 6Theorem 2 provides the foundation to iteratively get the posterior distribution of parameters and latent variable. However, the expectation quantities in the VBM step have not been evaluated explicitly so far. Due to the special structure of ݍభ:ಿశభሺଵ:ேାଵሻ, the standard Kalman smoother is not directly applicable, and some transformations are needed in advance. The basic steps are as follows: (1) Make the following definitions and the Cholesky decomposition ࢣࣆሺ௧ሻ ൌ ഥഥ൨,ሺሻௗሺሻିேೞିேିଵ ൌ ഥ ഥഥ ഥ൨, ሺ ௦ܰ ܰሻࢰሺ௧ሻ ൌ 2) ) Construct new parameters for SSM: ൌ ேೞ൨ , ෩ ൌ ഥ൨ , ෩ ൌ ቈഥ ேൈேೞேೞൈே ேೞ , ෩ ൌ ഥ െ ഥഥିଵഥ, ෩ ൌ ഥ െ ഥഥିଵഥ (3) Based on these new parameters, the square-root filtering algorithm (Gibson & Ninness, 2005) is applied to calculate expectation terms. Although the posterior distribution ࢳࢣݍሺࢽ, ሻ can be obtained exactly using Theorem 2, there is no closed form solution for the distribution of modal parameters because the eigenvalue decomposition is involved from ࢣ to modal parameters. Therefore, the Monte Carlo sampling is applied to approximate the distributions of modal parameters. This step is straightforward because it is easy to sample the posterior distribution of ࢣ which can be proved to be a matrix variate-t distribution. 5. EMPIRICAL STUDY In order to demonstrate the performance of the proposed algorithm, the modal identification of a simulated 8-DOF mass-spring system (Figure 4) is provided in this section. The model parameters are as follows: ݉ ൌ 1, ݇ ൌ 800݅ for ݅ ൌ 1,… ,9 and Rayleigh damping matrix ௗ ൌ0.69 1.743 ൈ 10ିସ . The same input, modeled by band-limited white noise, is applied to all DOFs. The acceleration responses at DOFs 2, 4, 6 and 8 are recorded with sampling frequency 25 Hz for 200 seconds. Then, these responses are contaminated by independent Gaussian white noise with variance equal to 25 % of the largest acceleration variance. Besides the VB algorithm, the Expectation-Maximization algorithm (Gibson & Ninness, 2005) and the Gibbs sampling (Shumway & Stoffer, 2011) are also implemented for comparison, and all are initialized by the same parameters identified from stochastic subspace identification. Figure 4: 8-DOF mass-spring system. Table 1 Identified Modal Parameters using EM, VB and Gibbs Sampler Mode Frequencies Damping Ratios (%) True EM VB Gibbs True EM VB Gibbs Mean COV(%) Mean COV(%) Mean COV(%) Mean COV(%)1 2.94 2.92 2.94 0.21 2.93 0.34 2.00 2.00 1.93 9.95 1.87 18.25 2 5.87 5.88 5.87 0.19 5.88 0.21 1.24 1.16 1.30 14.59 1.29 15.79 3 8.60 8.57 8.56 0.14 8.56 0.16 1.10 1.07 1.09 12.74 1.03 15.27 4 11.19 11.21 11.22 0.11 11.20 0.13 1.09 0.79 0.78 12.55 0.84 15.05 5 13.78 13.77 13.74 0.12 13.75 0.15 1.15 1.22 1.24 9.98 1.33 12.04 6 16.52 16.54 16.54 0.11 16.55 0.13 1.23 1.07 1.20 9.33 1.12 11.82 7 19.54 19.54 19.53 0.13 19.56 0.17 1.35 1.34 1.78 7.38 1.33 12.94 8 23.12 23.09 23.08 0.12 23.06 0.14 1.50 1.56 1.77 7.03 1.44 10.54 12th International Conference on Applications of Statistics and Probability in Civil Engineering, ICASP12 Vancouver, Canada, July 12-15, 2015 7 Figure 5: Empirical CDF of identified modal frequencies Solid line: variational Bayes; Dash-dot line: Gibbs sampler; Star: true value. Figure 6: Boxplot of identified mode shapes Blue: variational Bayes; Red: Gibbs sampler; Dot line: true value. Table 1 lists the identified modal frequencies and damping ratios as well as the coefficient of variation (COV) for variational Bayes and Gibbs samplers (1800 samples). By comparing the point estimators (MLE or posterior means), all three methods are consistent, although slight bias exists. Of all the three methods, the EM seems the most accurate, while the VB and Gibbs give similar performance. The COVs of variational Bayes are always smaller than those of Gibbs simpler, about 15% less. The comparison of empirical cumulative distribution functions (CDF) of modal frequencies are shown in Figure 5. Again, we can see the distributions estimated from VB shows less variant than those estimated from Gibbs sampler, but both are relatively close in most cases. The same phenomena can be oberserved from the empirical CDF of damping ratios, thus these plots are ignored. The boxplot of identified mode shapes are illustrated in Figure 6, in which both the VB and Gibbs sample provide accurate estimation of mode shapes, while the variations in identified mode shapes by VB are still smaller than those by Gibbs sampler. In SSM-based modal identification, another issue encountered is how to identify the physical modes from the estimated model. In this paper, we will not solve this problem thoroughly, but provide an empirical evidence that the physical modes can be identified based on the uncertainty information. For this 8-DOF mass-spring system, an order of 24 is specified in the SSM, so that 12th International Conference on Applications of Statistics and Probability in Civil Engineering, ICASP12 Vancouver, Canada, July 12-15, 2015 8there are 4 spurious modes. Figure 7 shows the COV of identified frequencies and standard deviation of damping ratios for the VB. The interesting observation is that the spurious modes corresponds to the peaks in the graph, i.e. the spurious modes have significantly larger uncertainties than the physical modes. The intuitive explanation behind this phenomenon, similar to that of stabilization diagram (Reynders, et al., 2012), is that the physical modes should be consistent in different realization while the spurious computational and noise modes have no reason to be focused. Figure 7: Spurious modes identification. 6. CONCLUSIONS An operational modal analysis approach based on variational Bayes was introduced in this paper. Through the empirical study the OMA of an 8-DOF mass-spring system, the following conclusions can be derived: (1) The posterior mean of VB estimator is consistent for modal parameters, and VB estimator tends to under-estimate the variability comparing with the Gibbs sampler. (2) The variational Bayes approach works in the sense of coordinate ascent and neither gradient nor Hessian matrix are required in optimization. (3) The uncertainty information provided by VB can be used to remove the spurious modes, and this is a good point worth further study. (4) Of the three approaches, the VB approach is recommended, because the EM algorithm only gives a point estimation, while the computation demanding of Gibbs sampler is too high to be applied in practice. 7. REFERENCES Au, S, Zhang, F. and Ni, Y. (2013). "Bayesian operational modal analysis: Theory, computation, practice." Computers and Structures 126: 3–14. Beal, M. (2003). "Variational Algorithms for Approximate Bayesian Inference." University College London, UK, PhD Dissertation. Ciloglu, S. (2006). “The Impact of Uncertainty in Operational Modal Analysis For Structural Identification of Constructed Systems”. Drexel University, USA, PhD disseration. Fujimoto, K., Satoh, A. and Fukunaga S. (2011). "System Identification Based on Variational Bayes Method and The Invariance under Coordinate Transformations." 50th IEEE CDC-ECC. Orlando, FL, USA. 3882-3888. Gibson, S., and Ninness, B. 2005. "Robust maximum-likelihood estimation of multivariable dynamic systems." Automatica 4: 1667–1682. Lam, X., and Mevel, L. (2011). "Uncertainty Quantification for Eigensystem-Realization-Algorithm, A Class of Subspace System Identification." Proceedings of the 18th IFAC World Congress. Milan, Italy. Reynders, E. (2012). "System Identification Methods for (Operational) Modal Analysis: Review and Comparison." Archives of Computational Methods in Engineering 19: 51-124. Reynders, E., Pintelon, R., and De Roeck, G. (2008). "Uncertainty bounds on modal parameters obtained from stochastic subspace identification." Mechanical Systems and Signal Processing 22: 948 – 969. Shumway, R., and Stoffer, D. (2011). Time Series Analysis and Its Applications: With R Examples. 3rd. New York, USA: Springer. Wang, B., and Titterington, D. (2004). "Convergence and asymptotic normality of variational Bayesian approximations for exponential family models with missing values." Banff, Canada: AUAI Press. 577-584. Yuen, K, and Katafygiotis L. (2001). "Bayesian time-domain approach for modal updating using ambient data." Probabilitic Engineering Mechanics 16: 219-231.
- Library Home /
- Search Collections /
- Open Collections /
- Browse Collections /
- International Conference on Applications of Statistics and Probability in Civil Engineering (ICASP) (12th : 2015) /
- Operational modal analysis using variational Bayes
Open Collections
International Conference on Applications of Statistics and Probability in Civil Engineering (ICASP) (12th : 2015)
Operational modal analysis using variational Bayes Li, Binbin; Der Kiureghian, Armen Jul 31, 2015
pdf
Page Metadata
Item Metadata
Title | Operational modal analysis using variational Bayes |
Creator |
Li, Binbin Der Kiureghian, Armen |
Contributor | International Conference on Applications of Statistics and Probability (12th : 2015 : Vancouver, B.C.) |
Date Issued | 2015-07 |
Description | Operational modal analysis is the primary tool for modal parameters identification in civil engineering. Bayesian statistics offers an ideal framework for analyzing uncertainties associated with the identified modal parameters. However, the exact Bayesian analysis is usually intractable due to the high computation demanding in obtaining the posterior distributions of modal parameters. In this paper, the variational Bayes is employed to provide an approximated solution. Working with the state space representation of a dynamic system, the joint distribution of the state transition matrix and observation matrix as well as the joint distribution of the process noise and measurement error are firstly obtained analytically using conjugate priors, then the distributions of modal parameters are extracted from these obtained joint distributions based on sampling because no closed form solution exists. A numerical simulation example demonstrates the performance of the proposed approach. The variational Bayes yields a consistent estimation of modal parameters although the variability is slightly under-estimated. Moreover, the variational Bayes is more flexible than the Laplace approximation and much more efficient than Monte Carlo sampling. |
Genre |
Conference Paper |
Type |
Text |
Language | eng |
Notes | This collection contains the proceedings of ICASP12, the 12th International Conference on Applications of Statistics and Probability in Civil Engineering held in Vancouver, Canada on July 12-15, 2015. Abstracts were peer-reviewed and authors of accepted abstracts were invited to submit full papers. Also full papers were peer reviewed. The editor for this collection is Professor Terje Haukaas, Department of Civil Engineering, UBC Vancouver. |
Date Available | 2015-05-22 |
Provider | Vancouver : University of British Columbia Library |
Rights | Attribution-NonCommercial-NoDerivs 2.5 Canada |
IsShownAt | 10.14288/1.0076155 |
URI | http://hdl.handle.net/2429/53364 |
Affiliation |
Non UBC |
Citation | Haukaas, T. (Ed.) (2015). Proceedings of the 12th International Conference on Applications of Statistics and Probability in Civil Engineering (ICASP12), Vancouver, Canada, July 12-15. |
Peer Review Status | Unreviewed |
Scholarly Level | Faculty |
Rights URI | http://creativecommons.org/licenses/by-nc-nd/2.5/ca/ |
AggregatedSourceRepository | DSpace |
Download
- Media
- 53032-Paper_405_Li.pdf [ 343.99kB ]
- Metadata
- JSON: 53032-1.0076155.json
- JSON-LD: 53032-1.0076155-ld.json
- RDF/XML (Pretty): 53032-1.0076155-rdf.xml
- RDF/JSON: 53032-1.0076155-rdf.json
- Turtle: 53032-1.0076155-turtle.txt
- N-Triples: 53032-1.0076155-rdf-ntriples.txt
- Original Record: 53032-1.0076155-source.json
- Full Text
- 53032-1.0076155-fulltext.txt
- Citation
- 53032-1.0076155.ris
Full Text
Cite
Citation Scheme:
Usage Statistics
Share
Embed
Customize your widget with the following options, then copy and paste the code below into the HTML
of your page to embed this item in your website.
<div id="ubcOpenCollectionsWidgetDisplay">
<script id="ubcOpenCollectionsWidget"
src="{[{embed.src}]}"
data-item="{[{embed.item}]}"
data-collection="{[{embed.collection}]}"
data-metadata="{[{embed.showMetadata}]}"
data-width="{[{embed.width}]}"
async >
</script>
</div>
Our image viewer uses the IIIF 2.0 standard.
To load this item in other compatible viewers, use this url:
http://iiif.library.ubc.ca/presentation/dsp.53032.1-0076155/manifest