Validation of computational models with multiple correlated functional responses requires the consideration of multivariate data correlation, uncertainty quantification and propagation, and objective robust metrics. This paper presents an enhanced Bayesian based model validation method together with probabilistic principal component analysis (PPCA) to address these critical issues. The PPCA is employed to handle multivariate correlation and to reduce the dimension of the multivariate functional responses. The Bayesian interval hypothesis testing is used to quantitatively assess the quality of a multivariate dynamic system. The differences between the test data and computer-aided engineering (CAE) results are extracted for dimension reduction through PPCA, and then Bayesian interval hypothesis testing is performed on the reduced difference data to assess the model validity. In addition, physics-based threshold is defined and transformed to the PPCA space for Bayesian interval hypothesis testing. This new approach resolves some critical drawbacks of the previous methods and adds some desirable properties of a model validation metric for dynamic systems, such as symmetry. Several sets of analytical examples and a dynamic system with multiple functional responses are used to demonstrate this new approach.

References

1.
Oberkampf
,
W. L.
, 2005, “
Overview of Verification, Validation and Predictive Capability
,” Sandia National Laboratories, Albuquerque, NM, Report No. SAND2005-1824P.
2.
Ferson
,
S.
,
Oberkampf
,
W. L.
, and
Ginzburg
,
L.
, 2008, “
Model Validation and Predictive Capability for the Thermal Challenge Problem
,”
Comput. Methods Appl. Mech. Eng.
,
197
(
29–32
), pp.
2408
2430
.
3.
Oberkampf
,
W. L.
, and
Barone
,
M. F.
, 2006, “
Measures of Agreement Between Computation and Experiment: Validation Metrics
,”
J. Comput. Phys.
,
217
(
1
), pp.
5
36
.
4.
Oberkampf
,
W. L.
, and
Trucano
,
T. G.
, 2006, “
Design of and Comparison with Verification and Validation Benchmarks
,” Sandia National Laboratories, Albuquerque, NM, Technical Report Sand No. 2006-5376C.
5.
Schwer
,
L. E.
, 2007, “
Validation Metrics for Response Histories: Perspectives and Case Studies
,”
Eng. Comput.
,
23
(
4
), pp.
295
309
.
6.
Sarin
,
H.
,
Kokkolaras
,
M.
,
Hulbert
,
G.
,
Papalambros
,
P.
,
Barbat
,
S.
, and
Yang
,
R. J.
, 2010, “
Comparing Time Histories for Validation of Simulation Models: Error Measures and Metrics
,”
ASME J. Dyn. Syst., Meas., Control
,
132
, p.
061401
.
7.
Mahadevan
,
S.
, and
Rebba
,
R.
, 2005, “
Validation of Reliability Computational Models Using Bayes Networks
,”
Reliab. Eng. Syst. Saf.
,
87
(
2
), pp.
223
232
.
8.
Rebba
,
R.
, and
Mahadevan
,
S.
, 2006, “
Model Predictive Capability Assessment Under Uncertainty
,”
AIAA J.
,
44
(
10
), pp.
2376
2384
.
9.
Jiang
,
X.
, and
Mahadevan
,
S.
, 2007, “
Bayesian Risk-Based Decision Method For Model Validation Under Uncertainty
,”
Reliab. Eng. Syst. Saf.
,
92
(
6
), pp.
707
718
.
10.
Jiang
,
X.
, and
Mahadevan
,
S.
, 2008, “
Bayesian Wavelet Method for Multivariate Model Assessment of Dynamical Systems
,”
J. Sound Vib.
,
312
(
4–5
), pp.
694
712
.
11.
Jiang
,
X.
,
Yang
,
R. J.
,
Barbat
,
S.
, and
Weerappuli
,
P.
, 2009, “
“Bayesian Probabilistic PCA Approach for Model Validation of Dynamic Systems
,”
SAE Int. J. Mater. Manuf.
,
2
(
1
), pp.
555
563
.
12.
Tipping
,
M. E.
, and
Bishop
,
C. M.
, 1999, “
Probabilistic Principal Component Analysis
,”
J. R. Stat. Soc. Ser. B (Stat. Methodol.)
,
61
(
3
), pp.
611
622
.
13.
Fu
,
Y.
,
Jiang
,
X.
, and
Yang
,
R. J.
, 2009, “
Auto-Correlation of an Occupant Restraint System Model Using a Bayesian Validation Metric
,”
Detroit, MI
, April 20–23, SAE Paper No. 2009-01-1402.
14.
Pai
,
Y.
, 2009, “
Investigation of Bayesian Model Validation Framework for Dynamic Systems
,” Master’s thesis, University of Michigan, Ann Arbor, MI.
15.
Pai
,
Y.
,
Kokkolaras
,
M.
,
Hulbert
,
G.
,
Papalambros
,
P.
,
Pozolo
,
M.
,
Fu
,
Y.
, and
Yang
,
R. J.
, 2009, “
Assessment of a Bayesian Model and Test Validation Method
,”
2009 National Defense Industrial Association Ground Vehicle Systems Engineering and Technology Symposium
,
Troy, Michigan
(short paper), Aug. 18–20.
16.
Fu
,
Y.
,
Zhan
,
Z.
, and
Yang
,
R. J.
, 2010, “
A Study of Model Validation Method for Dynamic Systems
,”
Detroit, MI
, April 12–15, SAE Paper No. 2010-01-0419.
17.
Hotelling
,
H.
, 1933, “
Analysis of a Complex of Statistical Variables into Principal Components
,”
J. Educ. Psychol.
,
24
, pp.
417
441
.
18.
Joliffe
,
I. T.
, 2002,
Principal Component Analysis
Springer
,
New York
.
19.
Migon
,
H. S.
, and
Gamerman
,
D.
, 1999,
Statistical Inference—An Integrated Approach
Arnold
,
London, UK
.
20.
Kass
,
R.
, and
Raftery
,
A.
, 1995, “
Bayes Factors
,”
J. Am. Stat. Assoc.
,
90
(
430
), pp.
773
795
.
You do not currently have access to this content.