Abstract

This paper examines the impact of omitted variable bias (OVB) within consumer choice models on engineering design optimization solutions. Engineering products often have a multitude of attributes that influence consumers’ purchasing decisions, many of which are difficult to include in revealed-preference models due to a lack of data. Correlations among these omitted variables and product attributes included in the model can bias demand parameter estimates. However, engineering design optimization studies typically do not account for this bias. We examine the influence consumer choice OVB can have on design optimization results. We first mathematically derive how OVB propagates into optimal design solutions and characterize properties of optimization problems that affect the magnitude of the resulting error in solutions. We then demonstrate the impact of OVB on optimal designs using a case study of automotive powertrain design optimization. In the case study, we estimate two sets of choice models: one using only “typically observed” vehicle attributes commonly found in the literature, and one with an additional set of “typically unobserved” attributes gathered from Edmunds.com. We find that the model with omitted variables leads to, in some scenarios, substantial bias in parameter estimates (5–143%), which propagates up to 21% error in the optimal engine size.

References

1.
Michalek
,
J. J.
,
Papalambros
,
P. Y.
, and
Skerlos
,
S. J.
,
2004
, “
A Study of Fuel Efficiency and Emission Policy Impact on Optimal Vehicle Design Decisions
,”
ASME J. Mech. Des.
,
126
(
6
), pp.
1062
1070
.
2.
Shiau
,
C.-S.
, and
Michalek
,
J.
,
2007
, “
A Game-Theoretic Approach to Finding Market Equilibria
,”
ASME 2007 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Las Vegas, NV
,
Sept. 4–7
, p.
9
.
3.
Wassenaar
,
H. J.
,
Chen
,
W.
,
Cheng
,
J.
, and
Sudjianto
,
A.
,
2005
, “
Enhancing Discrete Choice Demand Modeling for Decision-Based Design
,”
ASME J. Mech. Des.
,
127
(
4
), pp.
514
523
.
4.
Frischknecht
,
B.
, and
Papalambros
,
P. Y.
,
2008
, “
A Pareto Approach to [Q9]Aligning Public and Private Objectives in Vehicle Design
,”
Proceedings of the ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 1: 34th Design Automation Conference, Parts A and B
,
Brooklyn, NY
,
Aug. 3–6
, pp.
393
402
.
5.
Frischknecht
,
B. D.
,
Whitefoot
,
K.
, and
Papalambros
,
P. Y.
,
2010
, “
On the Suitability of Econometric Demand Models in Design for Market Systems
,”
ASME J. Mech. Des.
,
132
(
12
), p.
121007
.
6.
Whitefoot
,
K. S.
, and
Skerlos
,
S. J.
,
2012
, “
Design Incentives to Increase Vehicle Size Created From the U.S. Footprint-Based Fuel Economy Standards
,”
Energy Policy
,
41
, pp.
402
411
.
7.
Ross Morrow
,
W.
,
Long
,
M.
, and
MacDonald
,
E. F.
,
2014
, “
Market-System Design Optimization With Consider-Then-Choose Models
,”
ASME J. Mech. Des.
,
136
(
3
), p.
031003
.
8.
Besharati
,
B.
,
Luo
,
L.
,
Azarm
,
S.
, and
Kannan
,
P. K.
,
2006
, “
Multi-Objective Single Product Robust Optimization: An Integrated Design and Marketing Approach
,”
ASME J. Mech. Des.
,
128
(
4
), pp.
884
892
.
9.
Williams
,
N.
,
Azarm
,
S.
, and
Kannan
,
P. K.
,
2008
, “
Engineering Product Design Optimization for Retail Channel Acceptance
,”
ASME J. Mech. Des.
,
130
(
6
), p.
061402
.
10.
Wassenaar
,
H. J.
, and
Chen
,
W.
,
2003
, “
An Approach to Decision-Based Design With Discrete Choice Analysis for Demand Modeling
,”
ASME J. Mech. Des.
,
125
(
3
), pp.
490
497
.
11.
He
,
L.
,
Chen
,
W.
,
Hoyle
,
C.
, and
Yannou
,
B.
,
2012
, “
Choice Modeling for Usage Context-Based Design
,”
ASME J. Mech. Des.
,
134
(
3
), p.
031007
.
12.
Kroes
,
E. P.
, and
Sheldon
,
R. J.
,
1988
, “
Stated Preference Methods: An Introduction
,”
J. Trans. Econ. Policy
,
22
(
1
), pp.
11
25
.
13.
McCarthy
,
P. S.
,
1996
, “
Market Price and Income Elasticities of New Vehicle Demands
,”
Rev. Econ. Stat.
,
78
(
3
), p.
543
.
14.
Brownstone
,
D.
, and
Train
,
K.
,
1999
, “
Forecasting New Product Penetration With Flexible Substitution Patterns
,”
J. Econom.
,
89
(
1–2
), pp.
109
129
.
15.
Hoyle
,
C.
,
Chen
,
W.
,
Ankenman
,
B.
, and
Wang
,
N.
,
2009
, “
Optimal Experimental Design of Human Appraisals for Modeling Consumer Preferences in Engineering Design
,”
ASME J. Mech. Des.
,
131
(
7
), p.
071008
.
16.
Michalek
,
J. J.
,
Feinberg
,
F. M.
, and
Papalambros
,
P. Y.
,
2005
, “
Linking Marketing and Engineering Product Design Decisions via Analytical Target Cascading*
,”
J. Prod. Innov. Manage.
,
22
(
1
), pp.
42
62
.
17.
Dagsvik
,
J. K.
, and
Liu
,
G.
,
2009
, “
A Framework for Analyzing Rank-Ordered Data With Application to Automobile Demand
,”
Transp. Res. Part A: Policy Pract.
,
43
(
1
), pp.
1
12
.
18.
Chen
,
H. Q.
,
Honda
,
T.
, and
Yang
,
M. C.
,
2013
, “
Approaches for Identifying Consumer Preferences for the Design of Technology Products: A Case Study of Residential Solar Panels
,”
ASME J. Mech. Des.
,
135
(
6
), p.
061007
.
19.
Haaf
,
C. G.
,
Morrow
,
W. R.
,
Azevedo
,
I. M. L.
,
Feit
,
E. M.
, and
Michalek
,
J. J.
,
2016
, “
Forecasting Light-Duty Vehicle Demand Using Alternative-Specific Constants for Endogeneity Correction Versus Calibration
,”
Transp. Res. Part B: Methodol.
,
84
, pp.
182
210
.
20.
Grace Haaf
,
C.
,
Michalek
,
J. J.
,
Ross Morrow
,
W.
, and
Liu
,
Y.
,
2014
, “
Sensitivity of Vehicle Market Share Predictions to Discrete Choice Model Specification
,”
ASME J. Mech. Des.
,
136
(
12
), p.
121402
.
21.
Shiau
,
C.-S. N.
, and
Michalek
,
J. J.
,
2009
, “
Optimal Product Design Under Price Competition
,”
ASME J. Mech. Des.
,
131
(
7
), p.
071003
.
22.
Hoyle
,
C.
,
Chen
,
W.
,
Wang
,
N.
, and
Gomez-Levi
,
G.
,
2011
, “
Understanding and Modelling Heterogeneity of Human Preferences for Engineering Design
,”
J. Eng. Des.
,
22
(
8
), pp.
583
601
.
23.
Ma
,
J.
, and
Kim
,
H. M.
,
2014
, “
Continuous Preference Trend Mining for Optimal Product Design With Multiple Profit Cycles
,”
ASME J. Mech. Des.
,
136
(
6
), p.
061002
.
24.
Ferguson
,
C.-J.
,
Lees
,
B.
,
MacArthur
,
E.
, and
Irgens
,
C.
,
1998
, “
An Application of Data Mining for Product Design
,”
IEE Two-Day Colloquium on Knowledge Discovery and Data Mining
,
IEE
,
London, UK
, pp.
5
5
.
25.
MacDonald
,
E. F.
,
Gonzalez
,
R.
, and
Papalambros
,
P. Y.
,
2009
, “
Preference Inconsistency in Multidisciplinary Design Decision Making
,”
ASME J. Mech. Des.
,
131
(
3
), p.
031009
.
26.
Fitzsimons
,
G. J.
,
Hutchinson
,
J. W.
,
Williams
,
P.
,
Alba
,
J. W.
,
Chartrand
,
T. L.
,
Huber
,
J.
,
Kardes
,
F. R.
,
Menon
,
G.
,
Raghubir
,
P.
,
Russo
,
J. E.
,
Shiv
,
B.
, and
Tavassoli
,
N. T.
,
2002
, “
Non-Conscious Influences on Consumer Choice
,”
Mark. Lett.
,
13
(
3
), pp.
269
279
.
27.
Whitefoot
,
K. S.
,
Fowlie
,
M. L.
, and
Skerlos
,
S. J.
,
2017
, “
Compliance by Design: Influence of Acceleration Trade-Offs on CO2 Emissions and Costs of Fuel Economy and Greenhouse Gas Regulations
,”
Environ. Sci. Technol.
,
51
(
18
), pp.
10307
10315
.
28.
Dotson
,
J. P.
,
Beltramo
,
M. A.
,
Feit
,
E. M.
, and
Smith
,
R. C.
,
2012
, “
Controlling for Styling and Other ‘Complex Attributes’ in a Choice Model
,”
SSRN J.
, pp.
3
15
.
29.
Klier
,
T.
, and
Linn
,
J.
,
2012
, “
New-Vehicle Characteristics and the Cost of the Corporate Average Fuel Economy Standard
,”
RAND J. Econ.
,
43
(
1
), pp.
186
213
.
30.
Shiau
,
C.-S. N.
, and
Michalek
,
J. J.
,
2009
, “
Should Designers Worry About Market Systems?
,”
ASME J. Mech. Des.
,
131
(
1
), p.
011011
.
31.
Shiau
,
C.-S. N.
,
Michalek
,
J. J.
, and
Hendrickson
,
C. T.
,
2009
, “
A Structural Analysis of Vehicle Design Responses to Corporate Average Fuel Economy Policy
,”
Transp. Res. Part A: Policy Pract.
,
43
(
9–10
), pp.
814
828
.
32.
Helveston
,
J. P.
,
Liu
,
Y.
,
Feit
,
E. M.
,
Fuchs
,
E.
,
Klampfl
,
E.
, and
Michalek
,
J. J.
,
2015
, “
Will Subsidies Drive Electric Vehicle Adoption? Measuring Consumer Preferences in the U.S. and China
,”
Transp. Res. Part A: Policy Pract.
,
73
, pp.
96
112
.
33.
Greene
,
D.
,
Hossain
,
A.
, and
Beach
,
R.
,
2016
,
Consumer Willingness to Pay for Vehicle Attributes: What Is the Current State of Knowledge?
,
RTI International
,
Ann Arbor, MI
, 0213244.004.011.
34.
Linkov
,
J.
,
2019
,
Must-Have Features to Get in Your Next New Car, Consumer Reports
, https://www.consumerreports.org/automotive-technology/must-have-features-to-get-in-next-new-car/, Accessed June 1, 2021.
35.
Wooldridge
,
J. M.
,
2010
,
Econometric Analysis of Cross Section and Panel Data
,
MIT Press
,
Cambridge, MA
.
36.
Lee
,
L.-F.
,
1982
, “
Specification Error in Multinomial Logit Models: Analysis of the Omitted Variable Bias
,”
J. Econom.
,
20
(
2
), pp.
197
209
.
37.
Lütkepohl
,
H.
,
1982
, “
Non-Causality Due to Omitted Variables
,”
J. Econom.
,
19
(
2–3
), pp.
367
378
.
38.
Marais
,
M. L.
, and
Wecker
,
W. E.
,
1998
, “
Correcting for Omitted-Variables and Measurement-Error Bias in Regression With an Application to the Effect of Lead on IQ: Rejoinder
,”
J. Am. Stat. Assoc.
,
93
(
442
), p.
515
.
39.
Fan
,
Y.
, and
Li
,
Q.
,
1996
, “
Consistent Model Specification Tests: Omitted Variables and Semiparametric Functional Forms
,”
Econometrica
,
64
(
4
), pp.
865
890
.
40.
Canay
,
I.
,
Santos
,
A.
, and
Shaikh
,
A.
,
2013
, “
On the Testability of Identification in Some Nonparametric Models With Endogeneity
,”
Econometrica
,
81
(
6
), pp.
2535
2559
.
41.
Berry
,
S.
,
Levinsohn
,
J.
, and
Pakes
,
A.
,
1995
, “
Automobile Prices in Market Equilibrium
,”
Econometrica
,
63
(
4
), pp.
841
890
.
42.
Staiger
,
D.
, and
Stock
,
J.
,
1997
, “
Instrumental Variables Regression With Weak Instruments
,”
Econometrica
,
65
(
3
), pp.
557
586
.
43.
Stock
,
J.
, and
Yogo
,
M.
,
2002
,
Testing for Weak Instruments in Linear IV Regression t0284
,
National Bureau of Economic Research
,
Cambridge, MA
.
44.
Mytkowicz
,
T.
,
Diwan
,
A.
,
Hauswirth
,
M.
, and
Sweeney
,
P.
,
2010
, “
The Effect of Omitted-Variable Bias on the Evaluation of Compiler Optimizations
,”
Computer
,
43
(
9
), pp.
62
67
.
45.
Frischknecht
,
B.
,
Whitefoot
,
K.
, and
Papalambros
,
P.
,
2009
, “
Methods for Evaluating Suitability of Econometric Demand Models in Design for Market Systems
,”
35th Design Automation Conference, Parts A and B, ASMEDC
,
San Diego, CA
,
Aug. 30–Sept. 2
, Vol.
5
, pp.
397
406
.
46.
Chen
,
W.
,
Hoyle
,
C.
, and
Wassenaar
,
H. J.
,
2013
,
Decision-Based Design: Integrating Consumer Preferences Into Engineering Design
,
Springer
,
London
.
47.
Cameron
,
A. C.
, and
Trivedi
,
P.
,
2005
,
Macroeconometrics: Methods and Applications
,
Cambridge University Press
,
Cambridge, UK
.
48.
Yatchew
,
A.
, and
Griliches
,
Z.
,
1985
, “
Specification Error in Probit Models
,”
Rev. Econ. Stat.
,
67
(
1
), p.
134
.
49.
Yip
,
A. H. C.
,
Michalek
,
J. J.
, and
Whitefoot
,
K. S.
,
2019
, “
Implications of Competitor Representation on Optimal Design
,”
45th Design Automation Conference, American Society of Mechanical Engineers
,
Anaheim, CA
, Vol.
2A
, p.
V02AT03A045
.
50.
Angrist
,
J. D.
, and
Pischke
,
J.-S.
,
2009
,
Mostly Harmless Econometrics: An Empiricist’s Companion
,
Princeton University Press
,
Princeton
.
51.
Berry
,
S. T.
,
1994
, “
Estimating Discrete-Choice Models of Product Differentiation
,”
RAND J. Econ.
,
25
(
2
), p.
242
.
52.
Berry
,
S.
, and
Haile
,
P.
,
2014
, “
Identification in Differentiated Products Markets Using Market Level Data
,”
Econometrica
,
82
(
5
), pp.
1749
1797
.
53.
Angrist
,
J. D.
, and
Krueger
,
A. B.
,
1999
, “Empirical Strategies in Labor Economics,”
Handbook of Labor Economics
,
Elsevier
,
New York
, pp.
1277
1366
.
54.
Angrist
,
J. D.
, and
Krueger
,
A. B.
,
2001
, “
Instrumental Variables and the Search for Identification: From Supply and Demand to Natural Experiments
,”
J. Econ. Perspect.
,
15
(
4
), pp.
69
85
.
55.
Ahn
,
S. C.
,
Lee
,
Y. H.
, and
Schmidt
,
P.
,
2013
, “
Panel Data Models With Multiple Time-Varying Individual Effects
,”
J. Econom.
,
174
(
1
), pp.
1
14
.
56.
Nevo
,
A.
,
2000
, “
A Practitioner’s Guide to Estimation of Random-Coefficients Logit Models of Demand
,”
J. Econ. Manag. Strategy
,
9
(
4
), pp.
513
548
.
You do not currently have access to this content.