Product dissection has been highlighted as an effective means of interacting with example products in order to produce creative outcomes. While product dissection is often conducted as a team in engineering design education, the research on the effectiveness of product dissection activities has been primarily limited to individuals. Thus, the purpose of this study was to investigate the impact of the type(s) of product dissected in a team environment on encouraging creative design outcomes (variety, novelty, and quantity) and the underlying influence of educational level and dissection modality on these effects. This was accomplished through a computational simulation of 14,000 teams of noninteracting brainstorming individuals generated by a statistical bootstrapping technique using a design repository of 931 ideas generated by first-year and senior engineering students. The results of the study highlight the importance of educational level, dissection modality, and the number of products dissected on team design outcomes. Specifically, virtual dissection encouraged the exploration of more novel solutions across both educational levels. However, physical dissection encouraged the exploration of a larger variety and quantity of ideas for senior teams while virtual dissection encouraged the same in first-year teams. Finally, dissecting different types of products allowed teams to explore a larger solution space. The findings presented in this study can lead to a better understanding of how to deploy product dissection modules in engineering design education in order to drive creative design outcomes.

References

1.
Dym
,
C. L.
,
Agogino
,
A. M.
,
Eris
,
O.
,
Frey
,
D. D.
, and
Leifer
,
L. J.
,
2005
, “
Engineering Design Thinking, Teaching, and Learning
,”
J. Eng. Educ.
,
94
(
1
), pp.
103
120
.
2.
Melles
,
G.
,
Howard
,
Z.
, and
Thompson-Whiteside
,
S.
,
2012
, “
Teaching Design Thinking: Expanding Horizons in Design Education
,”
Procedia Soc. Behav. Sci.
,
31
, pp.
162
166
.
3.
Brown
,
T.
,
2008
, “
Design Thinking
,” Harvard Business Publishing, Boston, MA, p.
10
.
4.
Melsa
,
J. L.
,
Rajala
,
S. A.
, and
Mohsen
,
J.
,
2009
, “
Creating a Culture for Scholarly and Systematic Innovation in Engineering Education
,”
J. Eng. Educ.
,
98
(
3
), pp.
209
209
.
5.
Skaggs
,
P.
,
Fry
,
R.
, and
Wright
,
G.
,
2012
, “
Creating a Mindset for Innovation
,”
J. Strategic Innovation Sustainability
,
7
(
3
), pp.
95
99
.http://www.na-businesspress.com/jsis/skaggsp_web7_3_.pdf
6.
Badran
,
I.
,
2007
, “
Enhancing Creativity and Innovation in Engineering Education
,”
Eur. J. Eng. Educ.
,
32
(
5
), pp.
573
585
.
7.
Stouffer
,
W. B.
,
Russell
,
J. S.
, and
Oliva
,
M. G.
,
2004
, “
Making the Strange Familiar: Creativity and the Future of Engineering Education
,”
American Society for Engineering Education Annual Conference and Exposition
, Salt Lake City, UT, June 20–23, pp.
1
9
.https://www.researchgate.net/publication/246751147_Making_The_Strange_Familiar_Creativity_and_the_Future_of_Engineering_Education
8.
Genco
,
N.
,
Hölttä‐Otto
,
K.
, and
Seepersad
,
C. C.
,
2012
, “
An Experimental Investigation of the Innovation Capabilities of Undergraduate Engineering Students
,”
J. Eng. Educ.
,
101
(
1
), pp.
60
81
.
9.
West
,
R. E.
,
Tateishi
,
I.
,
Wright
,
G. A.
, and
Fonoimoana
,
M.
,
2012
, “
Innovation 101: Promoting Undergraduate Innovation Through a Two-Day Boot Camp
,”
Creativity Res. J.
,
24
(
2–3
), pp.
243
251
.
10.
Shah
,
J.
,
Kulkarni
,
S.
, and
Vargas-Hernandez
,
N.
,
2000
, “
Evaluation of Idea Generation Methods for Conceptual Design: Effectiveness Metrics and Design of Experiments
,”
ASME J. Mech. Des.
,
122
(
4
), pp.
377
384
.
11.
Maher
,
M. L.
,
Poon
,
J.
, and
Boulanger
,
S.
,
1996
, “
Formalising Design Exploration as Co-Evolution
,”
Advances in Formal Design Methods for CAD
,
Springer
, Boston, MA, pp.
3
30
.
12.
Dylla
,
N.
,
1991
, “
Thinking Methods and Procedures in Mechanical Design
,”
Technical University of Munich
, Munich, Germany.
13.
Song
,
S.
, and
Agogino
,
A. M.
,
2004
, “
Insights on Designers' Sketching Activities in New Product Design Teams
,”
ASME
Paper No. DETC2004-57474.
14.
Otto
,
K. N.
, and
Wood
,
K. L.
,
1998
, “
Product Evolution: A Reverse Engineering and Redesign Methodology
,”
Res. Eng. Des.
,
10
(
4
), pp.
226
243
.
15.
Lamancusa
,
J.
,
Jorgensen
,
J.
, and
Fridley
,
J.
,
1996
, “
Product Dissection—A Tool for Benchmarking in the Process of Teaching Design
,”
Frontiers in Education Conference
(
FIE
), Salt Lake City, UT, Nov. 6–9, pp. 1317–1321.
16.
Marchese
,
A. J.
,
Ramachandran
,
R. P.
,
Hesketh
,
R. P.
,
Schmalzel
,
J. L.
, and
Newell
,
H. L.
,
2003
, “
The Competitive Assessment Laboratory: Introducing Engineering Design Via Consumer Product Benchmarking
,”
IEEE Trans. Educ.
,
46
(
1
), pp.
197
205
.
17.
Brereton
,
M.
,
Sheppard
,
S.
, and
Leifer
,
L.
,
1995
, “
Students Connecting Engineering Fundamentals and Hardware Design: Observations and Implications for the Design of Curriculum and Assessment Methods
,”
Frontiers in Education Conference
(
FIE
), Atlanta, GA, Nov. 1–4, pp.
4d3.1
4d3.7
.
18.
Barr
,
R. E.
,
Schmidt
,
P. S.
,
Krueger
,
T. J.
, and
Twu
,
C.
,
2000
, “
An Introduction to Engineering Through an Integrated Reverse Engineering and Design Graphics Project
,”
J. Eng. Educ.
,
89
(
4
), pp.
413
418
.
19.
Sheppard
,
S. D.
,
1992
, “
Mechanical Dissection: An Experience in How Things Work
,” Engineering Education: Curriculum Innovation and Integration, Santa Barbara, CA, Jan. 6–10, pp. 6–10.
20.
Starkey
,
E. M.
,
Hunter
,
S. T.
, and
Miller
,
S. R.
,
2018
, “
Are Creativity and Self-Efficacy at Odds? An Exploration in Variations of Product Dissection in Engineering Education
,”
ASME J. Mech. Des.
,
141
(
1
), p.
012001
.
21.
Beaudoin
,
D. L.
, and
Llis
,
D. F.
,
1995
, “
A Product and Process Engineering Laboratory for Freshmen
,”
J. Eng. Educ.
,
84
(
3
), pp.
279
284
.
22.
Toh
,
C. A.
, and
Miller
,
S. R.
, “
Exploring the Utility of Product Dissection for Early-Phase Idea Generation
,”
ASME
Paper No. DETC2013-13096.
23.
Toh
,
C. A.
, and
Miller
,
S. R.
,
2014
, “
The Impact of Example Modality and Physical Interactions on Design Creativity
,”
ASME J. Mech. Des.
,
136
(
9
), p.
091004
.
24.
Starkey
,
E.
,
Mckay
,
A.
,
Hunter
,
S. T.
, and
Miller
,
S. R.
,
2016
, “
Dissecting Creativity: How Dissection Virtuality, Analogical Distance, And Product Complexity Impact Creativity and Self-Efficacy
,”
Seventh International Conference on Design Computing and Cognition
, Evanston, IL, June 27–29, p.
10
.
25.
Starkey
,
E. M.
,
McKay
,
A. S.
,
Hunter
,
S. T.
, and
Miller
,
S. R.
,
2018
, “
Piecing Together Product Dissection: How Dissection Conditions Impact Student Conceptual Understanding and Cognitive Load
,”
ASME J. Mech. Des.
,
140
(
5
), p.
052001
.
26.
Knight
,
D. W.
,
Carlson
,
L. E.
, and
Sullivan
,
J. F.
, “
Improving Engineering Student Retention Through Hands-On, Team Based, First-Year Design Projects
,”
International Conference on Research in Engineering Education
, Honolulu, HI, June 24–27, pp. 329–347.https://itll.colorado.edu/images/uploads/about_us/publications/Papers/ICREEpaperfinalin07octJEE.pdf
27.
Carlson
,
L. E.
, and
Sullivan
,
J. F.
,
1999
, “
Hands-On Engineering: Learning by Doing in the Integrated Teaching and Learning Program
,”
Int. J. Eng. Educ.
,
15
(
1
), pp.
20
31
.https://www.ijee.ie/articles/Vol15-1/Ijee1041.pdf
28.
Freuler
,
R. J.
,
Fentiman
,
A. W.
,
Demel
,
J. T.
,
Gustafson
,
R. J.
, and
Merrill
,
J. A.
,
2001
, “
Developing and Implementing Hands-On Laboratory Exercises and Design Projects for First Year Engineering Students
,”
American Society for Engineering Education Annual Conference
, Nashville, TN, June 24–27, p. 6.353.https://peer.asee.org/developing-and-implementing-hands-on-laboratory-exercises-and-design-projects-for-first-year-engineering-students.pdf
29.
Springer
,
L.
,
Stanne
,
M. E.
, and
Donovan
,
S. S.
,
1999
, “
Effects of Small-Group Learning on Undergraduates in Science, Mathematics, Engineering, and Technology: A Meta-Analysis
,”
Rev. Educ. Res.
,
69
(
1
), pp.
21
51
.
30.
Felder
,
R. M.
, and
Silverman
,
L. K.
,
1988
, “
Learning and Teaching Styles in Engineering Education
,”
Eng. Educ.
,
78
(
7
), pp.
674
681
.
31.
Stempfle
,
J.
, and
Badke-Schaub
,
P.
,
2002
, “
Thinking in Design Teams—An Analysis of Team Communication
,”
Des. Stud.
,
23
(
5
), pp.
473
496
.
32.
Zacharia
,
Z. C.
,
2007
, “
Comparing and Combining Real and Virtual Experimentation: An Effort to Enhance Students' Conceptual Understanding of Electric Circuits
,”
J. Comput. Assisted Learn.
,
23
(
2
), pp.
120
132
.
33.
Devendorf
,
M.
,
Lewis
,
K.
,
Simpson
,
T. W.
,
Stone
,
R. B.
, and
Regli
,
W. C.
, 2009, “
Evaluating the Use of Digital Product Repositories to Enhance Product Dissection Activities in the Classroom
,”
ASME J. Comput. Inf. Sci. Eng.
,
9
(4), p. 041008.
34.
Atman
,
C. J.
,
Cardella
,
M. E.
,
Turns
,
J.
, and
Adams
,
R.
,
2005
, “
Comparing Freshman and Senior Engineering Design Processes: An In-Depth Follow-Up Study
,”
Des. Studies
,
26
(
4
), pp.
325
357
.
35.
Atman
,
C. J.
,
1999
, “
A Comparison of Freshman and Senior Engineering Design Processes
,”
Des. Stud.
,
20
(
2
), pp.
131
152
.
36.
Atman
,
C. J.
,
2008
, “
Breadth in Problem Scoping: A Comparison of Freshman and Senior Engineering Students
,”
Int. J. Eng. Educ.
,
24
(
2
), pp.
234
245
.https://www.ijee.ie/latestissues/Vol24-2/s6_ijee2038.pdf
37.
Paulus, P., 2000, “
Groups, Teams, and Creativity: The Creative Potential of Idea-Generating Groups
,”
Appl. Psychol.
,
49
(2), pp. 237–262.https://product.design.umn.edu/courses/pdes2701/documents/5701papers/04bluesky/paulus00.pdf
38.
Paulus
,
P. B.
,
Dzindolet
,
M. T.
,
Poletes
,
G.
, and
Camacho
,
L. M.
,
1993
, “
Perception of Performance in Group Brainstorming: The Illusion of Group Productivity
,”
Pers. Soc. Psychol. Bull.
,
19
(
1
), pp.
78
89
.
39.
Van De Van
,
A.
, and
Delbecq
,
A. L.
,
1974
, “
The Effectiveness of Nominal, Delphi, and Interacting Group Decision Making Processes
,”
Acad. Manage. J.
,
17
(
4
), pp.
605
621
.
40.
Rietzschel
,
E. F.
,
Nijstad
,
B. A.
, and
Stroebe
,
W.
,
2006
, “
Productivity is Not Enough: A Comparison of Interactive and Nominal Brainstorming Groups on Idea Generation and Selection
,”
J. Exp. Soc. Psychol.
,
42
(
2
), pp.
244
251
.
41.
Lewis
,
A. C.
,
Sadosky
,
T. L.
, and
Connolly
,
T.
,
1975
, “
The Effectiveness of Group Brainstorming in Engineering Problem Solving
,”
IEEE Trans. Eng. Manage.
, (
3
), pp.
119
124
.
42.
Mullen
,
B.
,
Johnson
,
C.
, and
Salas
,
E.
,
1991
, “
Productivity Loss in Brainstorming Groups: A Meta-Analytic Integration
,”
Basic Appl. Soc. Psychol.
,
12
(
1
), pp.
3
23
.
43.
Eckert
,
C.
, and
Stacey
,
M.
,
2000
, “
Sources of Inspiration: A Language of Design
,”
Des. Stud.
,
21
(
5
), pp.
523
538
.
44.
Marsolek
,
C. J.
,
2003
, “
What is Priming and Why
?,”
Rethinking Implicit Memory
,
J. S.
Bowers
, and
C. J.
Marsolek
, eds.,
Oxford University Press
,
New York
, pp.
41
64
.
45.
Friedman
,
R. S.
,
Fishbach
,
A.
,
Förster
,
J.
, and
Werth
,
L.
,
2003
, “
Attentional Priming Effects on Creativity
,”
Creativity Res. J.
,
15
(
2
), pp.
277
286
.
46.
Liao
,
T.
, and
MacDonald
,
E. F.
,
2018
, “
Effects of Collage Priming on Sustainable Design Idea Creation and Assessment
,”
ASME
Paper No. DETC2018-86291.
47.
Walther
,
J.
,
Miller
,
S. E.
, and
Kellam
,
N. N.
,
2012
, “
Exploring the Role of Empathy in Engineering Communication Through a Transdisciplinary Dialogue
,”
ASEE Annual Conference and Exposition
, San Antonio, TX, June 10–13, p. 25.622.https://www.asee.org/public/conferences/8/papers/4670/download
48.
Gray
,
C. M.
,
McKIlligan
,
S.
,
Daly
,
S. R.
,
Seifert
,
C. M.
, and
Gonzalez
,
R.
,
2015
, “
Idea Generation Through Empathy: Reimagining the ‘Cognitive Walkthrough’
,”
ASEE Annual Conference and Exposition
, Seattle, WA, June 14–17, p.
24208
.https://lib.dr.iastate.edu/industrialdesign_conf/10/
49.
Johnson
,
D. G.
,
Genco
,
N.
,
Saunders
,
M. N.
,
Williams
,
P.
,
Seepersad
,
C.
, and
Hölttä-Otto
,
K.
,
2014
, “
An Experimental Investigation of the Effectiveness of Empathic Experience Design for Innovative Concept Generation
,”
ASME J. Mech. Des.
,
136
(
5
), p.
051009
.
50.
Herring
,
S. R.
,
Chang
,
C.-C.
,
Krantzler
,
J.
,
Bailey
,
B. P.
,
Greenberg
,
S.
,
Hudson
,
S.
,
Hinkley
,
K.
,
RingelMorris
,
M.
, and
Olsen
,
D.
,
2009
, “
Getting Inspired! Understanding How and Why Examples are Used in Creative Design Practice
,”
CHI Conference on Human Factors in Computing Systems
, Boston, MA, Apr. 4–9, pp.
87
96
.https://dl.acm.org/citation.cfm?id=1518717
51.
Eckert
,
C. M.
,
Stacey
,
M.
, and
Earl
,
C.
,
2005
, “
References to Past Designs
,”
Studying Designers
, Vol. 5, Open Research Online, pp.
3
21
.
52.
Chan
,
J.
,
Fu
,
K.
,
Schunn
,
C.
,
Cagan
,
J.
,
Wood
,
K.
, and
Kotovsky
,
K.
,
2011
, “
On the Benefits and Pitfalls of Analogies for Innovative Design: Ideation Performance Based on Analogical Distance, Commonness, and Modality of Examples
,”
ASME J. Mech. Des.
,
133
(
8
), p.
081004
.
53.
Jansson
,
D.
, and
Smith
,
S.
,
1991
, “
Design Fixation
,”
Des. Stud.
,
12
(
1
), pp.
3
11
.
54.
Viswanathan, V., and Linsey, J. S., 2013, “
Examining Design Fixation in Engineering Idea Generation: The Role of Example Modality
,”
Int. J. Des. Creativity Innovation
,
1
(2), pp. 109–129.
55.
Sio
,
U. N.
,
Kotovsky
,
K.
, and
Cagan
,
J.
,
2015
, “
Fixation or Inspiration? A Meta-Analytic Review of the Role of Examples on Design Processes
,”
Des. Stud.
,
39
, pp.
70
99
.
56.
Toh
,
C. A.
,
Miller
,
S. R.
, and
Okudan Kremer
,
G. E.
,
2014
, “
The Impact of Team-Based Product Dissection on Design Novelty
,”
ASME J. Mech. Des.
,
136
(
4
), p.
041004
.
57.
Hey
,
J.
,
Linsey
,
J.
,
Agogino
,
A. M.
, and
Wood
,
K. L.
,
2008
, “
Analogies and Metaphors in Creative Design
,”
Int. J. Eng. Educ.
,
24
(
2
), pp.
283
294
.https://www.ijee.ie/latestissues/Vol24-2/s11_ijee2031.pdf
58.
Bonnardel
,
N.
,
2000
, “
Towards Understanding and Supporting Creativity in Design: Analogies in a Constrained Cognitive Environment
,”
Knowl.-Based Syst. J.
,
13
(
7–8
), pp.
505
513
.
59.
Fu
,
K.
,
Chan
,
J.
,
Cagan
,
J.
,
Kotovsky
,
K.
,
Schunn
,
C.
, and
Wood
,
K.
,
2013
, “
The Meaning of ‘Near’ and ‘Far’: The Impact of Structuring Design Databases and the Effect of Distance of Analogy on Design Output
,”
ASME J. Mech. Des.
,
135
(
2
), p.
021007
.
60.
Kalogerakis
,
K.
,
Lüthje
,
C.
, and
Herstatt
,
C.
,
2010
, “
Developing Innovations Based on Analogies: Experience From Design and Engineering Consultants
,”
J. Prod. Innovation Manage.
,
27
(
3
), pp.
418
436
.
61.
Goucher-Lambert
,
K.
, and
Cagan
,
J.
,
2017
, “
Using Crowdsourcing to Provide Analogies for Designer Ideation in a Cognitive Study
,”
21st International Conference on Engineering Design (ICED 17)
, Vol.
8
: Human Behaviour in Design, Vancouver, Canada, BC, Aug. 21–25, pp.
529
538
.
62.
Linsey
,
J.
,
Murphy
,
J.
,
Markman
,
A.
,
Wood
,
K.
, and
Kurtoglu
,
T.
,
2006
, “
Representing Analogies: Increasing the Probability of Innovation
,”
ASME
Paper No. DETC2006-99383.
63.
Ball
,
L. J.
,
Lambell
,
N. J.
,
Reed
,
S. E.
, and
Reid
,
F. J.
,
2001
, “
The Exploration of Solution Options in Design: A ‘Naturalistic Decision Making’ Perspective
,”
Designing in Context
,
Delft University Press
,
Delft, The Netherlands
, pp.
79
93
.
64.
Petre
,
M.
,
2004
, “
How Expert Engineering Teams Use Disciplines of Innovation
,”
Des. Stud.
,
25
(
5
), pp.
477
493
.
65.
Linsey
,
J. S.
,
Clauss
,
E. F.
,
Kurtoglu
,
T. T.
,
Murphy
,
J. T.
,
Wood
,
K. L.
, and
Markman
,
A. B.
,
2011
, “
An Experimental Study of Group Idea Generation Techniques: Understanding the Roles of Idea Representation and Viewing Methods
,”
ASME J. Mech. Des.
,
133
(
3
), p.
031008
.
66.
Horton
,
J.
,
1980
, “
Nominal Group Technique
,”
Anaesthesia
,
35
(
8
), pp.
811
814
.
67.
Delp
,
P.
,
Thesen
,
A.
,
Motiwalla
,
J.
, and
Seshardi
,
N.
,
1977
, “
Nominal Group Technique
,”
System Tools for Project Planning
, International Development Institute, Bloomington, IN, pp.
14
18
.
68.
Delbecq
,
A. L.
,
Van de Ven
,
A. H.
, and
Gustafson
,
D. H.
,
1975
,
Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes
,
Scott Foresman
,
Glenview, IL
.
69.
Oxley
,
N. L.
,
Dzindolet
,
M. T.
, and
Paulus
,
P. B.
,
1996
, “
The Effects of Facilitators on the Performance of Brainstorming Groups
,”
J. Soc. Behav. Pers.
,
11
(
4
), p.
633
.http://psycnet.apa.org/record/1997-03261-001
70.
Paulus
,
P. B.
, and
Dzindolet
,
M. T.
,
1993
, “
Social Influence Processes in Group Brainstorming
,”
J. Pers. Soc. Psychol.
,
64
(
4
), pp.
575
586
.
71.
McKenna
,
A. F.
,
Chen
,
W.
, and
Simpson
,
T. W.
,
2008
, “
Exploring the Impact of Virtual and Physical Dissection Activities on Students' Understanding of Engineering Design Principles
,”
ASME
Paper No. DETC2008-49783.
72.
Zacharia
,
Z. C.
,
Olympiou
,
G.
, and
Papaevripidou
,
M.
,
2008
, “
Effects of Experimenting With Physical and Virtual Manipulatives on Students' Conceptual Understanding in Heat and Temperature
,”
J. Res. Sci. Teach.
,
45
(
9
), pp.
1021
1035
.
73.
Chou
,
S. W.
, and
Liu
,
C. H.
,
2005
, “
Learning Effectiveness in a Web‐Based Virtual Learning Environment: A Learner Control Perspective
,”
J. Comput. Assisted Learn.
,
21
(
1
), pp.
65
76
.
74.
Chittaro
,
L.
, and
Ranon
,
R.
,
2007
, “
Web3D Technologies in Learning, Education and Training: Motivations, Issues, Opportunities
,”
Comput. Educ.
,
49
(
1
), pp.
3
18
.
75.
Feinberg
,
S.
, and
Murphy
,
M.
,
2000
, “
Applying Cognitive Load Theory to the Design of Web-Based Instruction
,”
IEEE
Professional Communication Society International Professional Communication Conference and Proceedings of the 18th Annual ACM International Conference on Computer Documentation: Technology and Teamwork
, Cambridge, MA, Sept. 24–27, pp.
353
360
.
76.
Bhatnagar
,
A.
,
2015
, “
Product Dissection: A Method for Hands on Engineering Education
,”
J. Eng. Educ. Transform.
,
28
(3), pp.
99
104
.
77.
Starkey
,
E. M.
,
Spencer
,
C.
,
Lesniak
,
K.
,
Tucker
,
C.
, and
Miller
,
S. R.
,
2017
, “
Do Technological Advancements Lead to Learning Enhancements?: An Exploration in Virtual Product Dissection
,”
ASME
Paper No. DETC2017-68237.
78.
Toh
,
C. A.
,
Miller
,
S. R.
, and
Simpson
,
T. W.
,
2015
, “
The Impact of Virtual Product Dissection Environments on Student Learning and Self-Efficacy
,”
J. Eng. Des.
,
26
(
1–3
), pp.
48
73
.
79.
Im
,
I.
,
Kim
,
Y.
, and
Han
,
H.-J.
,
2008
, “
The Effects of Perceived Risk and Technology Type on Users' Acceptance of Technologies
,”
Inf. Manage.
,
45
(
1
), pp.
1
9
.
80.
Toh
,
C. A.
, and
Miller
,
S. R.
,
2013
, “
Exploring the Utility of Product Dissection for Early-Phase Idea Generation
,”
ASME
Paper No. DETC2013-13096.
81.
McComb
,
C.
,
Cagan
,
J.
, and
Kotovsky
,
K.
,
2017
, “
Optimizing Design Teams Based on Problem Properties: Computational Team Simulations and an Applied Empirical Test
,”
ASME J. Mech. Des.
,
139
(
4
), p.
041101
.
82.
McComb
,
C.
,
Cagan
,
J.
, and
Kotovsky
,
K.
,
2015
, “
Lifting the Veil: Drawing Insights About Design Teams From a Cognitively-Inspired Computational Model
,”
Des. Stud.
,
40
, pp.
119
142
.
83.
Mooney
,
C. Z.
,
Duval
,
R. D.
, and
Duvall
,
R.
,
1993
,
Bootstrapping: A Nonparametric Approach to Statistical Inference
,
SAGE Publications
, Newbury Park, CA.
84.
Wright
,
D. B.
,
2007
, “
Calculating Nominal Group Statistics in Collaboration Studies
,”
Behav. Res. Methods
,
39
(
3
), pp.
460
470
.
85.
Shah
,
J.
,
Vargas-Hernandez
,
N.
, and
Smith
,
S. M.
,
2003
, “
Metrics for Measuring Ideation Effectiveness
,”
Des. Stud.
,
24
(
2
), pp.
111
124
.
86.
Nelson
,
B. A.
, and
Wilson
,
J. O.
,
2009
, “
Redefining Metrics for Measuring Ideation Effectiveness
,”
Des. Stud.
,
30
(
6
), pp.
737
743
.
87.
Zheng
,
X.
,
Ritter
,
S. C.
, and
Miller
,
S. R.
,2018, “
How Concept Selection Tools Impact the Development of Creative Ideas in Engineering Design Education
,”
ASME. J. Mech. Des.
,
140
(5), p. 052002.
88.
Frigge
,
M.
,
Hoaglin
,
D. C.
, and
Iglewicz
,
B.
,
1989
, “
Some Implementations of the Boxplot
,”
Am. Stat.
,
43
(
1
), pp.
50
54
.
89.
Jaccard
,
J.
,
1998
,
Interaction Effects in Factorial Analysis of Variance
, Vol.
118
,
SAGE Publications
, Newbury Park, CA.
90.
Cardella
,
M. E.
,
Atman
,
C. J.
, and
Adams
,
R. S.
,
2006
, “
Mapping Between Design Activities and External Representations for Engineering Student Designers
,”
Des. Stud.
,
27
(
1
), pp.
5
24
.
91.
Nielsen
,
J.
,
1994
, “
Heuristic Evaluations
,”
Usability Inspection Methods
,
J.
Nielsen
, and
R. L.
Mack
, eds.,
Wiley
,
New York
, pp.
25
64
.
92.
Nielsen
,
J.
,
2003
, “
Usability 101: Introduction to Usability
,” Nielsen Norman Group, Fremont, CA, accessed Jan. 4, 2012, http://www.nngroup.com/articles/usability-101-introduction-to-usability/
93.
Nielsen
,
J.
,
1994
,
Usability Engineering
,
Academic Press
,
San Diego, CA
.
You do not currently have access to this content.