Abstract

Prototyping is an important part of the design process, but researchers currently have a limited understanding of how the resources invested in a prototype or designer teams’ intent for a prototype influence decision-making and perceptions of a prototype’s value. Prior work has shown that significant investment of time or money in design tasks can lead to design fixation, but little work has explored how these factors might impact design teams’ perceived value of prototypes with respect to the design process. Likewise, it is unclear how resource allocation and prototype intention effects the evolution of design team knowledge and subsequent design actions. To explore these relationships, an in situ study of prototyping tendencies was performed across two mechanical engineering design courses. Results suggest that effective design teams leveraged prototypes to uncover new design knowledge and limit uncertainty early in the design process. Importantly, this study did not find any significant relationships between the cost of a prototype in terms of money and time, and the perceived value of that prototype. Nor were any significant relationships found between costs and final design outcomes. Findings suggest that the true cost and value of a prototype with respect to design outcomes are challenging to explicitly quantify.

References

1.
Camburn
,
B.
,
Viswanathan
,
V.
,
Linsey
,
J.
,
Anderson
,
D.
,
Jenson
,
D.
,
Crawford
,
R.
,
Otto
,
K.
, and
Wood
,
K.
,
2017
, “
Design Prototyping Methods: State of the Art in Strategies, Techniques, and Guidelines
,”
Des. Sci.
,
3
(
13
), pp.
1
33
. 10.1017/dsj.2017.10
2.
Camburn
,
B. A.
,
Dunlap
,
B. U.
,
Kuhr
,
R.
,
Viswanathan
,
V. K.
,
Linsey
,
J. S.
,
Jensen
,
D. D.
,
Crawford
,
R. H.
,
Otto
,
K.
, and
Wood
,
K. L.
,
2013
, “
Methods for Prototyping Strategies in Conceptual Phases of Design: Framework and Experimental Assessment
,”
Volume 5: 25th International Conference on Design Theory and Methodology; ASME 2013 Power Transmission and Gearing Conference
,
Portland, OR
,
June 5
, p.
V005T06A033
.
3.
Lauff
,
C.
,
Kotys-Schwartz
,
D.
, and
Rentschler
,
M. E.
,
2017
, “
Perceptions of Prototypes: Pilot Study Comparing Students and Professionals
,”
Volume 3: 19th International Conference on Advanced Vehicle Technologies; 14th International Conference on Design Education; 10th Frontiers in Biomedical Devices
,
Cleveland, OH
,
Aug. 6–9
, p.
V003T04A011
.
4.
Drezner
,
J. A.
, and
Huang
,
M.
,
2009
, “
On Prototyping: Lessons from RAND Research
.”
5.
Hess
,
T.
, and
Summers
,
J. D.
,
2013
, “
Case Study: Evidence of Prototyping Roles in Conceptual Design
,”
International Conference on Engineering Design, ICED13
,
Seoul, South Korea
,
Aug. 19–22
, pp.
249
258
.
6.
Berglund
,
A.
,
Leifer
,
L.
,
Berglund
,
A.
, and
Leifer
,
L.
,
2013
, “
Why We Prototype ! An International Comparison of the Linkage Between Embedded Knowledge and Objective Learning Why We Prototype ! An International Comparison of the Linkage Between Embedded Knowledge and Objective Learning
,”
Eng. Education
,
8
(
1
), pp.
2
15
. 10.11120/ened.2013.00004
7.
Tiong
,
E.
,
Seow
,
O.
,
Camburn
,
B.
,
Teo
,
K.
,
Silva
,
A.
,
Wood
,
K. L.
,
Jensen
,
D. D.
, and
Yang
,
M. C.
,
2019
, “
The Economies and Dimensionality of Design Prototyping: Value, Time, Cost, and Fidelity
,”
J. Mech. Des.
,
141
(
3
). 10.1115/1.4042337
8.
Bohmer
,
A. I.
,
Sheppard
,
S.
,
Kayser
,
L.
, and
Lindemann
,
U.
,
2018
, “
Prototyping as a Thinking Approach in Design Insights of Problem-Solving Activities While Designing a Product
,”
2017 International Conference on Engineering, Technology and Innovation: Engineering, Technology and Innovation Management Beyond 2020: New Challenges, New Approaches, ICE/ITMC 2017—Proceedings
,
Funchal, Portugal
,
June 27–29
, pp.
955
963
.
9.
Jensen
,
M. B.
,
Elverum
,
C. W.
, and
Steinert
,
M.
,
2017
, “
Eliciting Unknown Unknowns With Prototypes: Introducing Prototrials and Prototrial-Driven Cultures
,”
Des. Studies
,
49
(
1
), pp.
1
31
. 10.1016/j.destud.2016.12.002
10.
Sutcliffe
,
A.
, and
Sawyer
,
P.
,
2013
, “
Requirements Elicitation: Towards the Unknown Unknowns
,”
2013 21st IEEE International Requirements Engineering Conference, RE 2013—Proceedings
,
Rio de Janeiro, Brazil
.
11.
Lauff
,
C. A.
,
Knight
,
D.
,
Kotys-Schwartz
,
D.
, and
Rentschler
,
M. E.
,
2020
, “
The Role of Prototypes in Communication Between Stakeholders
,”
Design Studies
,
66
(
1
), pp.
1
34
. 10.1016/j.destud.2019.11.007
12.
Viswanathan
,
V. K.
, and
Linsey
,
J. S.
,
2013
, “
Role of Sunk Cost in Engineering Idea Generation: An Experimental Investigation
,”
ASME J. Mech. Des.
,
135
(
12
), pp.
1
12
. 10.1115/1.4025290
13.
Viswanathan
,
V. K.
, and
Linsey
,
J. S.
,
2012
, “
Physical Models and Design Thinking: A Study of Functionality, Novelty and Variety of Ideas
,”
ASME J. Mech. Des.
,
134
(
9
), p.
091004
. 10.1115/1.4007148
14.
Linsey
,
J. S.
,
Tseng
,
I.
,
Fu
,
K.
,
Cagan
,
J.
,
Wood
,
K. L.
, and
Schunn
,
C.
,
2010
, “
A Study of Design Fixation, Its Mitigation and Perception in Engineering Design Faculty
,”
ASME J. Mech. Des.
,
132
(
4
), p.
0410031
. 10.1115/1.4001110
15.
Dow
,
S. P.
,
Fortuna
,
J.
,
Schwartz
,
D. L.
,
Altringer
,
B.
,
Schwartz
,
D. L.
, and
Klemmer
,
S. R.
,
2011
, “
Prototyping Dynamics : Sharing Multiple Designs Improves Exploration, Group Rapport, and Results
,”
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
,
Montréal Québec Canada
,
April, 2006
.
16.
Yang
,
M. C.
, and
Daniel
,
J.
,
2005
, “
A Study of Prototypes, Design Activity, and Design Outcome
,”
Des. Studies
,
26
(
6
), pp.
649
669
. 10.1016/j.destud.2005.04.005
17.
Loch
,
C. H.
,
Terwiesch
,
C.
, and
Thomke
,
S.
,
2001
, “
Parallel and Sequential Testing of Design Alternatives
,”
Manage. Sci.
,
47
(
5
), pp.
663
678
. 10.1287/mnsc.47.5.663.10480
18.
Camburn
,
B.
,
Dunlap
,
B.
,
Gurjar
,
T.
,
Hamon
,
C.
,
Green
,
M.
,
Jensen
,
D.
,
Crawford
,
R.
,
Otto
,
K.
, and
Wood
,
K.
,
2015
, “
A Systematic Method for Design Prototyping
,”
ASME J. Mech. Des.
,
137
(
8
), p.
081102
. 10.1115/1.4030331
19.
Moe
,
R. E.
,
Jensen
,
D. D.
, and
Wood
,
K. L.
,
2004
, “
Prototype Partitioning Based on Requirement Flexibility
,”
ASME 2004 International Design Engineering Technical Conference
,
Salt Lake City, UT
,
Sept. 28–Oct. 2
, pp.
1
13
.
20.
Dow
,
S. P.
,
Glassco
,
A.
,
Kass
,
J.
,
Schwarz
,
M.
,
Schwartz
,
D. L.
, and
Klemmer
,
S. R.
,
2012
, “
Parallel Prototyping Leads to Better Design Results, More Divergence, and Increased Self-Efficacy
,”
Des. Thinking Res.
,
17
(
4
), pp.
127
153
. 10.1007/978-3-642-21643-5_8
21.
Menold
,
J.
,
Jablokow
,
K. W.
, and
Simpson
,
T. W.
,
2017
, “
Prototype for X (PFX): A Holistic Framework for Structuring Prototyping Methods to Support Engineering Design
,”
Des. Studies
,
50
(
1
), pp.
70
112
. 10.1016/j.destud.2017.03.001
22.
Hamon
,
C. L.
,
Green
,
M. G.
,
Dunlap
,
B.
,
Camburn
,
B. A.
,
Crawford
,
R. H.
, and
Jensen
,
D. D.
,
2014
, “
Virtual or Physical Prototypes? Development and Testing of a Prototyping Planning Tool
,”
Proceedings of 121st ASEE Annual Conference and Exposition
,
Indianapolis, IN
,
June 15–18
, pp.
1
15
.
23.
Camburn
,
B. A.
,
Jensen
,
D.
,
Sng
,
K. H.
,
Perez
,
K. B.
,
Otto
,
K.
,
Wood
,
K. L.
, and
Crawford
,
R.
,
2015
, “
The Way Makers Prototype : Principles of DIY Design
,”
Proceedings of the ASME 2015 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference
,
Boston, MA
,
Aug. 2–5
, pp.
1
10
.
24.
Hartmann
,
B.
,
2009
,
Gaining design insight through interaction prototyping tools. Unpublished doctoral thesis, Stanford University, Stanford, CA
.
25.
Deininger
,
M.
,
Daly
,
S. R.
,
Lee
,
J. C.
,
Seifert
,
C. M.
, and
Sienko
,
K. H.
,
2019
, “
Prototyping for Context: Exploring Stakeholder Feedback Based on Prototype Type, Stakeholder Group and Question Type
,”
Res. Eng. Des.
,
30
(
4
), pp.
453
471
. 10.1007/s00163-019-00317-5
26.
Otto
,
K.
, and
Wood
,
K.
,
2001
,
Product Design: Techniques in Reverse Engineering and New Product Development
, Vol.
1
,
Prentice-Hall
,
Upper Saddle River, N.J
.
27.
Dieter
,
G.
, and
Schmidt
,
L.
,
2013
,
Engineering Design
,
McGraw-Hill
,
New York, NY
.
28.
Maher
,
M. L.
,
Poon
,
J.
, and
Boulanger
,
S.
,
1996
, “
Formalising Design Exploration as Co-Evolution: A Combined Gene Approach
,”
Advances in Formal Design Methods for CAD
,
1996
(
1
), pp.
3
30
. https://doi.org/10.1007/978-0-387-34925-1_1
29.
Dorst
,
K.
, and
Cross
,
N.
,
2001
, “
Creativity in the Design Process: Co-Evolution of Problem-Solution
,”
Des. Studies
,
22
(
5
), pp.
425
437
.
30.
Wiltschnig
,
S.
,
Christensen
,
B. T.
, and
Ball
,
L. J.
,
2013
, “
Collaborative Problem-Solution Co-Evolution in Creative Design
,”
Des. Studies
,
34
(
5
), pp.
515
542
. 10.1016/j.destud.2013.01.002
31.
Bryan
,
A.
,
Ko
,
J.
,
Hu
,
S. J.
, and
Koren
,
Y.
,
2007
, “
Co-evolution of Product Families and Assembly Systems
,”
CIRP Ann. Manuf. Technol.
,
56
(
1
), pp.
41
44
. 10.1016/j.cirp.2007.05.012
32.
Liu
,
X.
,
Du
,
G.
,
Jiao
,
R. J.
, and
Xia
,
Y.
,
2018
, “
Co-evolution of Product Family Configuration and Supplier Selection: A Game-Theoretic Bilevel Optimisation Approach
,”
J. Eng. Des.
,
29
(
4–5
), pp.
201
234
. 10.1080/09544828.2018.1461814
33.
Dorst
,
K.
,
2019
, “
Co-Evolution and Emergence in Design
,”
Des. Studies
,
65
(
1
), pp.
60
77
. 10.1016/j.destud.2019.10.005
34.
Böhmer
,
A. I.
,
Kayser
,
L.
,
Sheppard
,
S.
, and
Lindemann
,
U.
,
2017
, “
Insights of Problem-Solving Activities While Designing a Product
,”
International Conference on Engineering Technology and Innovation (ICE/ITMC)
,
Funchal, Portugal
,
June 27–29
, pp.
955
963
.
35.
Gerber
,
E.
, and
Carroll
,
M.
,
2012
, “
The Psychological Experience of Prototyping
,”
Des. Studies
,
33
(
1
), pp.
64
84
. 10.1016/j.destud.2011.06.005
36.
Cooper
,
R.
,
2001
, “
Winning at New Products
,”
Ivey Business J.
,
64
(
6
), pp.
54
60
.
37.
Jansson
,
D. G.
, and
Smith
,
S. M.
,
1991
, “
Design Fixation
,”
Des. Studies
,
12
(
1
), pp.
3
11
. 10.1016/0142-694X(91)90003-F
38.
Kershaw
,
T. C.
,
Hölttä-otto
,
K.
, and
Lee
,
Y. S.
,
2011
, “
The Effect of Prototyping and Critical Feedback on Fixation in Engineering Design Experiment 1 : Prototyping Method
,”
CogSci2011 Conference
,
Boston, MA
,
July 20–23
, pp.
807
812
.
39.
Schlecht
,
L.
, and
Yang
,
M.
,
2014
, “
Impact of Prototyping Resource Environments and Timing of Awareness of Constraints on Idea Generation in Product Design
,”
Technovation
,
34
(
4
), pp.
223
231
. 10.1016/j.technovation.2013.11.001
40.
Mejía-Gutiérrez
,
R.
, and
Carvajal-Arango
,
R.
,
2017
, “
Design Verification Through Virtual Prototyping Techniques Based on Systems Engineering
,”
Res. Eng. Des.
,
28
(
4
), pp.
477
494
. 10.1007/s00163-016-0247-y
41.
Rhinow
,
H.
,
2012
, “
Design Prototypes as Boundary Objects in Innovation Processes
,”
Conference on Design Research Society
,
Bangkok, Thailand
,
July
, pp.
1
10
.
42.
Lemons
,
G.
,
Carberry
,
A.
,
Swan
,
C.
,
Jarvin
,
L.
, and
Rogers
,
C.
,
2010
, “
The Benefits of Model Building in Teaching Engineering Design
,”
Des. Studies
,
31
(
3
), pp.
288
309
. 10.1016/j.destud.2010.02.001
43.
Kriesi
,
C.
,
Blindheim
,
J.
,
Bjelland
,
Ø
, and
Steinert
,
M.
,
2016
, “
Creating Dynamic Requirements Through Iteratively Prototyping Critical Functionalities
,”
Procedia CIRP
,
Stockholm, Sweden
,
June 15–17
, pp.
790
795
.
44.
Stowe
,
D. T.
,
2008
,
The Role of Prototyping in Mechanical Design Using Case Study Validation, Master thesis. Clemson University
.
45.
Lauff
,
C.
,
Kotys-Schwartz
,
D.
, and
Rentschler
,
M. E.
,
2018
, “
What Is a Prototype? What Are the Roles of Prototypes in Companies?
,”
ASME J. Mech. Des.
,
140
(
6
), p.
061102
. 10.1115/1.4039340
46.
Petrakis
,
K.
,
Hird
,
A.
, and
Wodehouse
,
A.
,
2019
, “
The Concept of Purposeful Prototyping: Towards a New Kind of Taxonomic Classification
,”
Proceedings of the International Conference on Engineering Design, ICED
,
Delft, The Netherlands
,
Aug. 5–8
.
47.
Ulrich
,
K. T.
,
Eppinger
,
S. D.
, and
Yang
,
M. C.
,
2020
,
Product Design and Development
,
McGraw-Hill
,
New York
.
48.
2015
, “
Unified Sumo Robot Rules
,”
Robogames.net
. Robogames.net
49.
Nelson
,
J.
,
Berlin
,
A.
, and
Menold
,
J.
,
2019
, “
ARCHIE: An Automated Data Collection Method for Physical Prototyping Efforts in Authentic Design Situations
,”
American Society for Mechanical Engineering International Design Engineering Technical Conferences & Computers and Information in Engineering Conference
,
Anaheim, CA
,
Aug. 18–21
, pp.
1
11
.
50.
Morkos
,
B.
,
Shankar
,
P.
, and
Summers
,
J. D.
,
2012
, “
Predicting Requirement Change Propagation, Using Higher Order Design Structure Matrices: An Industry Case Study
,”
J. Eng. Des.
,
23
(
12
), pp.
905
906
. 10.1080/09544828.2012.662273
51.
Dow
,
S. P.
,
Glassco
,
A.
, and
Kass
,
J.
,
2009
, “
The Effect of Parallel Prototyping on Design Performance, Learning, and Self-Efficacy
,” Stanford Technical Report 10.
52.
Lilliefors
,
H. W.
,
1967
, “
On the Kolmogorov-Smirnov Test for Normality With Mean and Variance Unknown
,”
J. Am. Statistics
,
62
(
318
), pp.
399
402
. 10.1080/01621459.1967.10482916
53.
Daniel
,
W. W.
,
1990
,
Applied Nonparametric Statistics
,
Cengage Learning
,
Boston, MA
.
54.
Mann
,
H. B.
, and
Whitney
,
D. R.
,
1947
, “
On a Test of Whether One of Two Random Variables Is Stochastically Larger Than the Other
,”
Ann. Math. Statistics
,
18
(
1
), pp.
50
60
. 10.1214/aoms/1177730491
55.
Simon
,
H. A.
,
1996
,
The Sciences of the Artificial
, 3rd ed.,
The MIT Press
,
Boston, MA
.
56.
Fricke
,
E.
,
Gebhard
,
B.
,
Negele
,
H.
, and
Igenbergs
,
E.
,
2000
, “
Coping With Changes: Causes, Findings, and Strategies
,”
Systems Eng.
,
3
(
4
), pp.
169
179
. 10.1002/1520-6858(2000)3:4<169::aid-sys1>3.0.co;2-w
57.
Koo
,
T. K.
, and
Li
,
M. Y.
,
2016
, “
A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research
,”
J. Chir. Med.
,
15
(
2
), pp.
155
163
. 10.1016/j.jcm.2016.02.012
58.
Arai
,
K.
, and
Ridho Barakbah
,
A.
,
2007
, “
Hierarchical K-Means: An Algorithm for Centroids Initialization for K-Means
,”
Reports of the Faculty of Science and Engineering
,
36
(
1
), pp.
25
31
.
59.
Pham
,
D. T.
,
Dimov
,
S. S.
, and
Nguyen
,
C. D.
,
2005
, “
Selection of K in K-Means Clustering
,”
Proc. Inst. Mech. Eng. Part C: J. Mech. Eng. Sci.
,
219
(
1
), pp.
103
119
.
60.
Kruskal
,
W. H.
, and
Wallis
,
W. A.
,
1952
, “
Use of Ranks in One-Criterion Variance Analysis
,”
J. Am. Stat. Assoc.
,
47
(
260
), pp.
583
621
. 10.1080/01621459.1952.10483441
61.
Viswanathan
,
V. K.
, and
Linsey
,
J.
,
2011
, “
Design Fixation in Physical Modeling: An Investigation on the Role of Sunk Cost
,”
ASME 2011 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference
,
Washington, DC
,
Aug. 28–31
.
62.
Lauff
,
C.
,
Kotys-Schwartz
,
D.
, and
Rentschler
,
M. E.
,
2017
, “
What Is a Prototype? Emergent Roles of Prototypes From Empirical Work in Three Diverse Companies
,”
ASME 2017 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference
,
Cleveland, OH
,
Aug. 6–9
, pp.
1
13
.
63.
Tiong
,
E.
,
Seow
,
O.
,
Teo
,
K.
,
Silva
,
A.
,
Wood
,
K. L.
,
Jensen
,
D. D.
, and
Yang
,
M. C.
,
2018
, “
The Economies and Dimensionality of Prototyping : Value, Time, Cost
,”
ASME J. Mech. Des.
,
141
(
3
), p.
031105
. https://doi.org/10.1115/1.4042337
You do not currently have access to this content.