Abstract

This paper presents a behavior-based protocol study conducted with mechanical engineering students, where the participants developed function–structure models for a novel design problem. A modeling activity video was recorded for each participant and coded using a protocol analysis that captured the modeling sequence, actions, and elements. Pauses in the modeling process were analyzed to identify patterns based on pause time and frequency, the distribution of pauses over the modeling activity, and events preceding and following the pauses. In this study, a pause is characterized as an interruption in the modeling process lasting at least 2 s. Participants were found to spend an average of 38% of the modeling time in pauses, with more of it being allotted to the middle of the modeling activity and less toward the start and end. Three pause types are defined (short, intermediate, and long pauses) based on an analysis of pause lengths, which are then used to analyze events before and after pauses. Participants added elements to the model more frequently, compared to editing and deleting elements. Longer pauses were observed before participants before elements are removed from the model, whereas editing was done more frequently after shorter pauses. Several modeling element pairs are identified that are infrequently separated by pauses, such as the “edge” and “edge text” pair, suggesting that the designer thinks about these as paired elements rather than distinct elements. Limitations of the research methods are discussed, and finally, new research questions are identified as continuing work for this research.

References

1.
Pahl
,
G.
,
Beitz
,
W.
,
Feldhusen
,
J.
, and
Grote
,
K.-H.
,
2007
,
Engineering Design
,
Springer-Verlag London
,
London
.
2.
Dieter
,
G. E.
, and
Schmidt
,
L. C.
,
2013
,
Engineering Design
,
McGraw-Hill Higher Education
,
New York
.
3.
Ullman
,
D. G.
,
2010
,
The Mechanical Design Process
,
McGraw-Hill
,
New York
.
4.
Dym
,
C. L.
, and
Little
,
P.
,
1999
,
Engineering Design: A Project-Based Introduction
,
John Wiley and Sons
,
Hoboken, NJ
.
5.
Sridhar
,
S.
,
Fazelpour
,
M.
,
Gill
,
A. S. A. S.
, and
Summers
,
J. D. J. D.
,
2016
, “
Accuracy and Precision Analysis of the Graph Complexity Connectivity Method
,”
Procedia CIRP
,
44
, pp.
163
168
. 10.1016/j.procir.2016.02.029
6.
Thomas
,
J.
,
Sen
,
C.
,
Mocko
,
G. M.
,
Summers
,
J. D.
, and
Fadel
,
G. M.
,
2009
, “
Investigation of the Interpretability of Three Function Structure Representations: A User Study
,”
Proceedings of the ASME 2009 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 8: 14th Design for Manufacturing and the Life Cycle Conference; 6th Symposium on International Design and Design Education; 21st International Conference on Design Theory and Methodology, Parts A and B
,
San Diego, CA
,
Aug. 30–Sept. 2
,
ASME
, pp.
1055
1068
. https://doi.org/10.1115/DETC2009-87381
7.
Patel
,
A.
,
Kramer
,
W.
,
Summers
,
J. D.
, and
Shuffler-Porter
,
M.
,
2016
, “
Function Modeling: A Study of Sequential Model Completion Based on Count and Chaining of Functions
,”
Proceedings of the ASME 2016 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 7: 28th International Conference on Design Theory and Methodology
,
Charlotte, NC
,
Aug. 21–24
,
ASME
, p.
V007T06A036
. https://doi.org/10.1115/DETC2016-59860
8.
Chawla
,
A.
, and
Summers
,
J. D.
,
2018
, “
Function Ordering Within Morphological Charts: An Experimental Study
,”
Proceedings of the ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 7: 30th International Conference on Design Theory and Methodology
,
Quebec City, Quebec, Canada
,
Aug. 26–29
,
American Society of Mechanical Engineers
, pp.
V007T06A012
V007T06A012
. https://doi.org/10.1115/DETC2018-86184
9.
Gill
,
A. S.
,
Patel
,
A. R.
,
Summers
,
J. D.
,
Shuffler
,
M.
,
Kramer
,
W. S.
,
Shuffler-Porter
,
M. L.
, and
Kramer
,
W. S.
,
2016
, “
Graph Complexity Analysis of Function Models Expanded From Partially Completed Models
,”
The Fourth International Conference on Design Creativity
,
Atlanta, GA
,
Nov. 2–4
, pp.
1
10
.
10.
Richardson
,
J. L.
, III
,
Summers
,
J. D.
, and
Mocko
,
G. M.
,
2011
, “
Function Representations in Morphological Charts: An Experimental Study on Variety and Novelty on Means Generated
,”
Interdisciplinary Design: Proceedings of the 21st CIRP Design Conference
,
M.K.
Thompson
, ed.,
Daejeon, South Korea
,
Mar. 27–29
, pp.
76
84
.
11.
Sen
,
C.
, and
Summers
,
J. D.
,
2014
, “A Pilot Protocol Study on How Designers Construct Function Structures in Novel Design,”
Design Computing and Cognition’12
,
J.
Gero
, ed.,
Springer-Verlag
,
College Station, TX
, pp.
247
264
.
12.
Caldwell
,
B. W.
,
Thomas
,
J.
,
Sen
,
C.
,
Mocko
,
G. M.
, and
Summers
,
J. D.
,
2012
, “
The Effects of Language and Pruning on Function Structure Interpretability
,”
ASME J. Mech. Des.
,
134
(
6
), p.
061001
. 10.1115/1.4006442
13.
Gero
,
J. S.
, and
Kannengiesser
,
U.
,
2007
, “
A Function–Behavior–Structure Ontology of Processes
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
21
(
04
), pp.
1
34
.
14.
Kurfman
,
M. A.
,
Stone
,
R. B.
,
Van
,
W. M.
,
Wood
,
K. L.
, and
Otto
,
K. N.
,
2000
, “
Theoretical Underpinnings of Functional Modeling: Preliminary Experimental Studies
,”
12th International Conference on Design Theory and Methodology
,
Baltimore, MD
,
Sept. 10–13
,
ASME
, p.
DETC2000/DTM-14563
.
15.
Goel
,
A. K.
,
Rugaber
,
S.
, and
Vattam
,
S.
,
2009
, “
Structure, Behavior, and Function of Complex Systems: The Structure, Behavior, and Function Modeling Language
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
23
(
1
), pp.
23
35
. 10.1017/S0890060409000080
16.
Ramachandran
,
R.
,
Caldwell
,
B. W.
, and
Mocko
,
G. M.
,
2011
, “
A User Study to Evaluate the Functional Model and Function Interaction Model for Concept Generation
,”
Proceedings of the ASME 2011 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 9: 23rd International Conference on Design Theory and Methodology; 16th Design for Manufacturing and the Life Cycle Conference
,
Washington, DC
,
Aug. 28–31
,
ASME
, pp.
273
284
. https://doi.org/10.1115/DETC2011-47660
17.
Umeda
,
Y.
,
Ishii
,
M.
,
Yoshioka
,
M.
,
Shimomura
,
Y.
, and
Tomiyama
,
T.
,
1996
, “
Supporting Conceptual Design Based on the Function-Behavior-State Modeler
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
10
(
4
), pp.
275
288
. 10.1017/S0890060400001621
18.
Albers
,
A.
,
Alink
,
T.
,
Matthiesen
,
S.
, and
Thau
,
S.
,
2008
, “
Support of System Analyses and Improvement in Industrial Design Trough the Contact & Channel Model
,”
DS 48: Proceedings DESIGN 2008, the 10th International Design Conference
,
The Design Society
,
Dubrovnik, Croatia
,
May 19–22
, pp.
245
252
.
19.
Hirtz
,
J.
,
Stone
,
R.
,
McAdams
,
D.
,
Szykman
,
S.
, and
Wood
,
K.
,
2002
, “
A Functional Basis for Engineering Design: Reconciling and Evolving Previous Efforts
,”
Res. Eng. Des.
,
13
(
2
), pp.
65
82
. 10.1007/s00163-001-0008-3
20.
Sen
,
C.
,
Summers
,
J. D. J. D.
, and
Mocko
,
G. M. G. M.
,
2013
, “
Physics-Based Reasoning in Conceptual Design Using a Formal Representation of Function Structure Graphs
,”
ASME J. Comput. Inf. Sci. Eng.
,
13
(
1
), p.
011008
. 10.1115/1.4023488
21.
Freeman
,
P.
, and
Newell
,
A.
,
1971
, “
A Model for Functional Reasoning in Design
,”
Second International Joint Conference on Artificial Intelligence
,
London, UK
,
Sept. 1–3
pp.
1
21
.
22.
Sridharan
,
P.
, and
Campbell
,
M.
,
2005
, “
A Study on the Grammatical Construction of Function Structures
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
19
(
3
), pp.
139
160
. 10.1017/S0890060405050110
23.
Caldwell
,
B. W.
, and
Mocko
,
G. M.
,
2008
, “
Towards Rules for Functional Composition
,”
Proceedings of the ASME 2008 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 1: 34th Design Automation Conference, Parts A and B.
,
American Society of Mechanical Engineers
,
Brooklyn, NY
,
Aug. 3–6
, pp.
319
328
. https://doi.org/10.1115/DETC2008-49904
24.
Gill
,
A. S.
,
Summers
,
J. D.
, and
Turner
,
C. J.
,
2017
, “
Comparing ‘Function-Structures’ and ‘Pruned Function-Structures’ for Market Price Prediction: An Approach to Benchmarking Representation Inferencing Value
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
31
(
4
), pp.
550
566
. 10.1017/s0890060417000543
25.
Stone
,
R. B.
, and
Wood
,
K. L.
,
2000
, “
Development of a Functional Basis for Design
,”
ASME J. Mech. Des.
,
122
(
4
), pp.
359
370
. 10.1115/1.1289637
26.
Sen
,
C.
,
Summers
,
J. D.
, and
Mocko
,
G. M.
,
2013
, “
A Formal Representation of Function Structure Graphs for Physics-Based Reasoning
,”
ASME J. Comput. Inf. Sci. Eng.
,
13
(
2
), p.
021001
. 10.1115/1.4023167
27.
Nagel
,
R. L.
,
Bohm
,
M. R.
,
Linsey
,
J. S.
, and
Riggs
,
M. K.
,
2015
, “
Improving Students’ Functional Modeling Skills: A Modeling Approach and a Scoring Rubric
,”
ASME J. Mech. Des.
,
137
(
5
), p.
51102
. 10.1115/1.4029585
28.
Bryant
,
C. R.
,
Stone
,
R. B.
,
McAdams
,
D. A.
,
Kurtoglu
,
T.
, and
Campbell
,
M. I.
,
2005
, “
Concept Generation From the Functional Basis of Design
,”
DS 35: Proceedings ICED 05, the 15th International Conference on Engineering Design
,
Melbourne, Australia
,
Aug. 15–18
,
The Design Society
, pp.
1702
1715
.
29.
Mokhtarian,
,
H.
,
Coatanea
,
E.
, and
Paris
,
H.
,
2017
, “
Function Modeling Combined With Physics-Based Reasoning for Assessing Design Options and Supporting Innovative Ideation
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
31
(
4
), pp.
476
500
. 10.1017/s0890060417000403
30.
Thiagarajan
,
A.
,
Patel
,
A.
,
O’Shields
,
S.
, and
Summers
,
J. D.
,
2017
, “Functional Thinking: A Protocol Study to Map Modeling Behavior of Designers,”
Design Cognition and Computing (DCC16)
,
J. S.
Gero
, ed.,
Springer
,
Evanston, IL
, pp.
339
357
.
31.
Patel
,
A.
,
Kramer
,
W. S.
,
Flynn
,
M.
,
Summers
,
J. D.
, and
Shuffler-Porter
,
M. L.
,
2017
, “
Function Modeling: Comparison of Chaining Methods Using Protocol Study and Designer Study
,”
Proceedings of the ASME 2017 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 7: 29th International Conference on Design Theory and Methodology
,
Cleveland, OH
,
Aug. 6–9
, ASME, p.
V007T06A032
. https://doi.org/10.1115/DETC2017-68420
32.
Friedman
,
B.
, and
Yoo
,
D.
,
2017
, “
Pause: A Multi-Lifespan Design Mechanism
,”
Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
,
New York, NY
,
May 9–11
,
ACM
, pp.
460
464
.
33.
Wallace
,
B.
,
1986
, “
Creativity: Some Definitions: The Creative Personality; the Creative Process; the Creative Classroom
,”
Gift. Educ. Int.
,
4
(
2
), pp.
68
73
. 10.1177/026142948600400202
34.
De Bono
,
E.
,
1993
,
Serious Creativity: Using the Power of Lateral Thinking to Create New Ideas
,
Harper Business
,
New York, NY
.
35.
Newell
,
A.
,
1994
,
Unified Theories of Cognition
,
Harvard University Press
,
Cambridge, MA
.
36.
Klein
,
G. A.
,
1993
, “A Recognition-Primed Decision (RPD) Model of Rapid Decision Making,”
Decision Making in Action: Models and Methods
,
G. A.
Klein
,
J.
Orasanu
,
R.
Calderwood
, and
C. E.
Zsambok
, eds.,
Ablex Publishing Corporation
,
Norwood, NJ
, pp.
138
147
.
37.
Klein
,
G.
,
2008
, “
Naturalistic Decision Making
,”
Hum. Factors J. Hum. Factors Ergon. Soc.
,
50
(
3
), pp.
456
460
. 10.1518/001872008X288385
38.
Patel
,
A.
,
Elena
,
M. V.
, and
Summers
,
J. D.
,
2019
, “
A Systematic Approach to Evaluating Design Prompts in Supporting Experimental Design Research
,”
Proceedings of the Design Society: 22nd International Conference on Engineering Design (ICED19)
,
Delft, The Netherlands
,
Aug. 5–8
,
The Design Society
, pp.
2755
2764
.
39.
Patel
,
A.
,
Kramer
,
W. S.
,
Flynn
,
M.
,
Summers
,
J. D.
, and
Shuffler
,
M. L.
,
2018
, “
Function Modeling: An Analysis of Pause Patterns in Modeling Activities
,”
Proceedings of the ASME 2018 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 7: 30th International Conference on Design Theory and Methodology
, Quebec City,
Quebec, Canada
,
Aug. 26–29
,
American Society of Mechanical Engineers
, p. V007T06A034. https://doi.org/10.1115/DETC2018-86103
40.
Nagel
,
R. L.
,
Bohm
,
M. R.
, and
Linsey
,
J. S.
,
2013
, “
An Investigation Into the Effectiveness of an Algorithmic Approach to Teaching Function Modeling
,”
Proceedings of the ASME 2013 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference. Volume 1: 15th International Conference on Advanced Vehicle Technologies; 10th International Conference on Design Education; 7th International Conference on Micro- and Nanosystems
,
Portland, OR
,
Aug. 4–7
, ASME, p.
V001T04A023
. https://doi.org/10.1115/DETC2013-12658
41.
Hannah
,
R.
,
Joshi
,
S.
, and
Summers
,
J. D.
,
2011
, “
A User Study of Interpretability of Engineering Design Representations
,”
J. Eng. Des.
,
23
(
6
), pp.
443
468
. 10.1080/09544828.2011.615302
42.
Lohmeyer
,
Q.
, and
Meboldt
,
M.
,
2015
, “
How We Understand Engineering Drawings: An Eye Tracking Study Investigating Skimming and Scrutinizing Sequences
,”
Proc. Int. Conf. Eng. Des. ICED
,
2
(
DS 80-02
), pp.
359
368
.
43.
Ruckpaul
,
A.
,
Fürstenhöfer
,
T.
, and
Matthiesen
,
S.
,
2015
, “
Combination of Eye Tracking and Think-Aloud Methods in Engineering Design Research
,”
Des. Comput. Cogn.
,
14
, pp.
81
97
. 10.1007/978-3-319-14956-1_5
44.
Sternberg
,
R. J.
,
1994
,
Thinking and Problem Solving
,
Elsevier
,
New York
.
45.
Mao
,
X.
,
Galil
,
O.
,
Parrish
,
Q.
, and
Sen
,
C.
,
2020
, “
Evidence of Cognitive Chunking in Freehand Sketching During Design Ideation
,”
Des. Stud.
,
67
, pp.
1
26
. 10.1016/j.destud.2019.11.009
46.
Murphy
,
A. R.
,
Ingram
,
H. E.
,
Nelson
,
J. T.
,
Bohm
,
M. R.
,
Linsey
,
J. S.
, and
Nagel
,
R. L.
,
2019
, “
An Update to a Functional Modeling Scoring Rubric With Overall and Question-Level Inter-Rater Reliability
,”
ASME J. Mech. Des.
,
141
(
8
), p.
084501
. 10.1115/1.4043205
You do not currently have access to this content.