Maps are visual design representations used by engineers to model the information behind a design. This paper evaluates the application of mapping methods supported by the Decision Rationale editor (DRed) in aerospace engineering industry. Specifically, the research investigates what DRed mapping methods are used, where engineers find them useful and why. DRed was selected because it has been formally embedded in the design processes of the partner company and all engineering staff have access to it. The tool was investigated using semistructured interviews with 14 engineers, each already trained with DRed through their work and representing diverse departments and experience levels. Nineteen use cases were collected, ranging from high-profile, multistakeholder projects to everyday individual work. Collected cases were analyzed for the methods applied, common contexts of use, and reasons for use. The results validate baseline DRed mapping methods to capture design rationale and analyze the root causes of engineering problems. Further, it provides empirical evidence for new DRed mapping methods to manage requirements, analyze functional interactions in complex systems and manage personal information. The contexts where mapping methods are most used involve: system-level information that cuts across subsystem boundaries; irregular intervals between map applications; dealing with loosely structured information; individual use or small team collaborations; and addressing on-going problems. The reasons stated by engineers for using maps focus on engineering design thinking, communication, and planning support. Using empirical evidence of its recurrent use, this research establishes that DRed is a powerful and versatile tool for engineers in industry and its mapping methods aid important and otherwise unsupported work. The range and impact of the use cases found in practice suggest that engineers need better support for work with loosely structured information. Organizations involved in the design of complex systems should make greater use of semiformal, graph-based visual tools like DRed. The understanding of mapping software gained through this research demonstrates a shift in emphasis from the enrichment of the engineering record to the provision of immediate cognitive benefits for engineers. The results also support an incremental, adaptive approach for deploying this emerging class of tools in other organizations.

References

1.
Turk
,
Z.
,
2001
, “
Phenomenologial Foundations of Conceptual Product Modelling in Architecture, Engineering and Construction
,”
Artif. Intell. Eng.
,
15
(
2
), pp.
83
92
.
2.
Crowder
,
R.
,
Fowler
,
D.
,
Reul
,
Q.
,
Sleeman
,
D.
,
Shadbolt
,
N.
, and
Wills
,
G.
,
2012
, “
An Information System to Support the Engineering Designer
,”
J. Intell. Manuf.
,
23
(
5
), pp.
1545
1558
.
3.
McAlpine
,
H.
,
Hicks
,
B.
, and
Tiryakioglu
,
C.
,
2011
, “
The Digital Divide: Investigating the Personal Information Management Practices of Engineers
,”
International Conference on Engineering Design
(
ICED
), Copenhagen, Denmark, Aug. 15–19, pp. 31–32.
4.
Asiedu
,
Y.
, and
Gu
,
P.
,
1998
, “
Product Life Cycle Cost Analysis: State of the Art Review
,”
Int. J. Prod. Res.
,
36
(
4
), pp.
883
908
.
5.
Conklin
,
J.
, and
Begeman
,
M. L.
,
1988
, “
gIBIS: A Hypertext Tool for Exploratory Policy Discussion
,”
ACM Trans. Inf. Syst.
,
6
(
4
), pp.
303
331
.
6.
Buzan
,
T.
, and
Griffiths
,
C.
,
2010
,
Mind Maps for Business: Revolutionise Your Business Thinking and Practice
,
Prentice Hall
,
Harlow, UK
.
7.
Qu
,
Y.
, and
Furnas
,
G. W.
,
2005
, “
Sources of Structure in Sensemaking
,”
Extended Abstracts on Human Factors in Computing Systems
(
CHI EA
), Portland, OR, Apr. 2–7, pp. 1989–1992.
8.
Buckingham-Shum
,
S. J.
, and
Hammond
,
N.
,
1994
, “
Argumentation-Based Design Rationale: What Use at What Cost?
,”
Int. J. Hum. Comput. Stud.
,
40
(
4
), pp.
603
652
.
9.
Buckingham-Shum
,
S. J.
,
Selvin
,
A. M.
,
Sierhuis
,
M.
,
Conklin
,
J.
,
Haley
,
C. B.
, and
Nuseibeh
,
B.
,
2006
, “
Hypermedia Support for Argumentation-Based Rationale: 15 Years on From gIBIS and QOC
,”
Rationale Management in Software Engineering
,
A.
Dutoit
,
R.
Mccall
,
I.
Mistrik
, and
B.
Paech
, eds.,
Springer-Verlag
,
Berlin
, pp.
111
132
.
10.
Bracewell
,
R. H.
,
Wallace
,
K. M.
,
Moss
,
M.
, and
Knott
,
D.
,
2009
, “
Capturing Design Rationale
,”
Comput. Aided Des.
,
41
(
3
), pp.
173
186
.
11.
Aurisicchio
,
M.
,
Bracewell
,
R. H.
, and
Hooey
,
B. L.
,
2016
, “
Rationale Mapping and Functional Modelling Enhanced Root Cause Analysis
,”
Saf. Sci.
,
85
, pp.
241
257
.
12.
REF2014: Research Excellence Framework Impact Case Studies
, 2014, “
The Decision Rationale Editor (Case Study 14057)
,” Higher Education Funding Council for England (HEFCE), London, accessed, Nov. 26, 2015, http://impact.ref.ac.uk/casestudies2/refservice.svc/getcasestudypdf/14057
13.
Kunz
,
W.
, and
Rittel
,
H. W. J.
,
1970
, “
Issues as Elements of Information Systems
,” Centre for Planning and Development Research, Berkeley, CA.
14.
Bracewell
,
R. H.
, and
Wallace
,
K. M.
,
2003
, “
A Tool for Capturing Design Rationale
,”
The 14th International Conference on Engineering Design
(
ICED
), Stockholm, Sweden, Aug. 19–21, Paper No. DS31_1437FPB.
15.
Eng
,
N. L.
,
Aurisicchio
,
M.
,
Bracewell
,
R. H.
, and
Armstrong
,
G.
,
2011
, “
More Space to Think: Eight Years of Visual Support for Rationale Capture, Creativity and Knowledge Management in Aerospace Engineering
,”
ASME
Paper No. DETC2011-47911.
16.
Eng
,
N. L.
,
Bracewell
,
R. H.
, and
Clarkson
,
P. J.
,
2009
, “
Concept Diagramming Software for Engineering Design Support: A Review and Synthesis of Studies
,”
ASME
Paper No. DETC2009-86840.
17.
Aurisicchio
,
M.
, and
Bracewell
,
R. H.
,
2013
, “
Capturing an Integrated Design Information Space With a Diagram-Based Approach
,”
J. Eng. Des.
,
24
(
6
), pp.
397
428
.
18.
Eng
,
N. L.
,
Aurisicchio
,
M.
,
Bracewell
,
R. H.
, and
Armstrong
,
G.
,
2012
, “
Mapping for Design Thinking Support in Industry
,”
ASME
Paper No. DETC2012-70959.
19.
Aurisicchio
,
M.
,
Bracewell
,
R. H.
, and
Armstrong
,
G.
,
2013
, “
Supporting Communication in the Supply Chain With Design Rationale Maps
,”
International Conference on Engineering Design
(
ICED
), Seoul, South Korea, Aug. 19–22, pp. 335–344.
20.
Perry
,
M.
, and
Sanderson
,
D.
,
1998
, “
Coordinating Joint Design Work: The Role of Communication and Artefacts
,”
Des. Stud.
,
19
(
3
), pp.
273
288
.
21.
Ewenstein
,
B.
, and
Whyte
,
J.
,
2009
, “
Knowledge Practices in Design: The Role of Visual Representations as `Epistemic Objects’
,”
Organ. Stud.
,
30
(
1
), pp.
07
30
.
22.
McAlpine
,
H.
,
Hicks
,
B.
,
Culley
,
S. J.
, and
Huet
,
G.
,
2006
, “
An Investigation Into the Use and Content of the Engineer’s Logbook
,”
Des. Stud.
,
27
(
4
), pp.
481
504
.
23.
Kurtz
,
C. F.
, and
Snowden
,
D. J.
,
2003
, “
The New Dynamics of Strategy: Sense-Making in a Complex and Complicated World
,”
IBM Syst. J.
,
42
(
3
), pp.
462
483
.
24.
Novak
,
J. D.
, and
Cañas
,
A. J.
,
2008
, “
The Theory Underlying Concept Maps and How to Construct and Use Them
,” Florida Institute for Human and Machine Cognition, Technical Report IHMC CmapTools 2006-01 Rev 01-2008.
25.
Cao
,
Y.
,
Liu
,
Y.
, and
Paredis
,
C. J. J.
,
2011
, “
System-Level Model Integration of Design and Simulation for Mechatronic Systems Based on SysML
,”
Mechatronics
,
21
(
6
), pp.
1063
1075
.
26.
Stone
,
R. B.
,
Wood
,
K. L.
, and
Crawford
,
R. H.
,
2000
, “
A Heuristic Method for Identifying Modules for Product Architectures
,”
Des. Stud.
,
21
(
1
), pp.
5
31
.
27.
Henderson
,
K.
,
1999
,
On Line and On Paper: Visual Representations, Visual Culture and Computer Graphics in Design Engineering
,
MIT Press
, Cambridge, MA.
28.
Kokotovich
,
V.
,
2008
, “
Problem Analysis and Thinking Tools: An Empirical Study of Non-Hierarchical Mind Mapping
,”
Des. Stud.
,
29
(
1
), pp.
49
69
.
29.
Marshall
,
C. C.
,
Shipman
,
F. M.
, and
Coombs
,
J. H.
,
1994
, “
VIKI: Spatial Hypertext Supporting Emergent Structure
,”
ACM European Conference on Hypermedia Technology
(
ECHT
), Edinburgh, Scotland, Sept. 19–23, pp.
13
23
.
30.
Bush
,
V.
,
1945
, “
As We May Think
,” The Atlantic Monthly, Washington, DC, accessed Jan. 23, 2017, http://www.theatlantic.com/magazine/archive/1945/07/as-we-may-think/303881/
31.
Engelbardt
,
D. C.
,
1962
, “
Augmenting Human Intellect: A Conceptual Framework
,” Stanford Research Institute, Menlo Park, CA, Report No.
AFOSR-3233
.
32.
Licklider
,
J.
, and
Taylor
,
R.
,
1968
, “
The Computer as a Communication Device
,”
Sci. Technol.
,
72
(
2
), pp.
21
41
.
33.
Nelson
,
T. H.
,
1965
, “
Complex Information Processing: A File Structure for the Complex, the Changing and the Indeterminate
,”
20th National ACM Conference
(
ACM
), Cleveland, OH, Aug. 24–26, pp.
84
100
.
34.
Bernstein
,
M.
,
2003
, “
Collage, Composites, Construction
,”
14th ACM Conference on Hypertext and Hypermedia
(
HT
), Nottingham, UK, Aug. 26–30, pp.
122
123
.
35.
Shipman
,
F. M.
,
Hsieh
,
H.
,
Maloor
,
P.
, and
Moore
,
M.
,
2001
, “
The Visual Knowledge Builder: A Second Generation Spatial Hypertext
,”
12th ACM Conference on Hypertext and Hypermedia
(
HT
), Arhus, Denmark, Aug. 14–18, pp.
113
122
.
36.
Bernstein
,
M.
,
1999
, “
Structural Patterns and Hypertext Rhetoric
,”
J. ACM Comput. Surv.
,
31
(
4
), p. 19.
37.
Conklin
,
J.
,
2006
,
Dialogue Mapping: Building Shared Understanding of Wicked Problems
,
Wiley
,
Chichester, UK
.
38.
Müller
,
J.
,
Polansky
,
D.
,
Novak
,
P.
,
Foltin
,
C.
,
and Polivaev
,
D.
, 2016, “
FreeMind—Free Mind Mapping Software
,” Sourceforge.net, accessed Jan. 23, 2017, http://freemind.sourceforge.net/wiki/index.php/main_page
39.
DesignVUE
, 2017, “
Imperial College London Design Engineering Group
,” London, accessed Jan. 23, 2017, http://www3.imperial.ac.uk/designengineering/tools/designvue
40.
Compendium Institute, 2012, “
Compendium Institute
,” Open University Knowldge Media Institute, Milton Keynes, UK, accessed Jan. 23, 2017, http://compendium.open.ac.uk/institute/
41.
Larkin
,
J. H.
, and
Simon
,
H. A.
,
1987
, “
Why a Diagram Is (Sometimes) Worth Ten Thousand Words
,”
Cognit. Sci.
,
11
(
1
), pp.
65
100
.
42.
Liu
,
Y.
,
McMahon
,
C. A.
,
Ramani
,
K.
, and
Schaefer
,
D.
,
2011
, “
Editorial for the Special Issue of Information Mining and Retrieval in Design
,”
Adv. Eng. Inf.
,
25
(
2
), pp.
117
118
.
43.
Buckingham-Shum
,
S. J.
,
MacLean
,
A.
,
Bellotti
,
V. M. E.
, and
Hammond
,
N. V.
,
1997
, “
Graphical Argumentation and Design Cognition
,”
Hum. Comput. Interact.
,
12
(
3
), pp.
267
300
.
44.
Eppler
,
M. J.
, and
Kernbach
,
S.
,
2016
, “
Dynagrams: Enhancing Design Thinking Through Dynamic Diagrams
,”
Des. Stud.
,
47
, pp.
91
117
.
45.
Conklin
,
J.
, 2003, “
Dialog Mapping: Reflections on an Industrial Strength Case Study
,”
Visualising Argumentation: Software Tools for Collaborative and Educational Sense-Making
, P. Kirschner, S. Buckingham Shum, and C. Carr, eds., Springer, London, pp. 117–136.
46.
Eng
,
N. L.
,
Bracewell
,
R. H.
, and
Clarkson
,
P. J.
,
2008
, “
Studying the Role of Narrative Across Aerospace Knowledge Management Systems
,” 59th International Astronautical Congress (IAC’08), Glasgow, UK, Sept. 29–Oct. 3, Paper No. IAC-08-D5.2.10.
47.
Aurisicchio
,
M.
, and
Bracewell
,
R. H.
,
2009
, “
Engineering Design by Integrated Diagrams
,”
International Conference on Engineering Design
(
ICED
), Stanford, CA, Aug. 24–27, pp. 301–312.
48.
Blessing
,
L. T. M.
,
Chakrabarti
,
A.
, and
Wallace
,
K. M.
,
1998
, “
An Overview of Descriptive Studies in Relation to a General Design Research Methodology
,”
Designers: The Key to Successful Product Development
,
E.
Frankenberger
,
H.
Birkhofer
, and
P.
Badke-Schaub
, eds.,
Springer-Verlag
, London, pp.
42
56
.
49.
Bracewell
,
R. H.
,
Gourtovaia
,
M.
,
Moss
,
M.
,
Knott
,
D.
,
Wallace
,
K. M.
, and
Clarkson
,
P. J.
,
2009
, “
DRed 2.0: A Method and Tool for Capture and Communication of Design Knowledge Deliberated in the Creation of Technical Products
,”
International Conference on Engineering Design
(
ICED
), Palo Alto, CA, Aug. 24–27, pp. 223–234.
50.
Hales
,
C.
,
1991
,
Analysis of an Engineering Design Process in an Industrial Context
,
Gants Hill Publications
,
Hants, UK
.
51.
Bucciarelli
,
L. L.
,
1994
,
Designing Engineers
,
MIT Press
,
Cambridge, MA
.
52.
Vinck
,
D.
,
2003
,
Everyday Engineering: An Ethnography of Design and Innovation
,
MIT Press
, Cambridge, MA.
53.
Gorman
,
G. E.
,
Clayton
,
P.
, and
Rice-Lively
,
M. L.
,
1997
,
Qualitative Research for the Information Professional: A Practical Introduction
,
Library Association Publishing
,
London
.
54.
Vasconcellos
,
M.
,
2008
, “
An Experience of the Use of the Cognitive Mapping Method in Qualitative Research
,”
Knowledge Cartography: Software Tools and Mapping Techniques
,
A.
Okada
,
S. J.
Buckingham-Shum
, and
T.
Sherborne
, eds.,
Springer-Verlag
,
London
, pp.
335
355
.
55.
Subrahmanian
,
E.
,
Reich
,
Y.
,
Konda
,
S. L.
,
Dutoit
,
A.
,
Cunningham
,
D.
,
Patrick
,
R.
,
Thomas
,
M.
, and
Westerberg
,
A. W.
,
1997
, “
The n-dim Approach to Creating Design Support Systems
,”
ASME
Paper No. DETC97/DTM-3873.
56.
Gopsill
,
J. A.
,
McAlpine
,
H. C.
, and
Hicks
,
B. J.
,
2013
, “
A Social Media Framework to Support Engineering Design Communication
,”
Adv. Eng. Inf.
,
27
(
4
), pp.
580
597
.
57.
Hooey
,
B. L.
,
Aurisicchio
,
M.
,
Bracewell
,
R. H.
, and
Foyle
,
D. C.
,
2014
, “
Evidence-Based Error Analysis: Supporting the Design of Error-Tolerant Systems
,”
Lect. Notes Comput. Sci.
,
8512
, pp.
401
412
.
58.
Aurisicchio
,
M.
, and
Bracewell
,
R. H.
,
2013
, “
The Function Analysis Diagram: Intended Benefits and Co-Existence With Other Functional Models
,”
Artif. Intell. Eng. Des. Anal. Manuf.
,
27
(
3
), pp.
249
257
.
59.
Aurisicchio
,
M.
,
Bracewell
,
R. H.
, and
Armstrong
,
G.
,
2012
, “
The Function Analysis Diagram
,”
ASME
Paper No. DETC2012-70944.
60.
Dai
,
W.
,
Aurisicchio
,
M.
, and
Armstrong
,
G.
,
2012
, “
An IBIS Based Approach for the Analysis of Non Functional Requirements
,”
ASME
Paper No. DETC2012-71023.
61.
Dai
,
W.
, and
Aurisicchio
,
M.
,
2013
, “
An Empirical Investigation of Requirement Evolution in an Industrial Project
,”
International Conference on Engineering Design (ICED)
, Seoul, South Korea, Aug. 19–22, pp. 369–378.
62.
Datchary
,
C.
, and
Licoppe
,
C.
,
2007
, “
La Multi-Activité et Ses Appuis: L’Exemple de la ‘Présence Obstinée’ des Messages Dans l’Environnnement de Travail
,” Activités,
4
(
1
), Paper No. 1370.
63.
Klein
,
G.
,
Moon
,
B.
, and
Hoffman
,
R. R.
,
2006
, “
Making Sense of Sensemaking 2: A Macrocognitive Model
,”
IEEE Intell. Syst.
,
21
(
5
), pp.
88
92
.
64.
Durugbo
,
C.
,
2013
, “
Integrated Product-Service Analysis Using SysML Requirement Diagrams
,”
Syst. Eng.
,
16
(
1
), pp.
111
123
.
65.
INCOSE
,
2007
, “
Systems Engineering Vision 2020
,” International Council on Systems Engineering, San Diego, CA, Doc. No. INCOSE-TP-2004-004-02, accessed Sep. 10,
2016
, http://oldsite.incose.org/productspubs/pdf/sevision2020_20071003_v2_03.pdf
66.
Poenisch
,
V.
, and
Clark
,
A.
,
2006
, “
Elements of an Interface Standard for Knowledge Sources in Knowledge-Based Engineering
,”
ASME J. Comput. Inf. Sci. Eng.
,
6
(
1
), pp.
78
83
.
67.
VanSchaik
,
J.
,
Scanlan
,
J.
,
Keane
,
A.
,
Takeda
,
K.
,
Gorissen
,
D.
, and
Schaik
,
J. Van
,
2011
, “
Improving Design Rationale Capture During Embodiment Design
,”
International Conference on Engineering Design
(
ICED
), Copenhagen, Denmark, Aug. 15–19, pp. 436–445.
68.
Baroni
,
P.
,
Romano
,
M.
,
Toni
,
F.
,
Aurisicchio
,
M.
, and
Bertanza
,
G.
,
2013
, “
An Argumentation-Based Approach for Automatic Evaluation of Design Debates
,”
Computational Logic in Multi-Agent Systems
(Lecture Notes in Computer Science), Vol.
8143
,
J.
Leite
,
T. C.
Son
,
P.
Torroni
,
L.
van der Torre
, and W. S., eds.,
Springer
,
Berlin
, pp.
340
356
.
69.
Baroni
,
P.
,
Romano
,
M.
,
Toni
,
F.
,
Aurisicchio
,
M.
, and
Bertanza
,
G.
,
2015
, “
Automatic Evaluation of Design Alternatives With Quantitative Argumentation
,”
Argument Comput.
,
6
(
1
), pp.
24
49
.
70.
Clegg
,
C.
,
Axtell
,
C.
,
Damodaran
,
L.
,
Farbey
,
B.
,
Hull
,
R.
,
Lloyd-Jones
,
R.
,
Nicholls
,
J.
,
Sell
,
R.
, and
Tomlinson
,
C.
,
1997
, “
Information Technology: A Study of Performance and the Role of Human and Organizational Factors
,”
Ergonomics
,
40
(
9
), pp.
851
871
.
71.
Dinar
,
M.
,
Shah
,
J. J.
,
Cagan
,
J.
,
Leifer
,
L.
,
Linsey
,
J.
,
Smith
,
S. M.
, and
Hernandez
,
N. V.
,
2015
, “
Empirical Studies of Designer Thinking: Past, Present, and Future
,”
ASME J. Mech. Des.
,
137
(
2
), p.
21101
.
You do not currently have access to this content.