A wide range of formal methods have been devised and used for idea generation in conceptual design. Experimental evidence is needed to support claims regarding the effectiveness of these methods in promoting idea generation in engineering design. Towards that goal this paper presents a set of effectiveness metrics experimental methods, data collection and analysis techniques. Statistically based Design of Experiments (DOE) principles were used in developing the guidelines. Four classes of operating variables were considered to characterize the design problem and the environment. The effectiveness metrics proposed are based on outcome and consists of the quantity, quality, novelty, and variety of ideas generated. Two experimental approaches have been developed. In the Direct Method, the influence of the type of design problem and various parameters related to the procedure of an idea generation method is measured by using the method in its entirety. In the Indirect Method, each idea generation method is decomposed into key components and its overall effectiveness is predicted by experimentally studying the effectiveness of its components and their mutual interactions. [S1050-0472(00)02004-3]
Issue Section:
Technical Papers
1.
Zwicky, P., 1969, Discovery, Invention, Research Through Morphological Analysis, McMillan, New York.
2.
Osborn, A., 1979, Applied Imagination, Scribners, New York.
3.
Hogarth, R., 1980, Judgment and Choice—The Psychology of Decision, John Wiley & Sons, New York.
4.
DeBono, E., 1970, Lateral Thinking: Creativity Step by Step, Harper and Row, New York.
5.
Rhorbach, B., 1969, Creative nach Regeln: Methode 635, eine neue Technik zum Losen von Problemen, Absatzwirtschaft 12.
6.
Shah, J. J., 1998, “Experimental Investigation of Collaborative Techniques for Progressive Idea Generation,” Proceedings, ASME Design Theory and Methodology Conference, Atlanta, GA.
7.
VanGundy, A. B., 1988, Techniques of Structured Problem Solving, 2nd Ed., Van Nostrand Reinhold, NY.
8.
Mizuno, S., 1988, “Management for Quality Improvement: The 7 New QC Tools,” Productivity Press, Cambridge, MA.
9.
Fogler, H., and Le Blanc, S., 1995, Strategies for Creative Problem Solving, Prentice Hall, NJ.
10.
Gordon, W. J. J., 1961, Synectics, the Development of Creative Capacity, Harper, New York.
11.
Pahl, G., and Beitz, W., 1996, Engineering Design—A Systematic Approach, 2nd Ed., Springer, London.
12.
Altshuller, G., 1984, Creativity as an Exact Science, Gordon and Breach, NY.
13.
Shigley, J., and Uicker, J., 1995, Theory of Machines and Mechanisms, McGraw Hill, New York.
14.
Sickafus, E. N., 1998, “Unified Structured Inventive Thinking: How to Invent,” NTELLECK, Grosselle, MI.
15.
Kulkarni, S. V., 1998, Idea Generation Techniques—A Critical Survey, Tech. Report ASU/DAL/IG/98-2, Arizona State University.
16.
Smith, S. M., 1995, “Creative Cognition: Demystifying Creativity,” in C. N. Hedley et al., eds., Thinking and Literacy—The Mind at Work, Lawrence Erlbaum Associates, Hillsdale, NJ.
17.
Martindale, C., 1995, “Creativity and Connectionism,” in S. M. Smith et al., eds., The Creative Cognition Approach, MIT Press, Cambridge, MA.
18.
Langley, P., and Jones, R., 1988, “Computational Model of Scientific Insight,” in R. J. Sternberg, ed., The Nature of Creativity—Contemporary Psychological Perspectives, Cambridge University Press, NY.
19.
Jansson
, D. G.
, and Smith
, S. M.
, 1991
, “Design Fixation
,” Des. Stud.
, 12
, pp. 3
–11
.20.
Finke, R. A., Ward, T. B., and Smith, S. M., 1992, Creative Cognition—Theory, Research, and Applications, MIT Press, Cambridge, MA.
21.
Smith, S. M., and Ward, T. B., 1999, Discussion at Texas A&M University, June 25, 1999, College Station, TX.
22.
Ullman
, D. G.
, 1992
, “A Taxonomy for Mechanical Design
,” Research in Engineering Design
, 3
, pp. 179
–189
.23.
Dixon, J. R., Duffey, M. R., Irani, R. K., Meunier, K. L., and Orelup, M. F., 1988, “A Proposed Taxonomy of Mechanical Design Problems,” Proceedings of the 1988 International Computers in Engineering Conference, American Society of Mechanical Engineers, San Francisco, CA, pp. 41–46.
24.
Frost
, R. B.
, 1994
, “A Suggested Taxonomy for Engineering Design Problems
,” J. Eng. Des.
, 5
, No. 4
, pp. 399
–410
.25.
Myers, Briggs, I., and McCauley, M. H., 1985, Manual: A Guide to the Development and Use of the Myers-Briggs Type Indicator, Consulting Psychologists’ Press, Palo Alto, CA.
26.
Wilde, D. J., 1999, “Design Team Roles,” Proceedings, ASME Design Theory and Methodology Conference, Las Vegas, NV.
27.
McGrath, J. E., 1984, Groups: Interaction and Performance, Prentice-Hall, NJ, pp. 35–36.
28.
Dorst, K., and Cross, N., 1995, “Protocol Analysis as a Research Technique for Analyzing Design Activity,” ASME Design Engineering Technical Conferences, DE-Vol. 83, Vol. 2.
29.
Kulkarni, S. V., 1998, Survey of Creativity Models, Technical Report ASU/DAL/IG/98-1, Arizona State University.
30.
Candy
, L.
, and Edmonds
, E. A.
, 1996
, “Creative Design of the Lotus Bicycle: Implications for Knowledge Support Systems Research
,” Des. Stud.
, 17
, No, 1
, pp. 71
–90
.31.
Cross
, N.
, and Cross
, A. C.
, 1996
, “Winning by Design: The Methods of Gordon Murray, Racing Car Designer
,” Des. Stud.
, 17
, No. 1
, pp. 91
–107
.32.
Kumar
, V. K.
, Holman
, E. R.
, and Rudegeair
, P.
, 1991
, “Creativity Styles of Freshmen Students
,” J. Creat. Behavior
, 25
, No. 4
, pp. 275
–303
.33.
Basadur
, M.
, and Thompson
, R.
, 1986
, “Usefulness of the Ideation Principle of Extended Effort in Real World Professional and Managerial Creative Problem Solving
,” J. Creat. Behavior
, 20
, No. 1
, pp. 23
–34
.34.
Parnes, S., 1961, “Effects of Extended Effort in Creative Problem Solving,” J. Educ. Psychol., 52, No. 3.
35.
Torrance, E. P., 1964, “Role of Evaluation in Creative Thinking,” Bureau of Educational Research, University of Minnesota.
36.
Torrance, E. P., 1962, Guiding Creative Talent, Prentice Hall, Englewood Cliffs, NJ.
37.
Montgomery, D. C., 1997, Design and Analysis of Experiments, 4th Ed. John Wiley & Sons, New York.
38.
Kulkarni, S. V., 1999, Survey for Evidence of ‘Components of Creativity,’ Technical Report ASU/DAL/IG/99-7, Arizona State University.
39.
Kulkarni, S. V., and Summers, J. D., 1998, “Influence of Method Variables on the C-Sketch Method—An Experimental Study,” Technical Report ASU/DAL/IG/99-8, Arizona State University.
40.
Cross, N., 1996, “Creativity in Design: Not Leaping but Bridging,” in L. Candy and E. A. Edmonds, eds., Proceedings of the 2nd International Symposium Creativity and Cognition, 1996, Loughborough, pp. 27–35.
41.
Verstijnen
, I. M.
, Van Leeuwen
, C.
, Goldschmidt
, G.
, Hamel
, R.
, and Hennessey
, J. M.
, 1998
, “Sketching and Creative Discovery
,” Des. Stud.
, 19
, No. 4
, pp. 519
–546
.42.
Candy, L., 1996, “Understanding Creativity: An Empirical Approach,” in L. Candy and E. A. Edmonds, eds., Proceedings of the 2nd International Symposium Creativity and Cognition, 1996, Loughborough, pp. 45–54
43.
Ekvall, G., and Parnes, S. J., 1984, Creative Problem Solving Methods in Product Development—A Second Experiment, The Swedish Council for management and work life issues, Stockholm, Sweden.
44.
Grossman
, S. R.
, and Wiseman
, E. E.
, 1993
, “Seven Operating Principles for Enhanced Creative Problem Solving Training
,” J. Creat. Behavior
, 27
, No. 1
, pp. 1
–17
.45.
Isaksen
, S. G.
, and Parnes
, S. J.
, 1985
, “Curriculum Planning for Creative Thinking and Problem Solving
,” J. Creat. Behavior
, 19
, No. 1
, pp. 1
–29
.46.
Parnes
, S. J.
, 1987
, “Visioneering—State of the Art
,” J. Creat. Behavior
, 21
, No. 4
, pp. 283
–299
.47.
Perkins, D., 1981, The Mind’s Best Work, Harvard University Press, Cambridge, MA.
48.
Polya, G., 1945, How to Solve it, Princeton University Press, Princeton, NJ.
49.
Poze
, T.
, 1983
, “Analogical Connections—The Essence of Creativity
,” J. Creat. Behavior
, 17
, No. 4
pp. 240
–258
.50.
Roy
, R.
, 1993
, “Case Studies of Creativity in Innovative Product Development
,” Des. Stud.
, 14
, No. 4
, pp. 423
–443
.51.
Shaw
, M. C.
, 1986
, “Creative Design
,” Ann. CIRP
, 35
, No. 2
, pp. 461
–466
.52.
Sternberg, R. J., 1977, Intelligence, Information Processing and Analogical Reasoning: The Componential Analysis of Human Abilities, Erlbaum, Hillsdale, NJ.
53.
Visser
, W.
, 1996
, “Two Functions of Analogical Reasoning in Design: A Cognitive-Psychology Approach
,” Des. Stud.
, 17
, No. 4
, pp. 417
–434
.54.
Akin
, O.
, and Lin
, C.
, 1995
, “Design Protocol Data and Movel Design Decisions
,” Des. Stud.
, 16
, No. 2
, pp 211
–236
.55.
Gross
, M. D.
, 1996
, “The Electronic Cocktail Napkin—A Computational Environment for Working with Design Diagrams
,” Des. Stud.
, 17
, No. 1
, pp. 53
–69
.56.
Lawson, B., 1994, Design in Mind, Butterworth Architecture Press, Oxford, UK.
57.
Lawson, B., and Loke, S. M., 1996, “Computers, words and pictures,” in L. Candy and E. A. Edmonds (eds.) Proceedings of the 2nd International Symposium Creativity and Cognition, 1996, Loughborough, UK, pp. 108–119.
58.
Tovey
, M.
, 1986
, “Thinking Styles and Modeling Systems
,” Des. Stud.
, 7
, No. 1
, pp. 20
–30
.59.
Carson
, P. P.
, and Carson
, K. R.
, 1993
, “Managing Creativity Enhancement Through Goal-Setting and Feedback
,” J. Creat. Behavior
, 27
, No. 1
, pp. 36
–45
.60.
Hist
, B.
, 1992
, “How Artists Overcome Creative Blocks
,” J. Creat. Behavior
, 26
, No. 2
, pp. 81
–82
.61.
Kolodner
, J. L.
, and Wills
, L. M.
, 1996
, “Powers of Observation in Creative Design
,” Des. Stud.
, 17
, No. 4
, pp. 385
–416
.62.
Finke, R. A., 1990, Creative Imagery: Discoveries and Inventions in Visualization, Erlbaum, Hillsdale, NJ.
63.
Savage
, J. C. D.
, and Miles
, C.
, 1998
, “The Interaction of Time and Cost Constraints on the Design Process
,” Des. Stud.
, 19
, No. 2
, pp. 217
–233
.64.
Christensen, P. R., Guilford, J. P., and Wilson, R. C., 1957, “Relations of Creative Responses to Working Time and Instructions,” J. Exp. Psychol., 53, No. 2.
65.
Donovan
, J. C.
, 1985
, “Creative Success: Twenty Years on the Back of an Envelope
,” J. Creat. Behavior
, 19
, No. 2
, pp. 110
–112
.66.
Hyman
, R.
, 1961
, “On Prior Information and Creativity
,” Psychol. Rep.
, 9
, pp. 151
–161
.67.
Schwab
, L.
, 1991
, “No Static in Your Attic: Tapping Into Your Creative and Intuitive Abilities
,” J. Creat. Behavior
, 25
, No. 3
, pp. 256
–262
.68.
Stein, M. I., 1975, Stimulating Creativity: Group Procedures, Vol. 2, Academic Press, New York.
69.
Basadur
, M. S.
, Graen
, G. B.
, and Green
, S. G.
, 1982
, “Training in Creative Problem Solving: Effects on Ideation and Problem Finding and Solving in an Industrial Research Organization
,” Organ Behav. Hum. Perform
, 30
, pp. 41
–70
.70.
Bugliarello
, G.
, 1969
, “Developing Creativity in an Engineering Science Course—Socrates Revisited
,” Eng. Educ.
, 59
, No. 7
, pp. 877
–880
.71.
Cohen, D., Whitmeyer, J. W., and Funk, W. H., 1960, “Effect of Group Cohesiveness and Training Upon Creative Thinking,” J. Appl. Psychol., 44, No. 5.
72.
Parnes, S., and Meadow, A., 1959, “Effects of Brainstorming Instructions on Creative Problem Solving by Trained and Untrained Subjects,” J. Educ. Psychol., 50, No. 4.
73.
Purcell
, A. T.
, and Gero
, J. S.
, 1996
, “Design and Other Types of Fixation
,” Des. Stud.
, 17
, No. 4
, pp. 363
–383
.74.
Rickards
, T.
, and Freedman
, B. L.
, 1978
, “Procedures for Managers in Idea Deficient Situations: An Examination of Brainstorming Approaches
,” J. Manage. Stud.
, 15
, No. 1
, pp. 43
–55
.75.
Rowatt, W. C., Nesselroade, Jr., K. P., Beggan, J. K., and Allison, S. T., 1997, “Perceptions of Brainstorming In Groups: The Quality Over Quantity Hypothesis,” J. Creat. Behavior, 31, No. 2.
76.
Simonton, D. K., 1987, “Genius: The Lessons of Historiometry,” in S. G. Isaksen, ed., Frontiers in Creativity Research: Beyond the Basics, Bearly Limited, Buffalo, NY.
77.
Akin
, O.
, and Akin
, C.
, 1996
, “Frames of Reference in Architectural Design: Analyzing the Hyperacclamation (A-h-a-!)
,” Des. Stud.
, 17
, No. 4
, pp. 341
–361
.78.
Barron, F., 1988, “Putting Creativity to Work,” in R. J. Sternberg, ed., The Nature of Creativity, pp. 76–98.
79.
Lipshitz
, R.
, and Waingortin
, M.
, 1995
, “Getting Out of Ruts—A Laboratory Study of a Cognitive Model of Reframing
,” J. Creat. Behavior
, 29
, No. 3
, pp. 151
–172
.80.
Rawlinson, J. G., 1981, Creative Thinking and Problem Solving, Gower, Farnborough, UK.
81.
Watzlawick, P., Weakland, J., and Fisch, R., 1974, Change: Principles of Problem Formulation and Problem Resolution, Norton, New York.
82.
Visser
, W.
, 1992
, “Use of Analogical Relationships Between Design Problem-Solution Representations: Exploitation at the Action-Execution and Action-Management Levels of the Activity
,” Studia Psychologica
, 34
, No. 4/5
, pp. 351
–357
.83.
Visser
, W.
, 1995
, “Use of Episodic Knowledge and Information in Design Problem Solving
,” Des. Stud.
, 16
, No. 2
, pp. 171
–187
.84.
DeBono, E., 1984, Tactics: The Art & Science of Success, Little Brown, Boston, MA.
Copyright © 2000
by ASME
You do not currently have access to this content.
