Design and Development Research: Methods, Strategies, and Issues by Rita C. Richey, James D. Klein

List of Tables     xiii
List of Figures     xiv
Preface     xv
Acknowledgments     xix
An Overview of Design and Development Research     1
The Need for Design and Development Research     2
Design and Development as a Science
The Design and Development Knowledge Base and Its Foundations
Design and Development Research and the Advancement of the Field
The Scope of Design and Development Research     7
Research on Product and Tool Design and Development
Research on Design and Development Models
The Outcomes of Product and Tool Research and Model Research
The Unique Role of Design and Development Research
Looking Ahead     14
Identifying Design and Development Research Problems     15
Guidelines for Selecting a Research Problem     15
Sources of Design and Development Research Problems     16
Problems from the Workplace
Problems Related to Emerging Technology
Problems Related to Design and Development Theory
Using the Literature to Identify and Refine a Research Problem     25
The Role of Literature in Problem Identification
Sources for a Literature Review in Design and Development
Focusing the Design and Development Research Problem     29
Transforming Research Problems into Research Questions
Determining the Parameters of the Study
Looking Ahead     32
AChecklist for Identifying and Focusing the Problem of a Design and Development Study     33
Design and Development Research Methodology     35
The Nature of Research Design     36
Establishing Validity
Facilitating Notions of Causality
Facilitating Generalization and Interpretation
Anticipating and Avoiding Problems
Components of a Research Design
The Characteristics of Design and Development Research Methodology     39
Commonly Used Design and Development Research Methods and Strategies
Mixed and Multiple Methods Research
Matching Research Methods and Questions     42
Classifying Design and Development Research Goals
Matching Research Purposes and Methods
Looking Ahead     45
A Checklist for Matching Design and Development Research Questions and Methods     46
Product and Tool Research: Methods and Strategies     47
Strategies of Product Development Research     48
A Representative Mixed Methods Case Study
A Representative Multiple Qualitative Methods Study
Strategies of Program Development Research
A Representative Program Evaluation Study
Strategies for Research on Design and Development Phases     52
A Representative Mixed Methods Study of Formative Evaluation
A Representative Multiple Quantitative Methods Study of Integrated Evaluation
Strategies for Research on Tool Development and Use     54
A Representative Tool Development Case Study
A Representative Tool Use Study
A Summary of Product and Tool Research Designs     57
Unique Product and Tool Research Design Concerns     61
Researcher-Participant Dual Roles
Research in a Natural Work Environment
Looking Ahead     63
A Checklist for Addressing Common Concerns of Product and Tool Research Design     64
Model Research: Methods and Strategies     65
Strategies of Model Development Research     66
A Representative Multiple Qualitative Methods Study
A Representative Mixed Methods Study
Strategies of Model Validation Research     67
A Representative Expert Review Study
A Representative Usability Documentation Study
A Representative Investigation of Component Variables
A Representative Field-Evaluation Study
A Representative Controlled Testing Study
Strategies of Model Use Research     72
A Representative Expertise Study Using Think-Aloud Strategies
A Representative Designer Decision-Making Study Using In-Depth Interviews
A Representative Qualitative Study of Conditions Impacting Model Use
A Summary of Model Research Designs     75
Unique Model Research Design Concerns     78
Working with Recall Data
Research in Multiple Natural Work Environments
Distinguishing Participant Characteristics
Looking Ahead     81
A Checklist for Addressing Common Concerns of Model Research Design     82
Selecting Participants and Settings     83
Selecting the Setting of the Study     84
Types of Settings and Their Characteristics
Matching Settings to Research Questions
Practical Issues in Setting Selection
Selecting the Participants of the Study     87
Types of Participants
Sampling Participants
Participant and Setting Solutions from the Design and Development Literature     90
Participants and Settings in Product and Tool Research
Participants and Settings in Model Research
Ethical Consideration for the Protection of Participants     94
Getting Approval to Conduct Research
Obtaining Informed Consent
Avoiding Coercion
Maintaining Confidentiality and Ensuring Anonymity
Looking Ahead     96
A Checklist for Selecting Participants and Settings in a Design and Development Study     97
Collecting Design and Development Research Data     99
Critical Design and Development Research Data     100
Profile Data
Context Data
In-Progress Project Data
Try-Out Data
Data Collection Instruments     106
Work Logs
Surveys and Questionnaires
Interview Protocols
Observation Guides
Technology-Based Data Collection Strategies     117
Web-Based Data Collection
Software-Based Data Collection
Laboratory-Based Data Collection
Data Collection Issues     123
Ensuring Data Integrity
Establishing Appropriate Data Sets
Looking Ahead      125
A Checklist for Collecting Data in a Design and Development Study     126
Interpreting Design and Development Findings     127
The Contributions of Design and Development Research     127
Expanding the Design and Development Knowledge Base
Creating the Foundations for Design and Development Theory
Creating the Foundations for Future Research
Interpreting Product and Tool Research Findings     132
Lessons Learned about Product and Tool Design and Development Processes
Lessons Learned about Product and Tool Use
Interpreting Model Research Findings     135
Understanding Model Development Findings
Understanding Model Validation Findings
Understanding Model Use Findings
Interpretation Issues     139
Generalizations and Project-Specific Data
The Impact of Organizational Concerns
Looking Ahead     142
A Checklist for Interpreting Findings of Design and Development Research     143
The Status and Future of Design and Development Research     145
The Expansion of Design and Development Research     146
Alternative Approaches to Design and Development Research
New Opportunities for Design and Development Research
Conditions that Facilitate Design and Development Research     151
Dissatisfaction with Existing Research Orientations
Knowledge of the Innovation
Availability of Resources
Conclusions     153
Glossary of Terms     155
References     161
Author Index     173
Subject Index     177