Evaluation-oriented Pragmatic Mixed Methods
Evaluation-oriented Pragmatic Mixed Methods Design · Also known as: pragmatic evaluation mixed methods, program evaluation mixed methods, applied pragmatic mixed methods, mixed methods program evaluation
Evaluation-oriented pragmatic mixed methods is a research design that combines quantitative and qualitative data collection within a pragmatist philosophical stance, expressly to evaluate programs, policies, or interventions. Rather than adhering rigidly to a single paradigm, it selects methods for their fitness to answer evaluation questions about program effectiveness, outcomes, and stakeholder experiences. The design is widely applied in education, public health, social services, and development evaluation contexts.
Read the full method
Sign in with a free account to read this section.
Method map
The neighbourhood of related methods — select a node to explore.
When to use it
Use this design when evaluating a real-world program, policy, or intervention where both outcome data (quantity, magnitude) and process/experience data (why, how, for whom) are needed to make credible recommendations. It is appropriate when a single-method evaluation would be insufficient — for instance, when outcome measures exist but stakeholder perspectives on implementation are essential for interpretation. It is not appropriate when the evaluation budget or timeline cannot support two full data collection strands, or when the evaluation question is purely descriptive and a single qualitative or quantitative approach would suffice. Avoid forcing a mixed design onto a straightforward question that one method can answer well.
Strengths & limitations
- Produces richer, more actionable findings than monomethod evaluation by triangulating quantitative outcomes with qualitative process evidence.
- The pragmatic stance makes the design flexible and responsive to stakeholder needs rather than constrained by paradigm orthodoxy.
- Well-suited to program evaluation contexts where both accountability (did it work?) and learning (why and how?) are required.
- Joint displays and mixed integration techniques make the added value of mixing visible and interpretable.
- Accommodates formative and summative evaluation purposes within a single overarching design.
- Requires expertise in both quantitative and qualitative methods as well as mixed methods integration — a demanding skill set that may require a multidisciplinary team.
- Substantially more resource-intensive (time, budget, personnel) than single-strand designs.
- Integration quality varies widely in practice; studies often report parallel strands without meaningful mixing, reducing the value over two separate studies.
- The pragmatic stance provides philosophical flexibility but can obscure important epistemological tensions that affect validity and interpretation.
Frequently asked
How is this different from just doing a survey and some interviews?
The key distinction is intentional integration. A study that collects a survey and interviews but reports them separately is conducting parallel monomethod studies. Evaluation-oriented pragmatic mixed methods requires a planned integration point — where quantitative findings inform the qualitative questions, or where joint displays bring both strands into dialogue to answer the evaluation question together. The added value of mixing comes from that integration, not from data collection alone.
Does 'pragmatic' mean the design has no philosophical foundation?
No. Pragmatism is a philosophical tradition (Peirce, James, Dewey) that holds that the meaning and value of ideas lie in their practical consequences. In research, a pragmatic stance means that the evaluation question and its usefulness to stakeholders — rather than allegiance to positivism or interpretivism — guide methodological choices. It is a coherent philosophical foundation, not an absence of one.
When should I choose sequential explanatory over concurrent design?
Choose sequential explanatory (QUAN then QUAL) when you expect quantitative results that need qualitative follow-up to explain unexpected patterns, subgroup differences, or outliers. Choose concurrent when you can collect both strands simultaneously and plan to merge them for a more complete picture. Sequential exploratory (QUAL then QUAN) is preferred when you need qualitative insight to develop or refine the quantitative instrument before deployment.
Is this design appropriate for a dissertation?
Yes, but it is demanding. A doctoral student should have access to supervision expertise in both methods, sufficient time for two data collection phases if sequential, and clear plans for integration. A well-executed concurrent convergent design — equal-priority survey and interview study with a joint display — is more feasible at dissertation level than an elaborate multi-phase sequential design.
How do I handle it when quantitative and qualitative findings contradict each other?
Divergence is informative, not a flaw. Common explanations include: different subgroups are captured by the two methods; quantitative measures and qualitative accounts are capturing different dimensions of the same phenomenon; or implementation varied in ways the quantitative measures could not detect. Investigate and report the divergence explicitly — it often yields the most important insights for program improvement.
Sources
- Greene, J. C. (2007). Mixed Methods in Social Inquiry. Jossey-Bass. ISBN: 978-0787984090
- Tashakkori, A., & Teddlie, C. (Eds.). (2010). SAGE Handbook of Mixed Methods in Social and Behavioral Research (2nd ed.). Sage. ISBN: 978-1412972666
How to cite this page
ScholarGate. (2026, June 3). Evaluation-oriented Pragmatic Mixed Methods Design. ScholarGate. https://scholargate.app/en/research-design/evaluation-oriented-pragmatic-mixed-methods
Which method?
Set this method beside its closest kin and read them side by side — the library lays the books on the table; the choice is yours.
- Action ResearchQualitative Research↔ compare
- Program EvaluationField Methods↔ compare