ScholarGate
Assistant

Sustainability and Long-Term Evaluation

Sustainability concerns whether the benefits of an improvement persist after the initial implementation effort and its dedicated resources have ended, and long-term evaluation is how that persistence is assessed. Empirical work shows that many successfully implemented programs are not maintained, making sustainability a distinct and demanding problem rather than a guaranteed outcome of good implementation.

Definition

Sustainability is the extent to which a new practice, program, or innovation, after a defined period of implementation, continues to be delivered and to produce its intended benefits, potentially while adapting to changing conditions; long-term evaluation is the assessment of whether and how those benefits are maintained over time.

Scope

This topic covers the definition and conceptualization of sustainability, why programs decay over time, the role of long-term evaluation frameworks (such as the maintenance dimension of RE-AIM), and the related idea of de-implementing practices that should not persist. It is a methodological and conceptual reference and does not provide individualized clinical guidance.

Core questions

  • What does it mean for a health-care improvement to be sustained?
  • Why are many successfully implemented programs not maintained?
  • How is maintenance assessed in long-term evaluation?
  • When should a practice be deliberately de-implemented rather than sustained?

Key concepts

  • Sustainability versus maintenance
  • Institutionalization
  • Program decay and erosion
  • Capacity and resources
  • Adaptation over time
  • De-implementation
  • Long-term outcome evaluation

Key theories

Comprehensive definition of sustainability
Moore and colleagues synthesized the literature to characterize sustainability through recurring elements such as continued delivery and benefits over time, ongoing capacity and resources, and adaptation, addressing inconsistent prior definitions.
RE-AIM maintenance dimension
Within the RE-AIM framework, Maintenance captures the long-term institutionalization of a program at the setting level and the continuation of effects at the individual level, providing an explicit evaluation lens for sustainability.

Mechanisms

Long-term evaluation asks whether delivery and benefits continue after the implementation period and its dedicated support end. Empirical reviews find that programs commonly erode when funding, attention, or champions are withdrawn, when the organizational context shifts, or when fit with routines is weak. Conceptual work clarifies that sustainability may include adaptation rather than rigid continuation, and evaluation frameworks such as RE-AIM operationalize maintenance at both the setting and individual levels. A complementary concern is de-implementation, the deliberate reduction of low-value or harmful practices that should not be sustained.

Clinical relevance

Sustaining quality and safety improvements is what turns short-term project gains into durable benefit for patients, yet maintenance is frequently not achieved. This topic describes how sustainability and long-term evaluation are conceptualized and studied at the program and system level and is not a basis for individualized clinical or treatment decisions.

Evidence & guidelines

The topic draws on empirical reviews of sustainability, conceptual syntheses of its definition, and evaluation frameworks rather than on a clinical guideline. The literature consistently reports that lack of sustainability is common and that definitions and measures have been inconsistent, motivating clearer concepts and longer-term evaluation designs.

History

As implementation science developed, attention shifted from achieving adoption toward keeping gains. Reviews around 2012 documented that many implemented programs were not sustained and that the construct was poorly defined; later work proposed comprehensive definitions and emphasized maintenance within established evaluation frameworks. Programme-evaluation syntheses of large quality-improvement efforts reinforced that durable change is difficult and context-dependent.

Debates

Should sustained practice stay fixed or adapt?
There is debate over whether sustainability means continuing a program unchanged or allowing it to evolve while preserving core benefits; comprehensive definitions increasingly treat adaptation as compatible with, not contrary to, being sustained.

Key figures

  • Shannon Wiltsey Stirman
  • Julia E. Moore
  • Sharon Straus
  • Russell Glasgow
  • Mary Dixon-Woods

Related topics

Seminal works

  • wiltsey-stirman-2012
  • moore-2017
  • glasgow-2019-reaim
  • dixon-woods-2012

Frequently asked questions

Is sustainability the same as the improvement simply continuing unchanged?
Not necessarily; many definitions hold that a program can be sustained while adapting to changing conditions, as long as its core activities continue and its intended benefits are maintained over time.
Why is sustainability treated separately from initial implementation?
Because a practice can be implemented successfully yet still fade once dedicated funding, attention, or staff are withdrawn; empirical reviews show that maintenance is frequently not achieved, so it requires its own attention, design, and long-term evaluation.

Methods for this concept

Related concepts