Psychology Reader

When More Evidence-Based Practice Does Not Improve Outcomes

Sally N. Merry, Sarah Hopkins, Mathijs F. G. Lucassen, and 11 others · 2020 · JAMA Network Open

Role
Critical reappraisal · Methodological contribution
Difficulty
Moderate
Full work length
12 pages
Type
Journal article

Access

Psychology Reader links to legitimate sources and does not host article PDFs.

Reading focus

Syllabus: How Should Psychological Treatment Change Across Childhood and Adolescence?

Compare the content of usual care and the separation between fidelity and clinical outcomes.

Why you’re reading it. Test the reach of the earlier result across service contexts.

A question to consider. If usual care already uses many supported techniques, what outcome pattern would you expect—and what evidence would test that explanation?

Why this reading

Changing clinical practice and improving people’s lives are different outcomes. This New Zealand trial tests whether training clinicians in a modular approach increases delivery of supported techniques and improves youth outcomes.

Before you read

Fidelity describes how an intervention is delivered relative to its intended procedures. A treatment contrast depends on both conditions. Usual care can contain many of the same techniques as a structured intervention.

Read for

  1. Keep clinician training, treatment fidelity and clinical change separate.
  2. Examine randomization, missing data, adverse-event monitoring and the content of usual care.

Consider afterwards

  1. What would explain greater fidelity without a greater clinical benefit?
  2. How would you test whether the comparison service explains different trial results?

Editorial context

The trial randomized 206 youths aged 7–14; 200 supplied outcome data at two or more time points. MATCH increased use of empirically supported content but did not improve measured clinical outcomes or efficiency over usual care. The authors’ explanation involving stronger usual care is plausible, not independently randomized across countries. Follow-up was short, and some populations were underrepresented.