Reading focus
Syllabus: How Do We Know When Psychotherapy Helps—or Harms?
Separate the observed allegiance–outcome association from explanations involving bias, expertise or genuine treatment differences.
Why you’re reading it. Evaluate a threat to credibility without replacing evidence appraisal with suspicion about researchers.
A question to consider. Propose one design safeguard and one additional observation that would help distinguish allegiance bias from informed preference for a more effective treatment.
Why this reading
Researchers can have theoretical and practical commitments to the treatments they study. This overview examines the association between those allegiances and reported outcomes, while raising a harder question: when does an association indicate bias?
Before you read
Researcher allegiance means a preference for or commitment to a treatment or its theory. A meta-analysis of meta-analyses combines review-level results; overlapping primary studies create dependencies that must be addressed.
Read for
- Compare ways of measuring allegiance, the adjustment for overlapping studies, and the proposed alternative causal explanations.
- Apply the same scrutiny to the authors’ assessment of allegiance among researchers studying allegiance itself.
Consider afterwards
- Draw two causal accounts of an allegiance–outcome association, one involving bias and one involving genuine treatment differences.
- Which design safeguard could reduce a plausible source of bias without assuming that every committed researcher produces distorted results?
Editorial context
The overview combines 30 meta-analyses located through November 2012. Allegiance ratings are imperfect, some analyses may be missing, and associations do not alone establish a causal effect. The authors argue that additional patterns make bias plausible; assess that argument rather than using allegiance as an automatic reason to dismiss a study. Their own moderator analyses also have limited precision and correlated predictors.