Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

© 2019 The Authors Journal of Evaluation in Clinical Practice Published by John Wiley & Sons Ltd Background: In 2018, a so-called crisis developed in the international network of systematic reviewers known as Cochrane. It was widely depicted in terms of two competing narratives—“bad behaviour” by one member of Cochrane's Governing Board and scientific and moral decline within Cochrane. Objective: Our goal was to distil insights on the structural issues underpinning the crisis, without taking a definitive position on the accuracy of either narrative. Approach and dataset: In this paper, we draw on (among other theories) Becker's notion of moral entrepreneurship and Foucault's conceptualisation of power to analyse the claims and counterclaims made by different parties. Our dataset consisted of publicly available materials (blogs, journal articles, newspaper articles) to end 2018, notably those relating to the expulsion of one Governing Board member. Main findings: Both narratives include strong moral claims about the science of systematic review and the governance of scientific organizations. The expelled individual and his supporters defined good systematic reviews in terms of a particular kind of methodological rigour and elimination of bias, and good governance largely in terms of measures to achieve independence from industry influence. Most of Cochrane's Governing Board and their sympathizers evaluated systematic reviews according to a broader range of criteria, incorporating factors such as attention to relationships among reviewers and reflexivity and dialogue around scientific and other judgements. They viewed governance partly in terms of accountability to an external advisory group. Power-knowledge alignments in Cochrane have emerged from, and contributed to, a particular system of meaning which is now undergoing evolution and challenge. Conclusion: Polarizing Cochrane's “crisis” into two narratives, only one of which is true, is less fruitful than viewing it in terms of a duality consisting of tensions between the two positions, each of which has some validity. Having framed the conflict as primarily philosophical and political rather than methodological and procedural, we suggest how Cochrane and its supporters and critics might harness their tensions productively.

Original publication

DOI

10.1111/jep.13124

Type

Journal article

Journal

Journal of Evaluation in Clinical Practice

Publication Date

01/10/2019

Volume

25

Pages

717 - 725