Abstract
Objective
To assess the association between competing interests and authors' conclusions in randomised clinical trials.Design
Epidemiological study of randomised clinical trials published in the BMJ from January 1997 to June 2001. Financial competing interests were defined as funding by for profit organisations and other competing interests as personal, academic, or political.Studies
159 trials from 12 medical specialties.Main outcome measures
Authors' conclusions defined as interpretation of extent to which overall results favoured experimental intervention. Conclusions appraised on 6 point scale; higher scores favour experimental intervention.Results
Authors' conclusions were significantly more positive towards the experimental intervention in trials funded by for profit organisations alone compared with trials without competing interests (mean difference 0.48 (SE 0.13), P=0.014), trials funded by both for profit and non-profit organisations (0.30 (SE 0.10), P=0.003), and trials with other competing interests (0.45 (SE 0.13), P=0.006). Other competing interests and funding from both for profit and non-profit organisations were not significantly associated with authors' conclusions. The association between financial competing interests and authors' conclusions was not explained by methodological quality, statistical power, type of experimental intervention (pharmacological or non-pharmacological), type of control intervention (for example, placebo or active drug), or medical specialty.Conclusions
Authors' conclusions in randomised clinical trials significantly favoured experimental interventions if financial competing interests were declared. Other competing interests were not significantly associated with authors' conclusions.Free full text
Association between competing interests and authors' conclusions: epidemiological study of randomised clinical trials published in the BMJ
Abstract
Objective
To assess the association between competing interests and authors' conclusions in randomised clinical trials.
Design
Epidemiological study of randomised clinical trials published in the BMJ from January 1997 to June 2001. Financial competing interests were defined as funding by for profit organisations and other competing interests as personal, academic, or political.
Studies
159 trials from 12 medical specialties.
Main outcome measures
Authors' conclusions defined as interpretation of extent to which overall results favoured experimental intervention. Conclusions appraised on 6 point scale; higher scores favour experimental intervention.
Results
Authors' conclusions were significantly more positive towards the experimental intervention in trials funded by for profit organisations alone compared with trials without competing interests (mean difference 0.48 (SE 0.13), P=0.014), trials funded by both for profit and non-profit organisations (0.30 (SE 0.10), P=0.003), and trials with other competing interests (0.45 (SE 0.13), P=0.006). Other competing interests and funding from both for profit and non-profit organisations were not significantly associated with authors' conclusions. The association between financial competing interests and authors' conclusions was not explained by methodological quality, statistical power, type of experimental intervention (pharmacological or non-pharmacological), type of control intervention (for example, placebo or active drug), or medical specialty.
Conclusions
Authors' conclusions in randomised clinical trials significantly favoured experimental interventions if financial competing interests were declared. Other competing interests were not significantly associated with authors' conclusions.
Introduction
Financial and other competing interests have recently received increasing attention.1 In a study of trials of multiple myeloma the authors' conclusions—that is, the authors' reported interpretation of the overall trial results—were more positive towards the benefit of experimental interventions in those trials that were funded by the pharmaceutical industry compared with trials that were funded by non-profit organisations.2 In a systematic review on antipsychotic drugs for schizophrenia, trials were more likely to show a benefit of treatment if they were funded by drug companies.3 It is not known whether the association between financial competing interests and authors' conclusions is limited to certain specialties or whether it is a general problem. It is also not known whether personal, academic, or political interests are associated with authors' conclusions.
Unlike most journals, the BMJ requires authors to declare funding as well as other competing interests. Trials in the BMJ therefore offer a unique opportunity to assess the potential impact of competing interests. We analysed the association between financial and other competing interests and authors' conclusions in randomised clinical trials published in the BMJ. We performed the analyses with and without adjustment for potential confounders, including the methodological quality, statistical power, type of experimental intervention, type of control intervention, and specialty.
Methods
We included all original randomised clinical trials published in the BMJ from 1997 to June 2001. Eligible trials were identified through Medline on PubMed using the key words “bmj” and “random*.” We considered trials to be randomised if some form of the word random was used to describe the method of allocation. We excluded articles that referred to previous publications for a description of the study design.
From each trial, we gathered data on authors' conclusions, competing interests, methodological quality, sample size (number of patients per intervention arm), whether the preset sample size was estimated and reached, specialty, type of intervention (pharmacological or non-pharmacological), and type of control (drug, placebo, no intervention, nursing, or surgery).
We defined authors' conclusions as the original investigators' reported interpretation of the extent to which the overall trial results favoured the experimental over the control intervention. We graded authors' conclusions according to phrasing in the abstract and the summarised conclusion on a previously validated 6 point scale2 (box). Higher scores indicate more positive conclusions towards the experimental intervention: scores of 1-3 favoured the control and scores of 4-6 favoured the experimental intervention.
We defined competing interests as anything that may influence professional judgment. We considered funding from for profit organisations—that is, companies that may incur financial gain or loss depending on the outcome—to be financial competing interests. Trials funded by for profit organisations alone and trials funded by both for profit and non-profit organisations were analysed separately. Other competing interests were defined as personal, academic, political, or similar competing interests declared by authors.
We assessed the methodological quality by looking at three components4–6: generation of allocation sequence (adequate, unclear (not reported), or inadequate (quasi-randomised)); concealment of allocation (adequate, unclear (not reported), or inadequate); and blinding (adequate, unclear, or not performed).
One author extracted data unblinded. The other author who was blinded with regard to funding and other competing interests assessed authors' conclusions and methodological quality. The interclass correlation coefficient between blinded and unblinded assessment of authors' conclusions was 0.89 (95% confidence interval 0.85 to 0.92), indicating good agreement between observers. Consensus was reached in all cases before analyses.
Statistical methods
We assessed discrepancies between groups of trials by analysis of variance.7 Authors' conclusions were log transformed to approximate a normal distribution and to achieve homogeneity of variance. We analysed the association between competing interests and authors' conclusions with and without adjustment for potential confounders—that is, methodological quality, sample size (log transformed), whether the preset sample size was determined and reached, the specialty, type of experimental intervention, and control intervention. We used the step down Bonferroni method to adjust for multiple comparisons by increasing the degrees of freedom. Accordingly, the level of significance was set to 5%. The analyses were performed in SPSS version 10.0 for Windows.
Results
We identified 684 eligible references of which 159 randomised clinical trials fulfilled our inclusion criteria. In 94 of these trials authors declared that they had no competing interests. In 65 trials authors had competing interests because they had received funding from for profit organisations (27 trials), funding by both for profit and non-profit organisations (19 trials), or other competing interests—for instance, personal, academic, or political (19 trials).
In most trials, authors' conclusions favoured the experimental intervention (table). The generation of the allocation sequence was adequate in 135 trials, unclear in 23 trials, and inadequate in one trial. Concealment of allocation was adequate in 109 trials, unclear in 45 trials, and inadequate in five trials. Forty one trials were double blind, 19 trials were single blind, and 99 trials were not blinded. The mean sample size was 485 (SE 130) patients per intervention arm. Preset sample size calculations were reported in 123 trials and were reached in 103 trials. The trials were in psychiatry, palliative care/nursing, infections, cardiology, gastroenterology, gynaecology/obstetrics, stroke, pain, allergy, obstructive lung diseases, alcohol/drug abuse, and orthopaedic surgery. The experimental intervention was pharmacological in 99 trials and non-pharmacological in 60 trials. The control intervention was nursing in 29 trials, drugs in 27 trials, surgery in 5 trials, placebo in 31 trials, and nothing in 67 trials.
The unadjusted analyses showed a significant association between competing interests and authors' conclusions (r2=0.10; P=0.001). Authors' conclusions were not significantly different in trials without competing interests, trials funded by both for profit and non-profit organisations, and trials with other competing interests. As shown in the figure, authors' conclusions in trials funded by for profit organisations alone significantly favoured experimental interventions compared with trials without competing interests (mean difference 0.48 (SE 0.13), P=0.014), trials funded by both for profit and non-profit organisations (0.30 (SE 0.10), P=0.003), and trials with other competing interests (0.45 (SE 0.13), P=0.006). Adjustment for potential confounders did not affect the association between competing interests and authors' conclusions (r2=0.11; P=0.002). None of the extracted confounders was significantly associated with authors' conclusions.
Discussion
In a sample of randomised clinical trials published in the BMJ from January 1997 to June 2001 we found that authors' conclusions were positively associated with financial competing interests. Other competing interests such as personal or academic were not significantly associated with authors' conclusions. Inadequate methodological quality, greater statistical power, specialty, and type of intervention and control did not explain these findings.
Strengths and weaknesses of study
The included trials covered 12 specialties. A more homogenous group of trials—for example, trials examining one therapeutic question—would have allowed an analysis of the association between competing interests and the trials' quantitative results. Such an analysis, however, would not capture the overall trade off between the efficacy and safety of the interventions. This trade off, which was summarised in authors' conclusions, is important as it may form the basis for subsequent treatment recommendations.
We included trials published in the BMJ after the introduction of the CONSORT statement.8 We chose this sample because of the consistent reporting of competing interests in the BMJ and to avoid confounding by editorial policies, language bias, and variations in methodological quality. We cannot exclude that some competing interests were not revealed by authors. Furthermore, given the declared editorial policies,1 the BMJ may be considered one of the leading medical journals with respect to the reporting of competing interests. It is possible that the requirement to disclose competing interests will discourage authors with competing interests from submitting biased trials to the BMJ. Accordingly, we may have underestimated the general association between competing interests and authors' conclusions. Conversely, apart from random error, we have not been able to identify any reasons why the results of the present study should be false positive.
The BMJ publishes fewer pharmacological trials than other general medical journals.9 According to our adjusted analyses, the association between financial competing interests and authors' conclusions was significant in pharmacological as well as non-pharmacological trials. Our findings may be relevant only to trials published in the BMJ, although we cannot identify any reason why this should be the case.
Our results increase the external validity of previous evidence.2,3 In accordance with Djulbegovic and colleagues,2 we found that trials sponsored by for profit organisations significantly more often compared the experimental interventions with placebo or no intervention (data not shown). However, according to our adjusted analyses, this did not explain why authors' conclusions were more favourable towards experimental interventions in trials funded by for profit organisations. Our results also concur with a systematic review by Wahlbeck and colleagues, who showed that the quantitative results of trials were significantly more favourable towards antipsychotic drugs if they were funded by for profit organisations.3 The combined evidence supports suggestions that systematic reviews should include sensitivity analyses with regard to funding.3
Mechanisms and implications
Our results cannot show the causes of the association between financial competing interests and authors' conclusions. Profit organisations, by skill or by chance, may fund only those trials in which the experimental intervention is significantly better than the control intervention.
Alternative explanations could be variations in methodological quality or statistical power. According to our adjusted analyses, these aspects could not explain the association between financial competing interests and authors' conclusions. We cannot, however, confirm or refute previous suggestions that the association reflects a violation of equipoise—that is, lack of substantial uncertainty about the relative value of one treatment versus another.2 Previous evidence indicates that trials sponsored by industry are more likely to be affected by publication bias.10 Publication bias could therefore explain the findings of the present study.
Some have argued that industrial funding has undue influence on the research agenda.11 Others state that a submitted manuscript should be considered the intellectual property of authors, not the study sponsor.12 A reliable assessment of this question depends on the transparency of the reporting.1 The CONSORT statement8,13 and similar standardised reporting guidelines could consider the importance of adequate reporting of funding. The reader can make an assessment only if the information is clearly presented.
Table
Score for conclusions*
| No (%) of trials
|
---|---|
1 | 10 (6) |
2 | 5 (3) |
3 | 33 (21) |
4 | 21 (13) |
5 | 39 (25) |
6 | 51 (32) |
Acknowledgments
We thank Christian Gluud for critical revision of an earlier draft of the paper.
Footnotes
Funding: Danish Medical Research Council; 1991 Pharmacy Foundation, Denmark; Copenhagen Hospital Corporation Medical Research Council; Danish Institute of Health Technology Assessments.
Competing interests: None declared.
References
Articles from The BMJ are provided here courtesy of BMJ Publishing Group
Full text links
Read article at publisher's site: https://doi.org/10.1136/bmj.325.7358.249
Read article for free, from open access legal sources, via Unpaywall: https://www.bmj.com/content/bmj/325/7358/249.full.pdf
Citations & impact
Impact metrics
Citations of article over time
Alternative metrics
Smart citations by scite.ai
Explore citation contexts and check if this article has been
supported or disputed.
https://scite.ai/reports/10.1136/bmj.325.7358.249
Article citations
The Primacy of Ethics in Aesthetic Medicine: A Review.
Plast Reconstr Surg Glob Open, 12(6):e5935, 25 Jun 2024
Cited by: 0 articles | PMID: 38919517 | PMCID: PMC11199011
Clinical evaluation of marketed and non-marketed orthodontic products: are researchers now ahead of the times? A meta-epidemiological study.
Prog Orthod, 24(1):32, 23 Oct 2023
Cited by: 0 articles | PMID: 37867164 | PMCID: PMC10590772
Does type of funding affect reporting in network meta-analysis? A scoping review of network meta-analyses.
Syst Rev, 12(1):81, 06 May 2023
Cited by: 1 article | PMID: 37149700 | PMCID: PMC10163730
Review Free full text in Europe PMC
Association Between Industry Sponsorship of Spine-Related Clinical Trials, Publication Status, and Research Outcomes.
Global Spine J, 14(7):2039-2044, 02 May 2023
Cited by: 3 articles | PMID: 37129370 | PMCID: PMC11418736
The standards of reporting trials in pets (PetSORT): Explanation and elaboration.
Front Vet Sci, 10:1137781, 30 Mar 2023
Cited by: 5 articles | PMID: 37065227 | PMCID: PMC10103631
Go to all (202) article citations
Similar Articles
To arrive at the top five similar articles we use a word-weighted algorithm to compare words from the Title and Abstract of each citation.
Industry sponsorship and financial conflict of interest in the reporting of clinical trials in psychiatry.
Am J Psychiatry, 162(10):1957-1960, 01 Oct 2005
Cited by: 146 articles | PMID: 16199844
Association between industry funding and statistically significant pro-industry findings in medical and surgical randomized trials.
CMAJ, 170(4):477-480, 01 Feb 2004
Cited by: 259 articles | PMID: 14970094 | PMCID: PMC332713
Association between research sponsorship and study outcome in plastic surgery literature.
Ann Plast Surg, 63(6):661-664, 01 Dec 2009
Cited by: 19 articles | PMID: 19887933