Home › Research › Treatments
Persistence of contradicted claims in the literature
Tatsioni A, Bonitsis NG, Ioannidis JP.. JAMA, 2007-12-01
Topic: Risk, prevention and care in population studies
Plain-language summary
Context Some research findings based on observational epidemiology are contradicted by randomized trials, but may nevertheless still be supported in some scientific circles. Objectives To evaluate the change over time in the content of citations for 2 highly cited epidemiological studies that proposed major cardiovascular benefits associated with vitamin E in 1993; and to understand how these benefits continued being defended in the literature, despite strong contradicting evidence from large randomized clinical trials (RCTs). To examine the generalizability of these findings, we also examined the extent of persistence of supporting citations for the highly cited and contradicted protective effects of beta-carotene on cancer and of estrogen on Alzheimer disease. Data sources For vitamin E, we sampled articles published in 1997, 2001, and 2005 (before, early, and late after publication of refuting evidence) that referenced the highly cited epidemiological studies and separately sampled articles published in 2005 and referencing the major contradicting RCT (HOPE trial). We also sampled articles published in 2006 that referenced highly cited articles proposing benefits associated with beta-carotene for cancer (published in 1981 and contradicted long ago by RCTs in 1994-1996) and estrogen for Alzheimer disease (published in 1996 and contradicted recently by RCTs in 2004). Data extraction The stance of the citing articles was rated as favorable, equivocal, and unfavorable to the intervention. We also recorded the range of counterarguments raised to defend effectiveness against contradicting evidence. Results For the 2 vitamin E epidemiological studies, even in 2005, 50% of citing articles remained favorable. A favorable stance was independently less likely in more recent articles, specifically in articles that also cited the HOPE trial (odds ratio for 2001, 0.05 [95% confidence interval, 0.01-0.19; P Conclusion Claims from highly cited observational studies persist and continue to be supported in the medical literature despite strong contradictory evidence from randomized trials.
What this study adds
Evidence grade: High
This analysis looked at how often contradicted claims, including a protective effect of estrogen on Alzheimer disease, continued to be cited after randomized trials refuted them. It is about how research findings are reported and cited, not about a treatment for Alzheimer disease.
Taken from this record’s own fields, not from reading the paper. The grade is assigned from the abstract’s wording; what that means.
Cite this study APA, Vancouver, BibTeX · download .bib or .ris
APA 7th
Tatsioni, A., Bonitsis, N. G., & Ioannidis, J. P. (2007). Persistence of contradicted claims in the literature. JAMA. https://doi.org/10.1001/jama.298.21.2517
Vancouver
Tatsioni A, Bonitsis NG, Ioannidis JP. Persistence of contradicted claims in the literature. JAMA. 2007. doi:10.1001/jama.298.21.2517. PMID: 18056905.
BibTeX
@article{tatsioni2007-18056905,
author = {Tatsioni, A. and Bonitsis, N. G. and Ioannidis, J. P.},
title = {{Persistence of contradicted claims in the literature}},
journal = {JAMA},
year = {2007},
doi = {10.1001/jama.298.21.2517},
pmid = {18056905},
url = {https://doi.org/10.1001/jama.298.21.2517}
}
Built from the record alzhub holds for this paper, not looked up. Volume, issue and page numbers are not held in the record. Check the citation against the original before you use it.
Key findings
- Objectives To evaluate the change over time in the content of citations for 2 highly cited epidemiological studies that proposed major cardiovascular benefits associated with vitamin E in 1993; and to understand how these benefits continued being defended in the literature, despite strong contradicting evidence from large randomized clinical trials (RCTs).
- To examine the generalizability of these findings, we also examined the extent of persistence of supporting citations for the highly cited and contradicted protective effects of beta-carotene on cancer and of estrogen on Alzheimer disease.
- We also sampled articles published in 2006 that referenced highly cited articles proposing benefits associated with beta-carotene for cancer (published in 1981 and contradicted long ago by RCTs in 1994-1996) and estrogen for Alzheimer disease (published in 1996 and contradicted recently by RCTs in 2004).
- Results For the 2 vitamin E epidemiological studies, even in 2005, 50% of citing articles remained favorable.
Why it matters
This analysis looked at how often contradicted claims, including a protective effect of estrogen on Alzheimer disease, continued to be cited after randomized trials refuted them. It is about how research findings are reported and cited, not about a treatment for Alzheimer disease.
New to this subject? Start with our plain-English guide: Treatments →
Study details
- Evidence strengthHigh
How this study scored 49/100
Published in a top-tier journal. Scored zero for study design, sample size, effect reported, studied in people and randomized / blinded because the record does not state it.
| Component | Points | Why |
|---|---|---|
| Journal tier | 10 / 10 | Tier 1 — top-tier general journal (JAMA) |
| Journal's citation record | 4 / 4 | JAMA: journal h-index 1,011 (OpenAlex, 2026-10-29) |
| Study design | 0 / 12 | No study design recorded — scores zero, not guessed (not stated in the record — scored 0) |
| Strength of evidence | 5 / 5 | Rated “high” in our summary |
| Peer-review validation | 10 / 10 | Peer-reviewed. Published as an article in a named peer-reviewed journal. |
| How recent | 1 / 5 | 2007 — within 20 year(s) of the newest study here |
| Sample size | 0 / 4 | Participant count not stated — scores zero (not stated in the record — scored 0) |
| Effect reported | 0 / 3 | No effect size reported — scores zero (not stated in the record — scored 0) |
| Studied in people | 0 / 3 | Not stated whether this was studied in people — scores zero (not stated in the record — scored 0) |
| Randomized / blinded | 0 / 2 | No randomization or blinding stated — scores zero (not stated in the record — scored 0) |
| Times cited | 5 / 7 | Cited 225 times (OpenAlex, 2026-10-10) |
| Citations per year | 3 / 5 | 10.7 citations a year over 21 year(s) since 2007 |
| Impact for its field and year | 4 / 6 | Cited 17.9× the average for papers of its field and year (OpenAlex FWCI) |
| Cited by studies here | 0 / 6 | No other study in this library cites it |
| Still being cited | 1 / 4 | Cited 11 times in 2024–2026 (2026 still in progress; OpenAlex) |
| Senior author's track record | 4 / 4 | Last-listed author John P. A. Ioannidis: h-index 230 (OpenAlex, whole career) |
| Institution's track record | 0 / 3 | University of Ioannina: institution h-index 513 (OpenAlex) |
| Multicenter collaboration | 0 / 3 | OpenAlex lists 1 institution(s) in 1 country — scores zero (affiliation lists can be incomplete) |
| Indexed in PubMed | 2 / 2 | Indexed in PubMed (PMID 18056905) |
| Free to read | 0 / 2 | Behind a paywall — scores zero |
| Total | 49 / 100 | — |
What each of these 20 components measures, and what this score is not →
Read the original
May need a subscription Unpaywall, Europe PMC and OpenAlex found no free copy of the full text (checked 10 Oct 2026), so the publisher may charge for it. The PubMed abstract is free.
Related
Studies in the library that share something with this one. The line above each title says what.
Studies this one cites
Referenced by this study and also in the alzhub library, so you can read them here.
Related studies in Treatments from nearby years
Also in Treatments
201 studies in the library are filed under Treatments with no topic tag they share with another; these are this study's neighbours in a fixed tour of them. The Treatments hub.