Poor replication validity of biomedical association studies reported by newspapers
| hal.structure.identifier | Institut des Maladies Neurodégénératives [Bordeaux] [IMN] | |
| hal.structure.identifier | Centre Émile Durkheim [CED] | |
| dc.contributor.author | DUMAS-MALLET, Estelle | |
| hal.structure.identifier | Centre Émile Durkheim [CED] | |
| dc.contributor.author | SMITH, Andy | |
| hal.structure.identifier | Institut des Maladies Neurodégénératives [Bordeaux] [IMN] | |
| dc.contributor.author | BORAUD, Thomas | |
| hal.structure.identifier | Institut des Maladies Neurodégénératives [Bordeaux] [IMN] | |
| dc.contributor.author | GONON, François | |
| dc.date.issued | 2017-02-21 | |
| dc.identifier.issn | 1932-6203 | |
| dc.description.abstractEn | OBJECTIVE: To investigate the replication validity of biomedical association studies covered by newspapers.METHODS: We used a database of 4723 primary studies included in 306 meta-analysis articles. These studies associated a risk factor with a disease in three biomedical domains, psychiatry, neurology and four somatic diseases. They were classified into a lifestyle category (e.g. smoking) and a non-lifestyle category (e.g. genetic risk). Using the database Dow Jones Factiva, we investigated the newspaper coverage of each study. Their replication validity was assessed using a comparison with their corresponding meta-analyses.RESULTS: Among the 5029 articles of our database, 156 primary studies (of which 63 were lifestyle studies) and 5 meta-analysis articles were reported in 1561 newspaper articles. The percentage of covered studies and the number of newspaper articles per study strongly increased with the impact factor of the journal that published each scientific study. Newspapers almost equally covered initial (5/39 12.8%) and subsequent (58/600 9.7%) lifestyle studies. In contrast, initial non-lifestyle studies were covered more often (48/366 13.1%) than subsequent ones (45/3718 1.2%). Newspapers never covered initial studies reporting null findings and rarely reported subsequent null observations. Only 48.7% of the 156 studies reported by newspapers were confirmed by the corresponding meta-analyses. Initial non-lifestyle studies were less often confirmed (16/48) than subsequent ones (29/45) and than lifestyle studies (31/63). Psychiatric studies covered by newspapers were less often confirmed (10/38) than the neurological (26/41) or somatic (40/77) ones. This is correlated to an even larger coverage of initial studies in psychiatry. Whereas 234 newspaper articles covered the 35 initial studies that were later disconfirmed, only four press articles covered a subsequent null finding and mentioned the refutation of an initial claim.CONCLUSION: Journalists preferentially cover initial findings although they are often contradicted by meta-analyses and rarely inform the public when they are disconfirmed. | |
| dc.language.iso | en | |
| dc.publisher | Public Library of Science | |
| dc.subject.en | Risk Factors | |
| dc.subject.en | Reproducibility of Results | |
| dc.subject.en | Neurology | |
| dc.subject.en | Psychiatry | |
| dc.subject.en | Journalism | |
| dc.subject.en | Life Style | |
| dc.subject.en | Humans | |
| dc.subject.en | Factual | |
| dc.subject.en | Health Behavior | |
| dc.subject.en | Databases | |
| dc.subject.en | Causality | |
| dc.subject.en | Journal Impact Factor | |
| dc.subject.en | Internal Medicine | |
| dc.subject.en | Information Dissemination | |
| dc.subject.en | Biomedical Research | |
| dc.title.en | Poor replication validity of biomedical association studies reported by newspapers | |
| dc.type | Article de revue | |
| dc.identifier.doi | 10.1371/journal.pone.0172650 | |
| dc.subject.hal | Sciences de l'Homme et Société/Sociologie | |
| dc.subject.hal | Sciences de l'Homme et Société/Science politique | |
| bordeaux.journal | PLoS ONE | |
| bordeaux.page | [en ligne] | |
| bordeaux.volume | 12 | |
| bordeaux.issue | 2 | |
| bordeaux.peerReviewed | oui | |
| hal.identifier | halshs-01807234 | |
| hal.version | 1 | |
| hal.popular | non | |
| hal.audience | Internationale | |
| hal.origin.link | https://hal.archives-ouvertes.fr//halshs-01807234v1 | |
| bordeaux.COinS | ctx_ver=Z39.88-2004&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.jtitle=PLoS%20ONE&rft.date=2017-02-21&rft.volume=12&rft.issue=2&rft.spage=%5Ben%20ligne%5D&rft.epage=%5Ben%20ligne%5D&rft.eissn=1932-6203&rft.issn=1932-6203&rft.au=DUMAS-MALLET,%20Estelle&SMITH,%20Andy&BORAUD,%20Thomas&GONON,%20Fran%C3%A7ois&rft.genre=article |
Fichier(s) constituant ce document
| Fichiers | Taille | Format | Vue |
|---|---|---|---|
|
Il n'y a pas de fichiers associés à ce document. |
|||