Statistical flaws revealed in top journals' papers

In summary, a recent study has found that Nature and the British Medical Journal have a high percentage of statistical errors in their published papers. This raises concerns about the accuracy of results reported in these and potentially other mainstream journals. The study estimates that four percent of reported statistically significant results may actually be insignificant. This highlights the importance of thorough review and fact-checking in the publication process.
  • #1
Monique
Staff Emeritus
Science Advisor
Gold Member
4,219
67
http://www.newscientist.com/news/news.jsp?id=ns99995051"

Two of the world's top scientific journals, Nature and the British Medical Journal, have been found guilty of routinely publishing figures that do not add up.

The evidence comes from Spanish researchers who found a surprisingly large number of statistical errors in the two journals. They warn that the same may well be true of other mainstream journals.

The analysis revealed that at least one error appeared in 38 per cent of the Nature papers and 25 per cent of the BMJ papers looked at. Furthermore, the study estimates that four per cent of results reported to be statistically "significant" may not be significant after all. :eek:

http://www.newscientist.com/news/news.jsp?id=ns99995051"
Rounding numbers seems to be a difficult task for some..
 
Last edited by a moderator:
Biology news on Phys.org
  • #2
I am not surprised. Statistics and probability seem to be reduced to folklore theorems and rules of thumb even in branches of quantitative science.
 
  • #3
Well that isn't very encouraging. Then again I have witnessed papers get rejected from other journals where the editor had requested "additional information" that was in the paper already.
 

1. What are some common examples of statistical flaws in research papers?

Some common examples of statistical flaws in research papers include small sample sizes, biased sampling methods, failure to account for confounding variables, and incorrect data analysis techniques.

2. How can statistical flaws impact the validity of a research study?

Statistical flaws can greatly impact the validity of a research study by producing inaccurate or misleading results. This can lead to incorrect conclusions and unreliable findings, making the research study less credible and potentially hindering its impact in the scientific community.

3. How can researchers avoid statistical flaws in their studies?

To avoid statistical flaws, researchers should carefully plan their study designs, use appropriate and unbiased sampling methods, properly analyze their data using appropriate statistical tests, and ensure their findings are reproducible and generalizable.

4. What is the role of peer review in identifying and addressing statistical flaws in research papers?

Peer review plays a crucial role in identifying and addressing statistical flaws in research papers. During the peer review process, other experts in the field carefully examine the study design, data analysis, and results to identify any potential flaws and provide feedback for improvement.

5. How can the general public identify potential statistical flaws in research studies?

The general public can identify potential statistical flaws in research studies by critically evaluating the study design, sample size, and data analysis methods. They can also look for peer-reviewed studies and consider the credibility of the researchers and their affiliations.

Similar threads

COVID Covid Long Haulers: Statistics Show Potential for Serious Health Issue
    • Biology and Medical
2
Replies
47
Views
7K
Chromosomes reveal surprise human-chimp differences
    • Biology and Medical
Replies
2
Views
2K
Precognition paper to be published in mainstream journal
    • General Discussion
5
Replies
164
Views
42K
Key papers in computational neuroscience
    • Biology and Medical
Replies
2
Views
11K
I New Hubble Paper On Lensing In Galactic Clusters
    • Cosmology
Replies
2
Views
1K
Medical NeuroQuantology another gem, hiding in plain sight
    • Biology and Medical
Replies
6
Views
3K
Complex organic molecules discovered in protoplanetary disk
    • Astronomy and Astrophysics
Replies
5
Views
2K
A Twistors and celestial holography
    • Beyond the Standard Models
Replies
14
Views
3K
Concordance value of Hubble growth rate (2014)
    • Cosmology
Replies
3
Views
2K
Black holes in the globular cluster M22 with Dr. Tom Maccarone
    • Astronomy and Astrophysics
Replies
12
Views
3K

Hot Threads

Recent Insights

Back
Top