William J. Sutherland, David Spiegelhalter and Mark A. Burgman published a comprehensive list of 20 tips for interpreting scientific claims in Nature that the writers think “…should be part of the education of civil servants, politicians, policy advisers and journalists — and anyone else who may have to interact with science or scientists. Politicians with a healthy scepticism of scientific advocates might simply prefer to arm themselves with this critical set of knowledge.”
You can read the article here, this is the list:
- Differences and chance cause variation.
- No measurement is exact.
- Bias is rife.
- Bigger is usually better for sample size.
- Correlation does not imply causation.
- Regression to the mean can mislead.
- Extrapolating beyond the data is risky
- Beware the base-rate fallacy.
- Controls are important.
- Randomization avoids bias.
- Seek replication, not pseudoreplication.
- Scientists are human.
- Significance is significant.
- Separate no effect from non-significance.
- Effect size matters.
- Study relevance limits generalizations.
- Feelings influence risk perception.
- Dependencies change the risks.
- Data can be dredged or cherry picked.
- Extreme measurements may mislead.