Wegwarth,O.

H ealth care providers are the most highly rated sources of health information. 1 Thus, responsibil-ity for helping patients understand the potential benefits and harms of medical prevention and intervention falls largely upon physicians. Can physicians fulfill this task? The news on that front is not encouraging. Eddy 2 reported already three decades ago that 95 out of 100 physicians overestimated the probability of breast cancer after a positive mammography test result by an order of magnitude. More recently, Bramwell and colleagues 3 found that only 1 out of 21 obstetricians were able to estimate the probability of an unborn child actually having Down syndrome given a positive test; those most confident in their estimates were furthest away from the correct response. Naylor et al 4 showed that physicians rated the effectiveness of a treatment much higher when the benefit was described in terms of a relative risk reduction—''a medical interven-tion results in a 34 \% relative decrease in the incidence of fatal and nonfatal myocardial infarction''—than when it was described as an absolute risk reduction—''a medical intervention results in a 1.4 \% decrease in the incidence of fatal and nonfatal myocardial infarction—2.5 \% vs. 3.9 \% .'' None of 20 German gynecologists were aware of the most serious risk of mammography overdiagnosis, when asked specifically about the harms of that screening program. 5 In a survey of 50 Australian physicians, only 8 were able to understand and explain number needed to treat to others. 6 And 70 \% of 412 US primary care physicians based their recommendation in favor of a screening test on 5-year survival rates, although this is a misleading metric in the context of screening. 7 All of these studies document the same phenomenon: A considerable number of physicians are statistically illiterate, that is, they do not understand the statistics of their own discipline. Given the evidence corroborating the statistical innu-meracy of many fully licensed physicians, the results of the study by Anderson and colleagues 8 on statistical illiteracy in residents reported in this issue of the Journal of Graduate Medical Education may come as no surprise. Only 12 \% of the 4713 surveyed obstetrics-gynecology residents were able to correctly answer 2 simple questions on medical statistics: one on the meaning of the P value and the other on assessing the positive predictive value of mammography screening. The practical relevance of the latter question is particularly striking. What will the uninformed 88 \% of these residents say when their first patient asks about her chance of truly having breast cancer given a positive mammogram? Statistically illiterate physicians are doomed to rely on their statistically illiterate conclusions, on local custom, and on the (mostly) inaccurate promises of pharmaceutical sales representatives and their leaflets. The price for this innumeracy is paid by patients who undergo medical procedures without being correctly informed of what to expect. When Schwartz and colleagues 9 investigated a stratified sample of 479 American women, of whom most underwent regular mammography screening, 92 \% believed that this screening could not harm a woman without breast cancer. In fact, for every woman saved from breast cancer death by mammography, 10 healthy women, who would not have been diagnosed without screening, will be wrongly diagnosed with breast cancer and treated unnecessarily for it. 10 The results of a representative study of 9 European countries with more than 10 000 participants amplify the depressing evidence of the US study: Frequent consultation with a physician was not correlated with better understand-ing of screening benefit but rather with overestimating it.

Wegwarth, O. (2013). Statistical illiteracy in residents: What they do not learn today will hurt their patients tomorrow. Journal of Graduate Medical Education, 5, 340-341. doi:10.4300/JGME-D-13-00084.1 (Full text)

Publication year	2013
Document type:	Article
Publication status:	Published
External URL:	http://dx.doi.org/10.4300/JGME-D-13-00084.1 View
Categories:	EducationHealthProbability
Keywords: