• Home
  • Guideline
  • Implementation
    • The Project
    • The Project Team
    • Advisory Board
  • Educational material
  • Publications
  • Contact
  • enEnglish
    • deDeutsch

Presentation of frequencies

Home Guideline Presentation of frequencies

Introduction

The success of evidence-based praxis depends on the clear, effective communication of statistical information (1). The aim is for the information to be understood, the risks to be correctly estimated and, finally, for informed decisions to be made possible. The development process of the information comprises the selection of the content that should be communicated and the critical appraisal including the decision whether presentation of numerical data is adequate. In order to communicate frequencies correctly it is important to check the existing evidence on various presentation formats with regard to their efficacy and also to check for possible adverse effects.

To present statistical information (probabilities, quality of diagnostic tests as well as benefits, harm and side effects of medicinal measures) verbal descriptors are used. Verbal descriptors are more or less specific linguistic transcriptions of frequencies, e.g. seldom, occasionally, frequent, certain or probable.

However, studies have shown that the interpretations of linguistic descriptions and the resulting perception of risks differ significantly both inter-individually and between (medical) nonprofessionals and professionals (2). Verbal information concerning side effects leads to overestimating the probability of their occurrence (2).

A first attempt to standardize the verbal description of risks was made by the European Commission in 1998 (3). In the guideline on the readability of information on medical products, five verbal descriptors were each allocated with a defined numerical frequency or range of frequency (3). The Federal Institute for Drugs and Medical Devices (BfArM) also demands the use of fixed linguistic descriptions combined with a numerical indicator when making statements about the frequencies of side effects in product information leaflets (4). In a survey carried out in Germany, the participating physicians, pharmacists, and legal practitioners were unable to allocate the verbal probabilities for side effects correctly to the corresponding percentages (5).

There are various formats available for the numerical presentation: natural frequencies, percentages, absolute risk reduction (ARR), relative risk reduction (RRR), number needed to treat/screen/harm (NNT, NNS, NNH). The natural frequencies are given in differing reference parameters (denominators): 1 in 100, 1 in 1000, 1 in 10000. The effects of these formats have been investigated in several systematic reviews (1, 6-8), whereby Akl et al. for the first time included the outcome persuasiveness which is measured by means of hypothetical choices (1).

For a long time the use of natural frequencies was considered superior to percentages and was also strongly advocated in the context of evidence-based medicine (9). Several studies have investigated how often the positive predictive value of a test was correctly estimated when statements were made about the prevalence of a particular illness or about sensitivity and the false-positive rate (10-13). They found out that the number of correct answers was very low, even when the parameters were shown as natural frequencies. That is why positive predictive values and other test rating parameters should be shown directly, without the reader of the information having to carry out the corresponding calculations (11).

A possible adverse effect of presenting risks as natural frequencies can arise through the denominator neglect: Perception is focused on the number of observed incidents (numerators), no matter how small, and not on the reference parameters (denominators) (14). If the risks are compared – perhaps with or without a therapy – the perception is distorted even more if the chosen parameters are different (e.g. 80 of 800 vs. 20 of 100). The disadvantages of this presentation have long since been the subject of discussion. The use of different parameters makes it difficult to compare different statements and to estimate the level of risk correctly (15) which can lead to overestimating the risks (16).

Questions

  1. What effects does the verbal presentation of risks, benefits and harm have in comparison to the numerical presentation?
  2. What effect does the presentation of benefits and harm as absolute risk reduction (ARR) have in comparison to the relative risk reduction (RRR)?
  3. What effects does the presentation in natural frequencies have in comparison to the presentation in percentages?
  4. What effects does the presentation of number needed to treat/screen/harm (NNT, NNS, NNH) have in comparison to the presentation as ARR (percentage or natural frequencies)?
  5. What effects does the presentation with constant reference parameters (e.g. x in 1000) have in comparison to presentation with differing parameters (e.g. 2 in 100; 5 in 1000)?
Recommendation 1-5
Evidence tables 1-5
Full text
[ultimate_exp_section title=”References” new_title=”References” icon=”none” new_icon=”none”]
  1. Akl EA, Oxman AD, Herrin J, Vist GE, Terrenato I, Sperati F, et al. Using alternative statistical formats for presenting risks and risk reductions. The Cochrane database of systematic reviews. 2011;3:CD006776. Epub 2011/03/18.
  2. Berry DC, Knapp P, Raynor DK. Provision of information about drug side-effects to patients. Lancet. 2002; http://onlinelibrary.wiley.com/o/cochrane/clcentral/articles/036/CN-00558036/frame.html (Zugriff am 11.10.2016).
  3. European Commission D-GI. A guideline on the readability of the label and package leaflet of medical products for human use. 1998. http://www.paint-consult.com/fileadmin/editorial/downloads/guidelines_behoerden/arzneimittelgesetze/PAINT-Consult_A_Guideline_on_the_readability_1998.pdf (Zugriff am 11.10.2016).
  4. Bundesministerium für Arzneimittel und Medizinprodukte (BfArM). Wie sollen die Häufigkeiten für Nebenwirkungen in der Produktinformation angegeben werden? 2015; http://www.bfarm.de/SharedDocs/FAQs/DE/Arzneimittel/pal/ja-ampal-faq.html (Zugriff am 11.10.2016) .
  5. Ziegler A, Hadlak A, Mehlbeer S, Konig IR. Comprehension of the description of side effects in drug information leaflets: a survey of doctors, pharmacists and lawyers. Deutsches Arzteblatt international. 2013;110(40):669-73. Epub 2013/10/30.
  6. Bunge M, Mühlhauser I, Steckelberg A. What constitutes evidence-based patient information? Overview of discussed criteria. Patient Education and Counseling. 2010;78(3):316-28. Epub 2009/12/17.
  7. Covey J. A Meta-analysis of the effects of presenting treatment benefits in different formats. [References]. Medical Decision Making. 2007;27(5):638-654.
  8. Trevena LJ, Davey HM, Barratt A, Butow P, Caldwell P. A systematic review on communicating with patients about evidence. Journal of evaluation in clinical practice. 2006;12(1):13-23. Epub 2006/01/21.
  9. Woloshin S, Schwartz LM. Communicating data about the benefits and harms of treatment: a randomized trial. Annals of internal medicine. 2011;155(2):87-96. Epub 2011/07/20.
  10. Bramwell R, West H, Salmon P. Health professionals’ and service users’ interpretation of screening test results: experimental study. British Medical Journal (Clinical research ed). 2006;333(7562):284. Epub 2006/07/15.
  11. Galesic M, Gigerenzer G, Straubinger N. Natural frequencies help older adults and people with low numeracy to evaluate medical screening tests. Medical decision making: an international journal of the Society for Medical Decision Making. 2009;29(3):368-71. Epub 2009/01/09.
  12. Garcia-Retamero R, Hoffrage U. Visual representation of statistical information improves diagnostic inferences in doctors and their patients. Social science & medicine. 2013;83:27-33. Epub 2013/03/08.
  13. Siegrist M, Keller C. Natural frequencies and Bayesian reasoning: The impact of formal education and problem context. [References]. Journal of Risk Research. 2011;14(9):1039-55.
  14. Reyna VF, Brainerd CJ. Numeracy, ratio bias, and denominator neglect in judgments of risk and probability. Learning and Individual Differences. 2008;18(1):89-107.
  15. Zikmund-Fisher BJ. Time to retire the 1-in-X risk format. Medical Decision Making: an international journal of the Society for Medical Decision Making. 2011;31(5):703-4.
  16. Pighin S, Savadori L, Barilli E, Cremonesi L, Ferrari M, Bonnefon J-F. The 1-in-X effect on the subjective assessment of medical probabilities. Medical Decision Making: an international journal of the Society for Medical Decision Making. 2011;31(5):721-9.
  17. Gurmankin AD, Baron J, Armstrong K. The effect of numerical statements of risk on trust and comfort with hypothetical physician risk communication. Medical decision making: an international journal of the Society for Medical Decision Making. 2004;24(3):265-71. Epub 2004/05/25.
  18. Knapp P, Gardner PH, Carrigan N, Raynor DK, Woolf E. Perceived risk of medicine side effects in users of a patient information website: a study of the use of verbal descriptors, percentages and natural frequencies. British journal of health psychology. 2009;14(3):579-94. Epub 2008/11/11.
  19. Lee Char SJ, Evans LR, Malvar GL, White DB. A randomized trial of two methods to disclose prognosis to surrogate decision makers in intensive care units. American journal of respiratory and critical care medicine. 2010;182(7):905-9. Epub 2010/06/12.
  20. Mazur DJ, Hickam DH, Mazur MD. How patients’ preferences for risk information influence treatment choice in a case of high risk and high therapeutic uncertainty: asymptomatic localized prostate cancer. Medical decision making: an international journal of the Society for Medical Decision Making. 1999;19(4):394-8. Epub 1999/10/16.
  21. Wallsten TS, Budescu DV, Zwick R, Kemp SM. Preferences and reasons for communicating probabilistic information in verbal or numerical terms. Bulletin of the Psychonomic Society. 1993;31(2):135-8.
  22. Berry D, Raynor T, Knapp P, Bersellini E. Over the counter medicines and the need for immediate action: a further evaluation of European Commission recommended wordings for communicating risk. Patient Education and Counseling. 2004;53(2):129-34. Epub 2004/05/14.
  23. Berry DC, Raynor DK, Knapp P. Communicating risk of medication side effects: an empirical evaluation of EU recommended terminology. [References]. Psychology, Health & Medicine. 2003;8(3):251-63.
  24. Berry D, Raynor T, Knapp P, Bersellini E. Is 15 per cent very common? Informing people about the risks of medication side effects. International Journal of Pharmacy Practice. 2002;10(3):145-51.
  25. Knapp P, Raynor DK, Berry DC. Comparison of two methods of presenting risk information to patients about the side effects of medicines. Quality & safety in health care. 2004;13(3):176-80. Epub 2004/06/04.
  26. Knapp P, Raynor DK, Woolf E, Gardner PH, Carrigan N, McMillan B. Communicating the risk of side effects to patients: an evaluation of UK regulatory recommendations. Drug safety: an international journal of medical toxicology and drug experience. 2009;32(10):837-49. Epub 2009/09/03.
  27. Marteau TM, Saidi G, Goodburn S, Lawton J, Michie S, Bobrow M. Numbers or words? A randomized controlled trial of presenting screen negative results to pregnant women. Prenatal diagnosis. 2000;20(9):714-8. Epub 2000/10/04.
  28. Shaw NJ, Dear PR. How do parents of babies interpret qualitative expressions of probability? Archives of disease in childhood. 1990;65(5):520-3. Epub 1990/05/01.
  29. Man-Son-Hing M, O’Connor AM, Drake E, Biggs J, Hum V, Laupacis A. The effect of qualitative vs. quantitative presentation of probability estimates on patient decision-making: a randomized trial. Health expectations: an international journal of public participation in health care and health policy. 2002;5(3):246-55. Epub 2002/08/30.
  30. Hagerty RG, Butow PN, Ellis PA, Lobb EA, Pendlebury S, Leighl N, et al. Cancer patient preferences for communication of prognosis in the metastatic setting. Journal of Clinical Oncology. 2004;22(9):1721-30.
  31. Cheung YB, Wee HL, Thumboo J, Goh C, Pietrobon R, Toh HC, et al. Risk communication in clinical trials: a cognitive experiment and a survey. BMC medical informatics and decision making. 2010;10:55. Epub 2010/09/28.
  32. Natter HM, Berry DC. Effects of presenting the baseline risk when communicating absolute and relative risk reductions. Psychology, Health & Medicine. 2005;10(4):326-34.
  33. Carling CL, Kristoffersen DT, Montori VM, Herrin J, Schunemann HJ, Treweek S, et al. The effect of alternative summary statistics for communicating risk reduction on decisions about taking statins: a randomized trial. PLoS medicine. 2009;6(8):e1000134. Epub 2009/08/27.
  34. Schwartz LM, Woloshin S, Black WC, Welch HG. The role of numeracy in understanding the benefit of screening mammography. Annals of internal medicine. 1997;127(11):966-72. Epub 1997/12/31.
  35. Sheridan SL, Pignone MP, Lewis CL. A randomized comparison of patients’ understanding of number needed to treat and other common risk reduction formats. Journal of general internal medicine. 2003;18(11):884-92. Epub 2003/12/23.
  36. Sprague D, LaVallie DL, Wolf FM, Jacobsen C, Sayson K, Buchwald D. Influence of graphic format on comprehension of risk information among American Indians. [References]. Medical Decision Making. 2011;31(3):437-43.
  37. Ruiz JG, Andrade AD, Garcia-Retamero R, Anam R, Rodriguez R, Sharit J. Communicating global cardiovascular risk: Are icon arrays better than numerical estimates in improving understanding, recall and perception of risk? Patient Education and Counseling. 2013;93(3):394-402.
  38. Berry DC, Knapp P, Raynor T. Expressing medicine side effects: assessing the effectiveness of absolute risk, relative risk, and number needed to harm, and the provision of baseline risk information. Patient Education and Counseling. 2006;63(1-2):89-96. Epub 2005/10/26.
[/ultimate_exp_section]

© 2014-2017 Leitlinie Gesundheitsinformation

  • Contact
  • Disclaimer & Privacy Policy
  • Imprint