Background: Repeatability and reproducibility are essential for clinicians for several purposes. Although discouraged, use of the Coefficient of Variation (CV) for assessing repeatability and reproducibility, rather than the Intraclass Correlation Coefficient (ICC), is still widespread. The aim of the present study was to highlight how using inappropriate indices may lead to misleading results, and this is done by simulation study and using real data on Anterior Active Rhinomanometry (AAR) in both healthy children and ones with rhinitis. Methods: A simulation study was carried out to highlight how using inappropriate indices could be misleading. Then a comparison was made between CV and ICC to assess repeatability and reproducibility of AAR, for which previous studies have given underestimated results. AAR is recommended as the gold standard tool for measuring nasal resistance in clinical practice. Results: A simulation study showed that the ICCs estimated from data generated assuming a true CV yielded results in agreement with estimated CVs; by contrast, if data were generated assuming a true ICC, CVs yielded conflicting results. For AAR, ICCs showed good repeatability, whereas CVs showed unacceptable repeatability. AUC and 95% CI for AAR showed good performance in predicting current symptoms of rhinitis in the overall study population. Conclusions: The present study focused on the importance of the choice of appropriate indices of repeatability and reproducibility, demonstrating the repeatability of AAR in both healthy children and ones with rhinitis.

Cilluffo G, Z.A. (2020). Assessing Repeatability and Reproducibility of Anterior Active Rhinomanometry (AAR) in Children. BMC MEDICAL RESEARCH METHODOLOGY, 20(1) [10.1186/s12874-020-00969-1].

Assessing Repeatability and Reproducibility of Anterior Active Rhinomanometry (AAR) in Children

Cilluffo G;Ferrante G;
2020-01-01

Abstract

Background: Repeatability and reproducibility are essential for clinicians for several purposes. Although discouraged, use of the Coefficient of Variation (CV) for assessing repeatability and reproducibility, rather than the Intraclass Correlation Coefficient (ICC), is still widespread. The aim of the present study was to highlight how using inappropriate indices may lead to misleading results, and this is done by simulation study and using real data on Anterior Active Rhinomanometry (AAR) in both healthy children and ones with rhinitis. Methods: A simulation study was carried out to highlight how using inappropriate indices could be misleading. Then a comparison was made between CV and ICC to assess repeatability and reproducibility of AAR, for which previous studies have given underestimated results. AAR is recommended as the gold standard tool for measuring nasal resistance in clinical practice. Results: A simulation study showed that the ICCs estimated from data generated assuming a true CV yielded results in agreement with estimated CVs; by contrast, if data were generated assuming a true ICC, CVs yielded conflicting results. For AAR, ICCs showed good repeatability, whereas CVs showed unacceptable repeatability. AUC and 95% CI for AAR showed good performance in predicting current symptoms of rhinitis in the overall study population. Conclusions: The present study focused on the importance of the choice of appropriate indices of repeatability and reproducibility, demonstrating the repeatability of AAR in both healthy children and ones with rhinitis.
2020
Cilluffo G, Z.A. (2020). Assessing Repeatability and Reproducibility of Anterior Active Rhinomanometry (AAR) in Children. BMC MEDICAL RESEARCH METHODOLOGY, 20(1) [10.1186/s12874-020-00969-1].
File in questo prodotto:
File Dimensione Formato  
Cilluffo_BMC Medical Research Methodology 2020.pdf

accesso aperto

Tipologia: Versione Editoriale
Dimensione 897.25 kB
Formato Adobe PDF
897.25 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10447/410563
Citazioni
  • ???jsp.display-item.citation.pmc??? 4
  • Scopus 19
  • ???jsp.display-item.citation.isi??? 15
social impact