Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

BACKGROUND: The ongoing global outbreak of mpox, caused by clade IIb mpox virus, poses significant challenges in accurately categorising and assessing the diversity of lesions. With lesion resolution being a key endpoint in clinical trials and observational studies, it is essential to evaluate the inter-rater reliability and agreement of clade IIb mpox lesion assessment among clinicians. METHODS: Clinicians experienced in clade IIb mpox disease were surveyed online with 20 lesion images. They categorized lesions into active, crusted, resolved, or unclassifiable groups. Reliability was assessed with Fleiss' kappa and agreement with proportion of exact agreement. RESULTS: Fifty-three clinicians completed the survey, with a median self-reported confidence rating of 7 (on a scale of 1 to 10) in assessing mpox lesions. The inter-rater reliability was found to be moderate, with a Fleiss' kappa coefficient of 0.417 (p < 0.05, 95% CI: 0.409 - 0.425). The inter-rater agreement was 61%. CONCLUSIONS: This study demonstrates moderate inter-rater reliability and agreement in clade IIb mpox lesion assessment among clinicians. The findings emphasise the importance of standardising lesion classification systems to facilitate clinical care (e.g decision to start treatment) and public health (e.g. isolation) decisions and a need to explore alternative endpoints for clinical trials.

Original publication

DOI

10.1016/j.ijid.2023.10.004

Type

Journal article

Journal

Int J Infect Dis

Publication Date

15/10/2023

Keywords

agreement, lesion assessment, mpox, reliability