TY - JOUR
T1 - Consensus-based attributes for identifying patients with spasmodic dysphonia and other voice disorders
AU - Ludlow, Christy L.
AU - Domangue, Rickie
AU - Sharma, Dinesh
AU - Jinnah, H. A.
AU - Perlmutter, Joel S.
AU - Berke, Gerald
AU - Sapienza, Christine
AU - Smith, Marshall E.
AU - Blumin, Joel H.
AU - Kalata, Carrie E.
AU - Blindauer, Karen
AU - Johns, Michael
AU - Hapner, Edie
AU - Harmon, Archie
AU - Paniello, Randal
AU - Adler, Charles H.
AU - Crujido, Lisa
AU - Lott, David G.
AU - Bansberg, Stephen F.
AU - Barone, Nicholas
AU - Drulia, Teresa
AU - Stebbins, Glenn
N1 - Publisher Copyright:
© 2018 American Medical Association. All rights reserved.
PY - 2018/8
Y1 - 2018/8
N2 - IMPORTANCE A roadblock for research on adductor spasmodic dysphonia (ADSD), abductor SD (ABSD), voice tremor (VT), and muscular tension dysphonia (MTD) is the lack of criteria for selecting patients with these disorders. OBJECTIVE To determine the agreement among experts not using standard guidelines to classify patients with ABSD, ADSD, VT, and MTD, and develop expert consensus attributes for classifying patients for research. DESIGN, SETTING AND PARTICIPANTS From 2011 to 2016, a multicenter observational study examined agreement among blinded experts when classifying patients with ADSD, ABSD, VT or MTD (first study). Subsequently, a 4-stage Delphi method study used reiterative stages of review by an expert panel and 46 community experts to develop consensus on attributes to be used for classifying patients with the 4 disorders (second study). The study used a convenience sample of 178 patients clinically diagnosed with ADSD, ABSD, VT MTD, vocal fold paresis/paralysis, psychogenic voice disorders, or hypophonia secondary to Parkinson disease. Participants were aged 18 years or older, without laryngeal structural disease or surgery for ADSD and underwent speech and nasolaryngoscopy video recordings following a standard protocol. EXPOSURES Speech and nasolaryngoscopy video recordings following a standard protocol. MAIN OUTCOMES AND MEASURES Specialists at 4 sites classified 178 patients into 11 categories. Four international experts independently classified 75 patients using the same categories without guidelines after viewing speech and nasolaryngoscopy video recordings. Each member from the 4 sites also classified 50 patients from other sites after viewing video clips of voice/laryngeal tasks. Interrater κ less than 0.40 indicated poor classification agreement among rater pairs and across recruiting sites. Consequently, a Delphi panel of 13 experts identified and ranked speech and laryngeal movement attributes for classifying ADSD, ABSD, VT, and MTD, which were reviewed by 46 community specialists. Based on the median attribute rankings, a final attribute list was created for each disorder. RESULTS When classifying patients without guidelines, raters differed in their classification distributions (likelihood ratio, χ2 = 107.66), had poor interrater agreement, and poor agreement with site categories. For 11 categories, the highest agreement was 34%, with no κ values greater than 0.26. In external rater pairs, the highest κ was 0.23 and the highest agreement was 38.5%. Using 6 categories, the highest percent agreement was 73.3%and the highest κ was 0.40. The Delphi method yielded 18 attributes for classifying disorders from speech and nasolaryngoscopic examinations. CONCLUSIONS AND RELEVANCE Specialists without guidelines had poor agreement when classifying patients for research, leading to a Delphi-based development of the Spasmodic Dysphonia Attributes Inventory for classifying patients with ADSD, ABSD, VT, and MTD for research.
AB - IMPORTANCE A roadblock for research on adductor spasmodic dysphonia (ADSD), abductor SD (ABSD), voice tremor (VT), and muscular tension dysphonia (MTD) is the lack of criteria for selecting patients with these disorders. OBJECTIVE To determine the agreement among experts not using standard guidelines to classify patients with ABSD, ADSD, VT, and MTD, and develop expert consensus attributes for classifying patients for research. DESIGN, SETTING AND PARTICIPANTS From 2011 to 2016, a multicenter observational study examined agreement among blinded experts when classifying patients with ADSD, ABSD, VT or MTD (first study). Subsequently, a 4-stage Delphi method study used reiterative stages of review by an expert panel and 46 community experts to develop consensus on attributes to be used for classifying patients with the 4 disorders (second study). The study used a convenience sample of 178 patients clinically diagnosed with ADSD, ABSD, VT MTD, vocal fold paresis/paralysis, psychogenic voice disorders, or hypophonia secondary to Parkinson disease. Participants were aged 18 years or older, without laryngeal structural disease or surgery for ADSD and underwent speech and nasolaryngoscopy video recordings following a standard protocol. EXPOSURES Speech and nasolaryngoscopy video recordings following a standard protocol. MAIN OUTCOMES AND MEASURES Specialists at 4 sites classified 178 patients into 11 categories. Four international experts independently classified 75 patients using the same categories without guidelines after viewing speech and nasolaryngoscopy video recordings. Each member from the 4 sites also classified 50 patients from other sites after viewing video clips of voice/laryngeal tasks. Interrater κ less than 0.40 indicated poor classification agreement among rater pairs and across recruiting sites. Consequently, a Delphi panel of 13 experts identified and ranked speech and laryngeal movement attributes for classifying ADSD, ABSD, VT, and MTD, which were reviewed by 46 community specialists. Based on the median attribute rankings, a final attribute list was created for each disorder. RESULTS When classifying patients without guidelines, raters differed in their classification distributions (likelihood ratio, χ2 = 107.66), had poor interrater agreement, and poor agreement with site categories. For 11 categories, the highest agreement was 34%, with no κ values greater than 0.26. In external rater pairs, the highest κ was 0.23 and the highest agreement was 38.5%. Using 6 categories, the highest percent agreement was 73.3%and the highest κ was 0.40. The Delphi method yielded 18 attributes for classifying disorders from speech and nasolaryngoscopic examinations. CONCLUSIONS AND RELEVANCE Specialists without guidelines had poor agreement when classifying patients for research, leading to a Delphi-based development of the Spasmodic Dysphonia Attributes Inventory for classifying patients with ADSD, ABSD, VT, and MTD for research.
UR - http://www.scopus.com/inward/record.url?scp=85051953234&partnerID=8YFLogxK
U2 - 10.1001/jamaoto.2018.0644
DO - 10.1001/jamaoto.2018.0644
M3 - Article
C2 - 29931028
AN - SCOPUS:85051953234
SN - 2168-6181
VL - 144
SP - 657
EP - 665
JO - JAMA Otolaryngology - Head and Neck Surgery
JF - JAMA Otolaryngology - Head and Neck Surgery
IS - 8
ER -