TY - JOUR
T1 - Validation and utility of ARDS subphenotypes identified by machine-learning models using clinical data
T2 - an observational, multicohort, retrospective analysis
AU - LUNG SAFE Investigators and the ESICM Trials Group
AU - Maddali, Manoj V.
AU - Churpek, Matthew
AU - Pham, Tai
AU - Rezoagli, Emanuele
AU - Zhuo, Hanjing
AU - Zhao, Wendi
AU - He, June
AU - Delucchi, Kevin L.
AU - Wang, Chunxue
AU - Wickersham, Nancy
AU - McNeil, J. Brennan
AU - Jauregui, Alejandra
AU - Ke, Serena
AU - Vessel, Kathryn
AU - Gomez, Antonio
AU - Hendrickson, Carolyn M.
AU - Kangelaris, Kirsten N.
AU - Sarma, Aartik
AU - Leligdowicz, Aleksandra
AU - Liu, Kathleen D.
AU - Matthay, Michael A.
AU - Ware, Lorraine B.
AU - Laffey, John G.
AU - Bellani, Giacomo
AU - Calfee, Carolyn S.
AU - Sinha, Pratik
AU - Rios, Fernando
AU - Van Haren, Frank
AU - Sottiaux, T.
AU - Lora, Fredy S.
AU - Azevedo, Luciano C.
AU - Depuydt, P.
AU - Fan, Eddy
AU - Bugedo, Guillermo
AU - Qiu, Haibo
AU - Gonzalez, Marcos
AU - Silesky, Juan
AU - Cerny, Vladimir
AU - Nielsen, Jonas
AU - Jibaja, Manuel
AU - Pham, Tài
AU - Wrigge, Hermann
AU - Matamis, Dimitrios
AU - Ranero, Jorge Luis
AU - Hashemian, S. M.
AU - Amin, Pravin
AU - Clarkson, Kevin
AU - Kurahashi, Kiyoyasu
AU - Villagomez, Asisclo J.
AU - Zeggwagh, Amine Ali
AU - Heunks, Leo M.
AU - Laake, Jon Henrik
AU - Palo, Jose Emmanuel
AU - do Vale Fernandes, Antero
AU - Sandesc, Dorel
AU - Arabi, Yaasen
AU - Bumbasierevic, Vesna
AU - Nin, Nicolas
AU - Lorente, Jose A.
AU - Larsson, Anders
AU - Piquilloud, Lise
AU - Abroug, Fekri
AU - McAuley, Daniel F.
AU - McNamee, Lia
AU - Hurtado, Javier
AU - Bajwa, Ed
AU - Démpaire, Gabriel
AU - Francois, Guy M.
AU - Sula, Hektor
AU - Nunci, Lordian
AU - Cani, Alma
AU - Zazu, Alan
AU - Dellera, Christian
AU - Insaurralde, Carolina S.
AU - Alejandro, Risso V.
AU - Daldin, Julio
AU - Vinzio, Mauricio
AU - Fernandez, Ruben O.
AU - Cardonnet, Luis P.
AU - Bettini, Lisandro R.
AU - Bisso, Mariano Carboni
AU - Osman, Emilio M.
AU - Setten, Mariano G.
AU - Lovazzano, Pablo
AU - Alvarez, Javier
AU - Villar, Veronica
AU - Milstein, Cesar
AU - Pozo, Norberto C.
AU - Grubissich, Nicolas
AU - Plotnikow, Gustavo A.
AU - Vasquez, Daniela N.
AU - Ilutovich, Santiago
AU - Tiribelli, Norberto
AU - Chena, Ariel
AU - Pellegrini, Carlos A.
AU - Saenz, María G.
AU - Estenssoro, Elisa
AU - Brizuela, Matias
AU - Gianinetto, Hernan
AU - Gomez, Pablo E.
AU - Cerrato, Valeria I.
AU - Bezzi, Marco G.
AU - Borello, Silvina A.
AU - Loiacono, Flavia A.
AU - Fernandez, Adriana M.
AU - Knowles, Serena
AU - Reynolds, Claire
AU - Inskip, Deborah M.
AU - Miller, Jennene J.
AU - Kong, Jing
AU - Whitehead, Christina
AU - Bihari, Shailesh
AU - Seven, Aylin
AU - Krstevski, Amanda
AU - Rodgers, Helen J.
AU - Millar, Rebecca T.
AU - Mckenna, Toni E.
AU - Bailey, Irene M.
AU - Hanlon, Gabrielle C.
AU - Aneman, Anders
AU - Lynch, Joan M.
AU - Azad, Raman
AU - Neal, John
AU - Woods, Paul W.
AU - Roberts, Brigit L.
AU - Kol, Mark R.
AU - Wong, Helen S.
AU - Riss, Katharina C.
AU - Staudinger, Thomas
AU - Wittebole, Xavier
AU - Berghe, Caroline
AU - Bulpa, Pierre A.
AU - Dive, Alain M.
AU - Verstraete, Rik
AU - Lebbinck, Herve
AU - Depuydt, Pieter
AU - Vermassen, Joris
AU - Meersseman, Philippe
AU - Ceunen, Helga
AU - Rosa, Jonas I.
AU - Beraldo, Daniel O.
AU - Piras, Claudio
AU - Ampinelli, Adenilton M.R.
AU - Nassar, Antonio P.
AU - Mataloun, Sergio
AU - Moock, Marcelo
AU - Thompson, Marlus M.
AU - Gonçalves, Claudio H.
AU - Antônio, Ana Carolina P.
AU - Ascoli, Aline
AU - Biondi, Rodrigo S.
AU - Fontenele, Danielle C.
AU - Nobrega, Danielle
AU - Sales, Vanessa M.
AU - Shindhe, Suresh
AU - Ismail, Dk Maizatul Aiman B.Pg Hj
AU - Beloncle, Francois
AU - Davies, Kyle G.
AU - Cirone, Rob
AU - Manoharan, Venika
AU - Ismail, Mehvish
AU - Goligher, Ewan C.
AU - Jassal, Mandeep
AU - Nishikawa, Erin
AU - Javeed, Areej
AU - Curley, Gerard
AU - Rittayamai, Nuttapol
AU - Parotto, Matteo
AU - Ferguson, Niall D.
AU - Mehta, Sangeeta
AU - Knoll, Jenny
AU - Pronovost, Antoine
AU - Canestrini, Sergio
AU - Bruhn, Alejandro R.
AU - Garcia, Patricio H.
AU - Aliaga, Felipe A.
AU - Farías, Pamela A.
AU - Yumha, Jacob S.
AU - Ortiz, Claudia A.
AU - Salas, Javier E.
AU - Saez, Alejandro A.
AU - Vega, Luis D.
AU - Labarca, Eduardo F.
AU - Martinez, Felipe T.
AU - Carreño, Nicolás G.
AU - Lora, Pilar
AU - Liu, Haitao
AU - Liu, Ling
AU - Tang, Rui
AU - Luo, Xiaoming
AU - An, Youzhong
AU - Zhao, Huiying
AU - Gao, Yan
AU - Zhai, Zhe
AU - Ye, Zheng L.
AU - Wang, Wei
AU - Li, Wenwen
AU - Li, Qingdong
AU - Zheng, Ruiqiang
AU - Yu, Wenkui
N1 - Publisher Copyright:
© 2022 Elsevier Ltd
PY - 2022/4
Y1 - 2022/4
N2 - Background: Two acute respiratory distress syndrome (ARDS) subphenotypes (hyperinflammatory and hypoinflammatory) with distinct clinical and biological features and differential treatment responses have been identified using latent class analysis (LCA) in seven individual cohorts. To facilitate bedside identification of subphenotypes, clinical classifier models using readily available clinical variables have been described in four randomised controlled trials. We aimed to assess the performance of these models in observational cohorts of ARDS. Methods: In this observational, multicohort, retrospective study, we validated two machine-learning clinical classifier models for assigning ARDS subphenotypes in two observational cohorts of patients with ARDS: Early Assessment of Renal and Lung Injury (EARLI; n=335) and Validating Acute Lung Injury Markers for Diagnosis (VALID; n=452), with LCA-derived subphenotypes as the gold standard. The primary model comprised only vital signs and laboratory variables, and the secondary model comprised all predictors in the primary model, with the addition of ventilatory variables and demographics. Model performance was assessed by calculating the area under the receiver operating characteristic curve (AUC) and calibration plots, and assigning subphenotypes using a probability cutoff value of 0·5 to determine sensitivity, specificity, and accuracy of the assignments. We also assessed the performance of the primary model in EARLI using data automatically extracted from an electronic health record (EHR; EHR-derived EARLI cohort). In Large Observational Study to Understand the Global Impact of Severe Acute Respiratory Failure (LUNG SAFE; n=2813), a multinational, observational ARDS cohort, we applied a custom classifier model (with fewer variables than the primary model) to determine the prognostic value of the subphenotypes and tested their interaction with the positive end-expiratory pressure (PEEP) strategy, with 90-day mortality as the dependent variable. Findings: The primary clinical classifier model had an area under receiver operating characteristic curve (AUC) of 0·92 (95% CI 0·90–0·95) in EARLI and 0·88 (0·84–0·91) in VALID. Performance of the primary model was similar when using exclusively EHR-derived predictors compared with manually curated predictors (AUC=0·88 [95% CI 0·81–0·94] vs 0·92 [0·88–0·97]). In LUNG SAFE, 90-day mortality was higher in patients assigned the hyperinflammatory subphenotype than in those with the hypoinflammatory phenotype (414 [57%] of 725 vs 694 [33%] of 2088; p<0·0001). There was a significant treatment interaction with PEEP strategy and ARDS subphenotype (p=0·041), with lower 90-day mortality in the high PEEP group of patients with the hyperinflammatory subphenotype (hyperinflammatory subphenotype: 169 [54%] of 313 patients in the high PEEP group vs 127 [62%] of 205 patients in the low PEEP group; hypoinflammatory subphenotype: 231 [34%] of 675 patients in the high PEEP group vs 233 [32%] of 734 patients in the low PEEP group). Interpretation: Classifier models using clinical variables alone can accurately assign ARDS subphenotypes in observational cohorts. Application of these models can provide valuable prognostic information and could inform management strategies for personalised treatment, including application of PEEP, once prospectively validated. Funding: US National Institutes of Health and European Society of Intensive Care Medicine.
AB - Background: Two acute respiratory distress syndrome (ARDS) subphenotypes (hyperinflammatory and hypoinflammatory) with distinct clinical and biological features and differential treatment responses have been identified using latent class analysis (LCA) in seven individual cohorts. To facilitate bedside identification of subphenotypes, clinical classifier models using readily available clinical variables have been described in four randomised controlled trials. We aimed to assess the performance of these models in observational cohorts of ARDS. Methods: In this observational, multicohort, retrospective study, we validated two machine-learning clinical classifier models for assigning ARDS subphenotypes in two observational cohorts of patients with ARDS: Early Assessment of Renal and Lung Injury (EARLI; n=335) and Validating Acute Lung Injury Markers for Diagnosis (VALID; n=452), with LCA-derived subphenotypes as the gold standard. The primary model comprised only vital signs and laboratory variables, and the secondary model comprised all predictors in the primary model, with the addition of ventilatory variables and demographics. Model performance was assessed by calculating the area under the receiver operating characteristic curve (AUC) and calibration plots, and assigning subphenotypes using a probability cutoff value of 0·5 to determine sensitivity, specificity, and accuracy of the assignments. We also assessed the performance of the primary model in EARLI using data automatically extracted from an electronic health record (EHR; EHR-derived EARLI cohort). In Large Observational Study to Understand the Global Impact of Severe Acute Respiratory Failure (LUNG SAFE; n=2813), a multinational, observational ARDS cohort, we applied a custom classifier model (with fewer variables than the primary model) to determine the prognostic value of the subphenotypes and tested their interaction with the positive end-expiratory pressure (PEEP) strategy, with 90-day mortality as the dependent variable. Findings: The primary clinical classifier model had an area under receiver operating characteristic curve (AUC) of 0·92 (95% CI 0·90–0·95) in EARLI and 0·88 (0·84–0·91) in VALID. Performance of the primary model was similar when using exclusively EHR-derived predictors compared with manually curated predictors (AUC=0·88 [95% CI 0·81–0·94] vs 0·92 [0·88–0·97]). In LUNG SAFE, 90-day mortality was higher in patients assigned the hyperinflammatory subphenotype than in those with the hypoinflammatory phenotype (414 [57%] of 725 vs 694 [33%] of 2088; p<0·0001). There was a significant treatment interaction with PEEP strategy and ARDS subphenotype (p=0·041), with lower 90-day mortality in the high PEEP group of patients with the hyperinflammatory subphenotype (hyperinflammatory subphenotype: 169 [54%] of 313 patients in the high PEEP group vs 127 [62%] of 205 patients in the low PEEP group; hypoinflammatory subphenotype: 231 [34%] of 675 patients in the high PEEP group vs 233 [32%] of 734 patients in the low PEEP group). Interpretation: Classifier models using clinical variables alone can accurately assign ARDS subphenotypes in observational cohorts. Application of these models can provide valuable prognostic information and could inform management strategies for personalised treatment, including application of PEEP, once prospectively validated. Funding: US National Institutes of Health and European Society of Intensive Care Medicine.
UR - https://www.scopus.com/pages/publications/85124466107
U2 - 10.1016/S2213-2600(21)00461-6
DO - 10.1016/S2213-2600(21)00461-6
M3 - Article
C2 - 35026177
AN - SCOPUS:85124466107
SN - 2213-2600
VL - 10
SP - 367
EP - 377
JO - The Lancet Respiratory Medicine
JF - The Lancet Respiratory Medicine
IS - 4
ER -