TY - JOUR
T1 - TRUST XAI
T2 - Model-Agnostic Explanations for AI With a Case Study on IIoT Security
AU - Zolanvari, Maede
AU - Yang, Zebo
AU - Khan, Khaled
AU - Jain, Raj
AU - Meskin, Nader
N1 - Publisher Copyright:
© 2014 IEEE.
PY - 2023/2/15
Y1 - 2023/2/15
N2 - Despite artificial intelligence (AI)'s significant growth, its 'black box' nature creates challenges in generating adequate trust. Thus, it is seldom utilized as a standalone unit in IoT high-risk applications, such as critical industrial infrastructures, medical systems, financial applications, etc. Explainable AI (XAI) has emerged to help with this problem. However, designing appropriately fast and accurate XAI is still challenging, especially in numerical applications. Here, we propose a universal XAI model, named the transparency relying upon statistical theory (TRUST), which is model-agnostic, high performing, and suitable for numerical applications. Simply put, TRUST XAI models the statistical behavior of the AI's outputs in an AI-based system. Factor analysis is used to transform the input features into a new set of latent variables. We use mutual information (MI) to rank these variables and pick only the most influential ones on the AI's outputs and call them 'representatives' of the classes. Then, we use multimodal Gaussian (MMG) distributions to determine the likelihood of any new sample belonging to each class. We demonstrate the effectiveness of TRUST in a case study on cybersecurity of the Industrial Internet of Things (IIoT) using three different cybersecurity data sets. As IIoT is a prominent application that deals with numerical data. The results show that TRUST XAI provides explanations for new random samples with an average success rate of 98%. Compared with local interpretable model-agnostic explanations (LIME), a popular XAI model, TRUST is shown to be superior in the context of performance, speed, and the method of explainability. In the end, we also show how TRUST is explained to the user.
AB - Despite artificial intelligence (AI)'s significant growth, its 'black box' nature creates challenges in generating adequate trust. Thus, it is seldom utilized as a standalone unit in IoT high-risk applications, such as critical industrial infrastructures, medical systems, financial applications, etc. Explainable AI (XAI) has emerged to help with this problem. However, designing appropriately fast and accurate XAI is still challenging, especially in numerical applications. Here, we propose a universal XAI model, named the transparency relying upon statistical theory (TRUST), which is model-agnostic, high performing, and suitable for numerical applications. Simply put, TRUST XAI models the statistical behavior of the AI's outputs in an AI-based system. Factor analysis is used to transform the input features into a new set of latent variables. We use mutual information (MI) to rank these variables and pick only the most influential ones on the AI's outputs and call them 'representatives' of the classes. Then, we use multimodal Gaussian (MMG) distributions to determine the likelihood of any new sample belonging to each class. We demonstrate the effectiveness of TRUST in a case study on cybersecurity of the Industrial Internet of Things (IIoT) using three different cybersecurity data sets. As IIoT is a prominent application that deals with numerical data. The results show that TRUST XAI provides explanations for new random samples with an average success rate of 98%. Compared with local interpretable model-agnostic explanations (LIME), a popular XAI model, TRUST is shown to be superior in the context of performance, speed, and the method of explainability. In the end, we also show how TRUST is explained to the user.
KW - Artificial intelligence (AI)
KW - Industrial Internet of Things (IIoT)
KW - cybersecurity
KW - explainable AI (XAI)
KW - machine learning (ML)
KW - statistical modeling
KW - trustworthy AI
UR - https://www.scopus.com/pages/publications/85124068081
U2 - 10.1109/JIOT.2021.3122019
DO - 10.1109/JIOT.2021.3122019
M3 - Article
AN - SCOPUS:85124068081
SN - 2327-4662
VL - 10
SP - 2967
EP - 2978
JO - IEEE Internet of Things Journal
JF - IEEE Internet of Things Journal
IS - 4
ER -