Hierarchical fuzzy model-agnostic explanation: framework, algorithms and interface for XAI

Artificial intelligence (AI) has made remarkable achievements in extensive fields while its black box nature limited applications in many critical areas. Against this drawback, explainable AI (XAI), has emerged as a focal point of current research. Recently, fuzzy logic systems (FLSs) attract increasing attention in XAI because of their linguistic representation, which can be naturally understood by humans. However, the focus of these works is limited by simply relying on inherent rule-based structures for explanation. Motivated by further exploring the potential of FLS to overcome the challenges of XAI in terms of comprehensibility, scalability and transferability, in this work we propose Fuzzy Model-Agnostic Explanation (FMAE) as a post-hoc paradigm to explain the behavior of black box models. The innovations and contributions of this work provide a unified framework offering four levels of explanation, develop the associated algorithms to present the hidden knowledge behind the black box model in human-understandable form at different levels of granularity and create the interface to deliver explanations to users. First, we introduce the hierarchical FMAE framework to formulate explanations into four levels including sample, local, domain and universe. Second, the learning and explaining algorithms are developed to systematically construct FLS to model the behavior of black box models in the four levels where downscaling is performed by simplification to facilitate explanations with concise rules and upscaling is performed by aggregation to integrate explanations at a higher level. Third, the proposed explanation interface unifies two typical forms of expression in XAI by fuzzy rules: the semantic inference explanation revealing the decision mechanism of the black box model and the feature salience explanation reflecting the attribution and interaction of input features. Simulated user experiments are designed on the comprehensive explanatory metrics. Compared with mainstream methods, the result shows ...