Measuring Interpretability: A Systematic Literature Review of Interpretability Measures in Artificial Intelligence

Advancement in any field requires approaches for measurement. Failure to build such approaches inhibits improvements within the field. In the context of interpretability in Artificial Intelligence (AI), a lack of widely adopted evaluation and measurement approaches prevents its advance. While some approaches in literature propose ways to measure interpretability, no consensus exists on objective measurement of interpretability. To advance the state-of-the-art, a clear understanding of these approaches is essential. This paper conducts a systematic review of existing approaches that propose to measure or quantify interpretability and its aspects. The resulting analysis of this review identifies important aspects to consider when measuring interpretability. We found that no approaches directly propose to measure interpretability but instead quantify aspects associated with interpretability. We identify the relevant aspects in result of this review.