Automatic Generation of Explainability Requirements and Software Explanations From User Reviews

verfasst von

Martin Obaidi, Jakob Droste, Hannah Deters, Marc Herrmann, Kurt Schneider, Jil Klünder, Hugo Villamizar, Jannik Fischbach, Steffen Krätzig

Abstract

Explainability has become a crucial non-functional requirement to enhance transparency, build user trust, and ensure regulatory compliance. However, translating explanation needs expressed in user feedback into structured requirements and corresponding explanations remains challenging. While existing methods can identify explanation-related concerns in user reviews, there is no established approach for systematically deriving requirements and generating aligned explanations. To contribute toward addressing this gap, we introduce a tool-supported approach that automates this process. To evaluate its effectiveness, we collaborated with an industrial automation manufacturer to create a dataset of 58 user reviews, each annotated with manually crafted explainability requirements and explanations. Our evaluation shows that while AI-generated requirements often lack relevance and correctness compared to human-created ones, the AI-generated explanations are frequently preferred for their clarity and style. Nonetheless, correctness remains an issue, highlighting the importance of human validation. This work contributes to the advancement of explainability requirements in software systems by (1) introducing an automated approach to derive requirements from user reviews and generate corresponding explanations, (2) providing empirical insights into the strengths and limitations of automatically generated artifacts, and (3) releasing a curated dataset to support future research on the automatic generation of explainability requirements.

Organisationseinheit(en)

Fachgebiet Software Engineering

Externe Organisation(en)

Fachhochschule für die Wirtschaft (FHDW) Hannover
Fortiss GmbH
Phoenix Contact GmbH and Co. KG

Typ

Aufsatz in Konferenzband

Seiten

49-58

Anzahl der Seiten

10

Publikationsdatum

01.09.2025

Publikationsstatus

Veröffentlicht

Peer-reviewed

Ja

ASJC Scopus Sachgebiete

Artificial intelligence, Software, Sicherheit, Risiko, Zuverlässigkeit und Qualität, Modellierung und Simulation

Elektronische Version(en)

https://doi.org/10.1109/REW66121.2025.00011 (Zugang: Geschlossen)
http://10.48550/arXiv.2507.07344 (Zugang: Offen)