Comment by Stefan Buijsman

We should avoid applications of AI that largely replace decision-making (relegating humans to the position of checking outputs). We can, however, use AI in other roles even for high-risk decision making while conforming to all of the requirements set...

The explanations of AI systems that we can currently offer typically fall short of the stated goals (including mine for appropriate reliance and system improvement), so it seems that if we truly have a strong requirement that systems are explainable ...