Does the model need to be explainable for the users or affected persons?
This page is a fallback for search engines and cases when javascript fails or is disabled.
Please view this card in the library, where you can also find the rest of the plot4ai cards.
Does the model need to be explainable for the users or affected persons?
Do you need to be able to give a clear explanation to the user about the logic that the AI system used to reach a certain decision? And can that decision have a big impact on the user?
If you answered Yes then you are at risk
If you are not sure, then you might be at risk too
Recommendations
- Evaluate the type of models that you could use to solve the problem as specified in your task.
- Consider what the impact is if certain black box models cannot be used and interpretability tools do not offer sufficient results. You might need to evaluate a possible change in strategy.
- Data scientists can evaluate the impact from a technical perspective and discuss this with the rest of stakeholders. The decision keeps being a team effort.