Can we provide the necessary information to the users about possible impacts, benefits and potential risks?

This page is a fallback for search engines and cases when javascript fails or is disabled.
Please view this card in the library, where you can also find the rest of the plot4ai cards.

Unawareness CategoryAccessibility Category
Design PhaseModel PhaseOutput Phase
Can we provide the necessary information to the users about possible impacts, benefits and potential risks?
  • Did you establish mechanisms to inform users about the purpose, criteria and limitations of decisions generated by the AI system?
  • If an AI-assisted decision has been made about a person without any type of explanation or information then this may limit that person's autonomy, scope and self-determination. This is unlikely to be fair.

If you answered No then you are at risk

If you are not sure, then you might be at risk too

Recommendations

  • Provide clear information about how and why an AI-assisted decision was made and which personal data was used to train and test the model.
  • The model you choose should be at the right level of interpretability for your use case and for the impact it will have on the decision recipient. If you use a black box model make sure the supplementary explanation techniques you use provide a reliable and accurate representation of the systems behaviour. Source: UK ICO
  • Communicate the benefits, the technical limitations and potential risks of the AI system to users, such as its level of accuracy and/or error rates.
  • Ask your users (with a survey for instance) if they understand the decisions that your product makes.