Could the AI system incorrectly attribute actions to individuals or groups?

This page is a fallback for search engines and cases when javascript fails or is disabled.
Please view this card in the library, where you can also find the rest of the plot4ai cards.

Bias, Fairness & Discrimination Category
Design PhaseInput PhaseModel PhaseOutput PhaseMonitor Phase
Could the AI system incorrectly attribute actions to individuals or groups?

Your AI system could adversely affect individuals by incorrectly attributing actions or facts to them. For example, a facial recognition system may misidentify someone, or a flawed risk prediction model could negatively impact a person’s opportunities or reputation.

If you answered Yes then you are at risk

If you are not sure, then you might be at risk too

Recommendations

  • Evaluate the possible consequences of inaccuracies in your AI system and implement measures to prevent these errors from happening: avoiding bias and discrimination during the life cycle of the model, ensuring the quality of the input data, implementing a strict human oversight process, ways to double check the results with extra evidence, implementing safety and redress mechanisms, etc.
  • Assess the impact on the different human rights of the individual.
  • Consider not implementing such a system if the risks cannot be effectively mitigated.

Interesting resources/references