Could our AI system reinforce systemic inequalities?

This page is a fallback for search engines and cases when javascript fails or is disabled.
Please view this card in the library, where you can also find the rest of the plot4ai cards.

Bias, Fairness & Discrimination Category
Design PhaseInput PhaseModel PhaseOutput PhaseMonitor Phase
Could our AI system reinforce systemic inequalities?

Institutional biases, like racism or sexism, are often rooted in organizational structures and policies. Could such biases, intentionally or unintentionally, be embedded or influence the design or the functioning of the system?

If you answered Yes then you are at risk

If you are not sure, then you might be at risk too

Recommendations

  • Identify the stakeholders to involve in each phase of the AI lifecycle. Involving diverse stakeholders with different perspectives and experiences helps address blind spots and reduce bias.
  • Identify and define the demographic groups affected by the AI system. Considering their needs and concerns can help minimize institutional bias and create fairer outcomes.