In case of system failure, could users be adversely impacted?
This page is a fallback for search engines and cases when javascript fails or is disabled.
Please view this card in the library, where you can also find the rest of the plot4ai cards.
In case of system failure, could users be adversely impacted?
- Do you have a mechanism implemented to stop the processing in case of harm?
- Do you have a way to identify and contact affected individuals and mitigate the adverse impacts?
- Imagine a scenario where your AI system, a care-robot, is taking care of an individual (the patient) by performing some specific tasks and that this individual depends on this care.
If you answered Yes then you are at risk
If you are not sure, then you might be at risk too
Recommendations
- Implement some kind of stop button or procedure to safely abort an operation when needed.
- Establish a detection and response mechanism for undesirable adverse effects on individuals.
- Define criticality levels of the possible consequences of faults/misuse of the AI system: what type of harm could be caused to the individuals, environment or organisations?