Can our AI system scale in performance from data input to data output?
This page is a fallback for search engines and cases when javascript fails or is disabled.
Please view this card in the library, where you can also find the rest of the plot4ai cards.
Can our AI system scale in performance from data input to data output?
Can your algorithm scale in performance from the data it learned on to real data? In online situations the rate at which data comes into the model may not align with the rate of anticipated data arrival. This can lead to both outright ML system failure and to a system that “chases" its own tail. Source: BerryVilleiML
If you answered No then you are at risk
If you are not sure, then you might be at risk too
Recommendations
- Find out what the rate would be of expected data arrival to your model and perform tests in a similar environment with similar amount of data input.
- Implement measures to make your model scalable.