TWIMLcon 2022 Logo


Treating Model Quality as a Reliability Problem

October 4, 2022
10:00 am - 
10:30 am

Model quality and performance is typically thought of as a problem within scope for model developers more than ML production engineers. But changes in model quality represent the only truly end-to-end test of ML infrastructure, reliably identifying subtle problems in feature storage, metadata, model configuration, training, and serving. ML production engineers generally avoid directly measuring or responding to changes in model quality as an operational or reliability concern, but that needs to change. This will be a technical and cultural transformation.

Session Speakers

Senior Director, ML SRE