Skip to main content
Engineering, Data / ML

Model Excellence Scores: A Framework for Enhancing the Quality of Machine Learning Systems at Scale

March 21 / Global
Featured image for Model Excellence Scores: A Framework for Enhancing the Quality of Machine Learning Systems at Scale
Image
Figure 1: Example ML quality dimensions (in yellow) in a typical ML system.
Image
Figure 2: Relationship among agreement, indicator, objective, use cases, and models.
Image
Figure 3: High-level view of the interaction between the MES framework and various ML systems.
Min Cai

Min Cai

Min Cai is a Distinguished Engineer at Uber working on the AI/ML platform, Michelangelo. He received his Ph.D. degree in Computer Science from Univ. of Southern California. He has published over 20 journal and conference papers and holds 6 US patents.

Joseph Wang

Joseph Wang

Joseph Wang serves as a Principal Software Engineer on the AI Platform team at Uber, based in San Francisco. His notable achievements encompass designing the Feature Store, expanding the capacity of the real-time prediction service, developing a robust model platform, and improving the performance of key models. Presently, Wang is focusing his expertise on advancing the domain of generative AI.

Anupriya Mouleesha

Anupriya Mouleesha

Anupriya has been a thought partner and executor for multiple engineering initiatives within Uber spanning software networking, Data, ML platform, UberAI and product development. She currently leads Technical Program Management for Uber's Mobility and Product Platforms.

Sally Mihyoung Lee

Sally Mihyoung Lee

Sally is a Senior Staff Tech Lead Manager who leads ML Quality and ML Ops for the Uber AI/ML platform, Michelangelo. With over 15 years of experience, she is passionate about applying machine learning solutions to large scale business problems.

Posted by Min Cai, Joseph Wang, Anupriya Mouleesha, Sally Mihyoung Lee