Skip to main content
Engineering, Data / ML

Genie: Uber’s Gen AI On-Call Copilot

10 October / Global
Featured image for Genie: Uber’s Gen AI On-Call Copilot
Image
Figure 1: The high number of questions asked across Slack channels at Uber over 5 months.
Image
Figure 2: The slow process of waiting for an on-call engineer to answer a question.
Image
Figure 3: Architecture of the on-call copilot. 
Image
Figure 4: Spark application for data ingest. 
Image
Figure 5: Columns of the Spark dataframe from the Engwiki datasource. 
Image
Figure 6: Columns of the Spark dataframe with vector embeddings.
Image
Figure 7: Flow of vectors getting pushed to Terrablob. 
Image
Figure 8: Flow of the back-end Knowledge Service. 
Image
Figure 9: Flow of Genie cost tracking. 
Image
Figure 10: Flow of user feedback for Genie. 
Image
Figure 11: Performance evaluation process. 
Image
Figure 12: Workflow of the document evaluation app. 
Image
Figure 13: Flow of how Genie responds to user questions. 
Paarth Chothani

Paarth Chothani

Paarth Chothani is a Staff Software Engineer on the Uber AI Gen AI team in the San Francisco Bay area. He specializes in building distributed systems at scale. Previously worked on building large-scale systems.

Eduards Sidorovics

Eduards Sidorovics

Eduards is a Senior Software Engineer on the Uber AI Platform team based in Amsterdam.

Xiyuan Feng

Xiyuan Feng

Xiyuan is a Software Engineer on the Uber AI Platform Feature Store team based in Sunnyvale.

Nicholas Marcott

Nicholas Marcott

Nicholas Brett Marcott is a Staff Software Engineer, TLM on the Uber AI Feature Store team in the San Francisco Bay area. He specializes in serving data for ML models at high scale.

Jonathan Li

Jonathan Li

Jonathan Li is a Software Engineer on the Uber AI Platform team based in the San Francisco Bay Area.

Chun Zhu

Chun Zhu

Chun Zhu is a Senior Software Engineer on the Uber AI Platform team based in the San Francisco Bay area.

Kailiang Fu

Kailiang Fu

Kailiang Fu is an Associate Product Manager on the Michelangelo team based in the San Francisco Bay area.

Meghana Somasundara

Meghana Somasundara

Meghana Somasundara is a Product Lead for the Uber AI Platform. Previously she worked on building AI Platforms with other companies.

Posted by Paarth Chothani, Eduards Sidorovics, Xiyuan Feng, Nicholas Marcott, Jonathan Li, Chun Zhu, Kailiang Fu, Meghana Somasundara