Skip to main content
Engineering, Uber AI

Palette Meta Store Journey

January 18 / Global
Featured image for Palette Meta Store Journey
Image
Figure 1: Feature Generation graph shows job computing features. Feature Ingestion graph shows ingesting data to hive and Cassandra. Feature Serving graph shows how features are served offline/online. Feature Metadata and Data Quality graph shows how featurestore metadata flows across offline and online stores.
Image
Figure 2: Feature Group Update flows from Palette Metadata repository to Offline Serving system and propagates to OnlineServing Cache eventually as well as is used by various systems for ETL/Training.
Image
Figure 3: FeatureGroup has OnlineSpec, OfflineSpec, ComputeSpec. OnlineSpec has Snapshot Backing which underneath is backed by Cassandra or Hive Backing. OnlineFeatureServingGroup is composed of online stores and online caches. Inference Server/Palette Service references OnlineFeatureServingGroup and indirectly references FeatureGroup.
Image
Figure 4: Palette Metadata repository updates go through server side validation and get registered in offline serving system and pushed to OnlineServing Cache and OnlineServing stack.
Image
Figure 5: Schema updates for Old and New Schema propagate from Metadata Service to Read only Cache and gets loaded to OnlineServing via Loader which is referenced by Wrapper.
Paarth Chothani

Paarth Chothani

Paarth Chothani is a Staff Software Engineer on the Uber AI Gen AI team in the San Francisco Bay area. He specializes in building distributed systems at scale. Previously worked on building large-scale systems.

Nicholas Marcott

Nicholas Marcott

Nicholas Brett Marcott is a Staff Software Engineer, TLM on the Uber AI Feature Store team in the San Francisco Bay area. He specializes in serving data for ML models at high scale.

Dehua Lai

Dehua Lai

Dehua Lai is a Senior Software Engineer on Uber AI's Feature Store team based in Seattle. His primary focus is on building ML Platforms on large-scale distributed systems.

Xiyuan Feng

Xiyuan Feng

Xiyuan is a Software Engineer on the Uber AI Platform Feature Store team based in Sunnyvale.

Chunhao Zhang

Chunhao Zhang

Chunhao Zhang is a Senior Software Engineer at Uber AI’s Feature Store tead based in Sunnyvale. He specializes in building large scale distributed systems. Previous work on Google search indexing and display ads serving.

Victoria Wu

Victoria Wu

Victoria Wu is a Senior Software Engineer on the Uber AI’s Feature Store team based in the San Francisco Bay Area. She specializes in building large-scale distributed systems. Previously worked on building Kafka infrastructure at PayPal.

Posted by Paarth Chothani, Nicholas Marcott, Dehua Lai, Xiyuan Feng, Chunhao Zhang, Victoria Wu