Skip to main content

Go anywhere with Uber

Request a ride Request a ride

Go anywhere with Uber

Request a ride Request a ride

On the move in Columbus

Things to do and ways to get there

Featured image for How Uber Scaled Data Replication to Move Petabytes Every Day

Engineering, Data / ML

How Uber Scaled Data Replication to Move Petabytes Every Day

Uber prioritizes a reliable data lake, which is distributed across on-premise and cloud environments. This multi-region setup presents challenges for ensuring reliable and timely data access due to limited network bandwidth and the need for seamless data availability, particularly for disaster recovery. Uber uses the Hive Sync service, which uses Apache HadoopⓇ Ditscp (Distributed Copy) for data replication. However, with Uber’s Data Lake exceeding 350 PB, Distcp’s limitations became apparent. This blog explores the optimizations made to Distcp to enhance its performance and meet Uber’s growing data replication and disaster recovery needs across its distributed infrastructure.

January 29 / Global

Your Brand’s Next Big Play: Super Bowl with Uber

January 19 / US

Engineering, Data / ML

Apache Hudi™ at Uber: Engineering for Trillion-Record-Scale Data Lake Operations

January 16 / Global

Engineering, Backend

How Uber Conquered Database Overload: The Journey from Static Rate-Limiting to Intelligent Load Management

January 13 / Global

Get a ride when you need one

Sign up to ride

Start earning in your city

Sign up to drive

Get a ride when you need one

Download the App

Start earning in your city

Sign up to drive

New Uber Pro: Coming soon to select cities

January 9 / US

Engineering, Backend

From Monitoring to Observability: Our Ultra-Marathon to a Cloud-Native Platform

January 6 / Global

Safety guidelines for autonomous mobility and delivery on the Uber Platform

January 5 / US

Uber Advertising Creative Studio Debuts Journey Takeover, Turning Everyday Trips Into Immersive In-App Advertising Experiences

January 5 / Global

Most popular

AdvertisingDecember 8, 2025 / North America

Uber Advertising Launches Uber Intelligence, a New Way for Brands to Learn from Real-World Behavior, Powered by LiveRamp

Engineering, Data / MLJanuary 29 / Global

How Uber Scaled Data Replication to Move Petabytes Every Day

Data / MLOctober 30, 2025 / Global

Raising the Bar on ML Model Deployment Safety

Engineering, Data / MLDecember 9, 2025 / Global

Blazing Fast OLAP on Uber’s Inventory and Catalog Data with Apache Pinot™

Higher Education

Beyond the books: how Compton College supports its students with Uber Eats

December 28, 2025 / Global

You moved the world in 2025

December 23, 2025 / US

Data / ML, Engineering

Powering Billion-Scale Vector Search with OpenSearch

December 18, 2025 / Global

Engineering, Backend

How Uber Indexes Streaming Data with Pull-Based Ingestion in OpenSearch™

December 16, 2025 / Global

Engineering, Backend

How Uber, OCI™, and Ampere® Co-Optimized OCI AmpereOne® M A4 Compute

December 15, 2025 / Global

Restaurants on the New Path to Purchase

December 12, 2025 / US

Engineering, Data / ML

From Batch to Streaming: Accelerating Data Freshness in Uber’s Data Lake

December 11, 2025 / Global

Engineering, Data / ML

Blazing Fast OLAP on Uber’s Inventory and Catalog Data with Apache Pinot™

December 9, 2025 / Global

Uber Advertising Launches Uber Intelligence, a New Way for Brands to Learn from Real-World Behavior, Powered by LiveRamp

December 8, 2025 / North America

View more stories

Select your preferred language

English Español پښتو دری 简体中文

Sign up to drive

Sign up to ride

Select your preferred language

English Español پښتو دری 简体中文

Sign up to drive

Sign up to ride