Uber’s Real-time Data Intelligence Platform At Scale: Improving Gairos Scalability/Reliability

Background Real-time data (# of ride requests, # of drivers available, weather, game) enables operations teams to make informed decisions like surge pricing, maximum dispatch ETA calculating, and demand/supply forecasting about our services that improve user experiences on the … The post Uber’s Real-time Data Intelligence Platform At Scale: Improving...

3d

The Journey Towards Metric Standardization

At Uber, business metrics are vital for discovering insights about how we perform, gauging the impact of new products, and optimizing the decision making process. The use cases for metrics can range from an operations member diagnosing a fares issue … The post The Journey Towards Metric Standardization appeared first on Uber Engineering Blog.

2w

Disaster Recovery for Multi-Region Kafka at Uber

Apache Kafka at Uber Uber has one of the largest deployments of Apache Kafka in the world, processing trillions of messages and multiple petabytes of data per day. As Figure 1 shows, today we position Apache Kafka as a cornerstone … The post Disaster Recovery for Multi-Region Kafka at Uber appeared first on Uber Engineering Blog.

Dec 2020

Uber’s Real-Time Push Platform

Uber builds multi-sided marketplaces handling millions of trips every day across the globe. We strive to build real-time experiences for all our users. The nature of real time marketplaces make them very lively. Over the course of a trip, there … The post Uber’s Real-Time Push Platform appeared first on Uber Engineering Blog.

Dec 2020

No Code Workflow Orchestrator for Building Batch & Streaming Pipelines at Scale

Data-In-Motion @ Uber At Uber, several petabytes of data move across and within various platforms every day. We power this data movement by a strong backbone of data pipelines. Whether it’s ingesting the data from millions of Uber trips or … The post No Code Workflow Orchestrator for Building Batch & Streaming Pipelines at Scale appeared first...

Dec 2020

Horovod v0.21: Optimizing Network Utilization with Local Gradient Aggregation and Grouped Allreduce

We originally open-sourced Horovod in 2017, and since then it has grown to become the standard solution in industry for scaling deep learning training to hundreds of GPUs.  With Horovod, you can reduce training times from days or weeks to … The post Horovod v0.21: Optimizing Network Utilization with Local Gradient Aggregation and Grouped Allreduce...

Nov 2020

Turning Metadata Into Insights with Databook

Every day in over 10,000 cities around the world, millions of people rely on Uber to travel, order food, and ship cargo. Our apps and services are available in over 69 countries and run 24 hours a day. At our … The post Turning Metadata Into Insights with Databook appeared first on Uber Engineering Blog.

Nov 2020

Meet the 2020 Safety Engineering Interns: COVID Edition

About the Safety team & What we do Uber is dedicated to keeping people safe on the road. The Safety and Insurance Engineering team is at the core of Uber’s business. We work to redefine what it takes to be … The post Meet the 2020 Safety Engineering Interns: COVID Edition appeared first on Uber Engineering Blog.

Oct 2020

Operating Apache Pinot @ Uber Scale

Introduction Uber has a complex marketplace consisting of riders, drivers, eaters, restaurants and so on. Operating that marketplace at a global scale requires real-time intelligence and decision making. For instance, identifying delayed Uber Eats orders or abandoned carts helps to … The post Operating Apache Pinot @ Uber Scale appeared first on...

Oct 2020

Building from the Baltics: Meet the Uber Engineering Team in Vilnius, Lithuania

When the site launched in 2014, the team at Uber Engineering’s Vilnius, Lithuania office consisted of two people working out of a co-working space. Six years later, the team has grown to 46 people, representing Uber’s Production Engineering, Core Platform, … The post Building from the Baltics: Meet the Uber Engineering Team in Vilnius, Lithuania appeared...

Oct 2020