Better Load Balancing: Real-Time Dynamic Subsetting

Overview Subsetting is a common technique used in load balancing for large-scale distributed systems. In this blog post, we will briefly introduce Uber’s current service mesh architecture that has been powering thousands of critical microservices in Uber since 2016. We … The post Better Load Balancing: Real-Time Dynamic Subsetting appeared first...

6d

Better Load Balancing: Real-Time Dynamic Subsetting

Overview Subsetting is a common technique used in load balancing for large-scale distributed systems. In this blog post, we will briefly introduce Uber’s current service mesh architecture that has been powering thousands of critical microservices in Uber since 2016. We … The post Better Load Balancing: Real-Time Dynamic Subsetting appeared first...

2w

Dynamic Data Race Detection in Go Code

Uber has extensively adopted Go as a primary programming language for developing microservices. Our Go monorepo consists of about 50 million lines of code and contains approximately 2,100 unique Go services. Go makes concurrency a first-class citizen; prefixing function calls … The post Dynamic Data Race Detection in Go Code appeared first on Uber...

4w

Presto® on Apache Kafka® At Uber Scale

Uber’s goal is to ignite opportunity by setting the world in motion, and big data is a very important part of that. Presto® and Apache Kafka® play critical roles in Uber’s big data stack. Presto is the de … The post Presto® on Apache Kafka® At Uber Scale appeared first on Uber Engineering Blog.

Apr 2022

Securing Kafka® Infrastructure at Uber

Background Uber has one of the largest deployments of Apache Kafka® in the world. It empowers a large number of real-time workflows at Uber, including pub-sub message buses for passing event data from the rider and driver apps, as … The post Securing Kafka® Infrastructure at Uber appeared first on Uber Engineering Blog.

Apr 2022

Uber’s Emergency Button and The Technologies Behind It

Safety has long been a top priority at Uber, as Uber’s CEO Dara Khosrowshahi wrote in ‘Raising the Bar on Safety’ in September 2018. In order to #StandForSafety, the team at Uber has rolled out a set of … The post Uber’s Emergency Button and The Technologies Behind It appeared first on Uber Engineering Blog.

Mar 2022

Avoiding CPU Throttling in a Containerized Environment

At Uber, all stateful workloads run on a common containerized platform across a large fleet of hosts. Stateful workloads include MySQL®, Apache Cassandra®, ElasticSearch®, Apache Kafka®, Apache HDFS™, Redis™… The post Avoiding CPU Throttling in a Containerized Environment appeared first on Uber Engineering Blog.

Mar 2022

One Stone, Three Birds: Finer-Grained Encryption @ Apache Parquet™

Overview  Data access restrictions, retention, and encryption at rest are fundamental security controls. This blog explains how we have built and utilized open-sourced Apache Parquet™’s finer-grained encryption feature to support all 3 controls in a unified way. In … The post One Stone, Three Birds: Finer-Grained Encryption @ Apache Parquet™ appeared...

Mar 2022

Introducing Ballast: An Adaptive Load Test Framework

As Uber’s architecture has grown to encompass thousands of interdependent microservices, we need to test our mission-critical components at max load in order to preserve reliability. Accurate load testing allows us to validate if a set of services are working … The post Introducing Ballast: An Adaptive Load Test Framework appeared first on Uber Engineering...

Mar 2022

Introducing Carbon Feed for Earners: The One-Stop Info Shop

After launching the Driver App in 2018 to over 2 million earners worldwide, we added content and functionality at a rapid pace. Although this really bolstered the platform, allowing for high-density and high-frequency content, and provided drivers and couriers with … The post Introducing Carbon Feed for Earners: The One-Stop Info Shop appeared first...

Feb 2022