May 18, 2022
Cities, freeways, airports: How we've built a scalable autonomous driver
 |
The Waymo Driver autonomously navigating through a busy intersection to pick up a rider at the Phoenix Convention Center |
For both a human and autonomous driver, the fundamentals of driving are largely the same wherever they go. For example, any driver should be prepared to navigate around construction zones no matter if it’s a Class 8 truck carrying cargo on I-45 or a passenger car ferrying riders in San Francisco or Downtown Phoenix. Rather than just validating our technology for specific routes, we've prepared it to handle the myriad of situations that can happen on many different types of streets, by testing it in a diverse range of environments across 13 U.S. states. Our approach is to enable our software to generalize from place to place, allowing us to both make our Driver better in all locations at once and to focus our attention on new aspects of a territory—like different climates, specific road rules, or other local nuances—which leads to quicker scalability.
 |
The Waymo Driver autonomously navigating construction zones in multiple locations |
The Waymo Driver's powerful ML models learn from each mile from our entire fleet. Our team gets creative to train our ML systems, locating and applying the datasets that are the most interesting for ML training from the tens of millions of miles our Driver has autonomously navigated in the real world. For example, we have developed innovative techniques to automatically identify interesting interactions and augment data, enabling us to create focused datasets to learn more effectively and efficiently. When combined with our suite of simulation tools—which are now so advanced that we can generate fully synthetic data at a real-world scale with remarkable realism—it significantly speeds up our data generation rates, in turn dramatically improving our iteration speeds.
Training ML models is only part of the equation — there are many pieces that all have to work seamlessly together to solve this incredibly hard problem. One important part is evaluation, which is a critical step before we begin our operations without a human in the driver's seat. We use a comprehensive set of safety methodologies and a range of methods from simulation to structured testing to driving in the real world to evaluate the Waymo Driver's performance and determine its safety readiness. Operating in multiple domains and environments, from bustling city streets to high-speed freeways to now airport roads, gives us a nuanced understanding of which parts of evaluation are fundamental across domains and which are context-specific, helping us build a safe, generalizable stack.
Scaling with the Flywheel Effect
As the fastest growing city in the U.S. Phoenix represents a diverse population with unique transport needs. With the rapidly increasing number of residents, heavy traffic, and the sheer amount of construction taking place, vibrant Downtown Phoenix presents many similar challenges to what we’ve seen in other cities like San Francisco. Being able to apply learnings directly from one city to another unlocks a powerful flywheel effect and gives us a significant head start in every new location, without overfitting our technology to a single territory.
At Sky Harbor, the Waymo Driver will apply learnings it has gained from driving in other locations to the unique challenge of airport pick up and drop off. That includes lessons our Driver learned from navigating the bustling streets of San Francisco, as well as Phoenix's East Valley's crowded shopping centers and high speed roads. Our Jaguar I-PACEs will drive autonomously at Sky Harbor Airport at all hours of the day and night, with an autonomous specialist present at first, to help us learn from the airport’s busy roads and crowded parking lots. We’ll focus our operations on the area around the 44th Street PHX Sky Train® Station, which is near the pickup and drop-off location for other ride-hail services. We will begin with Waymo employees hailing rides between Downtown Phoenix and Sky Harbor, eventually opening up to members of the public via our Trusted Tester program.
What we learn at Sky Harbor Airport will benefit us in other locations and help accelerate our progress. As we bring the Waymo Driver to more people in more places, we will be able to deploy in every new territory even faster and focus on some inherent challenges specific to each location—like driving in snow in New York City, human-like mannequins in Los Angeles' Fashion District, or the notorious Pittsburgh left. With our robust infrastructure and state-of-the-art ML systems, the Waymo Driver is well prepared to tackle the challenges down the road.
Training ML models is only part of the equation — there are many pieces that all have to work seamlessly together to solve this incredibly hard problem. One important part is evaluation, which is a critical step before we begin our operations without a human in the driver's seat. We use a comprehensive set of safety methodologies and a range of methods from simulation to structured testing to driving in the real world to evaluate the Waymo Driver's performance and determine its safety readiness. Operating in multiple domains and environments, from bustling city streets to high-speed freeways to now airport roads, gives us a nuanced understanding of which parts of evaluation are fundamental across domains and which are context-specific, helping us build a safe, generalizable stack.
Scaling with the Flywheel Effect
As the fastest growing city in the U.S. Phoenix represents a diverse population with unique transport needs. With the rapidly increasing number of residents, heavy traffic, and the sheer amount of construction taking place, vibrant Downtown Phoenix presents many similar challenges to what we’ve seen in other cities like San Francisco. Being able to apply learnings directly from one city to another unlocks a powerful flywheel effect and gives us a significant head start in every new location, without overfitting our technology to a single territory.
At Sky Harbor, the Waymo Driver will apply learnings it has gained from driving in other locations to the unique challenge of airport pick up and drop off. That includes lessons our Driver learned from navigating the bustling streets of San Francisco, as well as Phoenix's East Valley's crowded shopping centers and high speed roads. Our Jaguar I-PACEs will drive autonomously at Sky Harbor Airport at all hours of the day and night, with an autonomous specialist present at first, to help us learn from the airport’s busy roads and crowded parking lots. We’ll focus our operations on the area around the 44th Street PHX Sky Train® Station, which is near the pickup and drop-off location for other ride-hail services. We will begin with Waymo employees hailing rides between Downtown Phoenix and Sky Harbor, eventually opening up to members of the public via our Trusted Tester program.
What we learn at Sky Harbor Airport will benefit us in other locations and help accelerate our progress. As we bring the Waymo Driver to more people in more places, we will be able to deploy in every new territory even faster and focus on some inherent challenges specific to each location—like driving in snow in New York City, human-like mannequins in Los Angeles' Fashion District, or the notorious Pittsburgh left. With our robust infrastructure and state-of-the-art ML systems, the Waymo Driver is well prepared to tackle the challenges down the road.
