ADAS & Autonomous Vehicle International
  • News
    • A-L
      • ADAS
      • AI & Sensor Fusion
      • Business
      • Connectivity
      • Cybersecurity
      • Expo
      • HMI
      • Last-mile delivery
      • Legislation & Standards
      • Localization/GNSS
    • M-Z
      • Mapping
      • Off-Highway
      • Robo-Taxis
      • Sensors
      • Shared Mobility
      • Safety
      • Simulation
      • Testing
      • Trucks
      • V2X
  • Features
  • Online Magazines
    • January 2025
    • September 2024
    • April 2024
    • January 2024
    • Subscribe
  • Opinion
  • Videos
  • Supplier Spotlight
  • Events
LinkedIn Facebook Twitter
  • Automotive Interiors
  • Automotive Testing
  • Automotive Powertrain
  • Professional Motorsport
  • Tire Technology
  • Media Pack
LinkedIn Facebook
Subscribe
ADAS & Autonomous Vehicle International
  • News
      • ADAS
      • AI & Sensor Fusion
      • Business
      • Connectivity
      • Cybersecurity
      • Expo
      • HMI
      • Last-mile delivery
      • Legislation & Standards
      • Localization/GNSS
      • Mapping
      • Off-Highway
      • Robo-Taxis
      • Sensors
      • Shared Mobility
      • Safety
      • Simulation
      • Testing
      • Trucks
      • V2X
  • Features
  • Online Magazines
    1. April 2025
    2. January 2025
    3. September 2024
    4. April 2024
    5. January 2024
    6. Subscribe
    Featured
    April 15, 2025

    In this Issue – April 2025

    Online Magazines By Web Team
    Recent

    In this Issue – April 2025

    April 15, 2025

    In this Issue – January 2025

    November 29, 2024

    In this Issue – September 2024

    July 23, 2024
  • Opinion
  • Videos
  • Supplier Spotlight
  • Events
  • Awards
    • About
    • Shortlist
    • Judges
LinkedIn Facebook
Subscribe
ADAS & Autonomous Vehicle International
Features

FEATURE: Zoox – radars in autonomy: current landscape, challenges, and the future

Anthony JamesBy Anthony JamesAugust 10, 20235 Mins Read
Share
LinkedIn Twitter Facebook Email

Arvind Srivastav, a software engineer at Zoox, discusses the use of radars in autonomy, ahead of his presentation on the same theme at the ADAS & Autonomous Vehicle Technology Expo California Conference, which takes place September 20 & 21, 2023, in Santa Clara. Arvind currently leads R&D projects on perception at Zoox, which is on a mission to provide safe transportation via its purpose-built robotaxis.

A graduate of Stanford University, Arvind’s expertise lies in radar perception and early sensor fusion. Prior to Stanford, he led the development of an advanced underground imaging radar system in Cleveland, Ohio. This novel technology facilitated proactive monitoring of urban infrastructure, leading to reduced financial and environmental costs and improved safety of the city’s aging infrastructure. A fervent advocate of a safer and more sustainable future of our cities supported by autonomous vehicles, Arvind holds six publications and seven patents.

Describe your presentation?
My presentation aims to shed light on the importance of radars in autonomous driving and the challenges inherent in their use. Radars are known for their ability to detect objects from long distances, under occlusions, and in adverse weather conditions. However, fully harnessing their full potential through deep learning methods is no easy task. Imagine trying to identify objects in a foggy environment; while the human eye might struggle, radars can “see” in these conditions, but interpreting this radar data accurately presents a significant challenge.

One of the strategies I will explore is early sensor fusion. Here, we combine radar data with information from other sensors like cameras and lidar at an early stage to achieve a more robust perception of objects in a scene. It’s like piecing together a jigsaw puzzle of scene perception, where each sensor provides different pieces. Radars might offer velocity information, lidars contribute precise shape details, and cameras add color and fine-grained class data. We’ll also delve into occupancy estimation, which involves predicting where objects could be in the environment around the vehicle – essentially reconstructing the scene from sensor data and estimating which regions are safe for driving.

What are some common misconceptions about radar and their use in ADAS and autonomous driving?
A common misunderstanding is that all radars are similar. However, a radar’s capability can vary greatly based on its specifications like imaging range, resolution and other technical parameters. For instance, the new-generation radars, called 4D radars, provide far superior resolution imaging and data compared to previous generation 3D radars. 

Another misconception is that radar perception models need to provide full scene perception, just like camera and lidar models do. However, radar models inherit strengths of radars as well as their weaknesses – which are many (sparsity, low resolution and noise in data, to name a few). Arguably, it’s better to use radar data in a complementary fashion with other sensor’s data so that we inherit the strengths of radars and compensate for their weaknesses. An emerging approach is early sensor fusion, in which perception models leverage strengths of radars like velocity, long-range imaging, robustness to adverse weather, and compensate for their weaknesses using data from other sensors like lidar and cameras.

Lastly, radars have high uncertainty in imaging which permeates through all of their data. For example, a car could very well appear like a bike under certain imaging conditions. Thus, it’s important to accurately estimate a radar model’s detection uncertainty and bake it into the final output.

What are some of radar’s key weaknesses and how are they best resolved?
One of the key weaknesses of radar is its lower resolution compared to cameras or lidar. This can be mitigated to some extent by accumulating radar data over multiple measurement cycles, which improves the shape and location estimation of detected objects.

High uncertainty in radar measurements presents another challenge. This can be addressed by incorporating uncertainty estimates into perception models, thus ensuring safe and reliable perception even when the data lacks sufficient knowledge.

Radars frequently generate ghost objects due to their imaging physics. Advanced signal processing techniques can assist in filtering out most of these ghost objects, thereby enhancing the reliability of the detections.

Finally, the scarcity of large public radar data sets for developing and validating models is a significant challenge. This situation underscores the need for increased availability of better data sets.

What is the future for autonomous radar?
The future holds immense promise for radars in autonomous driving. New 4D radars offer denser data with higher resolution and lower uncertainty compared to previous generation radars, leading to superior radar perception.  Additionally, a new type of radars, called terahertz radars, are under development, which promise even greater resolution in imaging, resulting in improved perception of smaller objects, such as cyclists and pedestrians.

Moreover, transformers, which power ChatGPT, are gaining wide adoption in perception as well. Transformers are emerging as universal learners with the ability to learn from disparate multi-modality data. They are increasingly playing an instrumental role in designing early sensor fusion models to better leverage strengths of radar in tandem with other sensor data and offer a unified and robust perception of the surroundings.

What is your key message to the audience in Santa Clara?
Safety and reliability form the cornerstone of our envisioned autonomous driving future, and radars, with their unique capabilities and potential for continuous advancement, are set to play a crucial role in this endeavor. As we continue to innovate and push the boundaries of what’s possible with radars, we move one step closer to making the dream of safe and reliable autonomous driving a reality.

Don’t miss Arvind Srivastav’s presentation, which is part of the ‘Sensor test, development, fusion, calibration and data’ session taking place on Day 2 (Sept 21) of the conference (rates apply), alongside the free-to-attend exhibition at ADAS & Autonomous Vehicle Technology Expo California. 

Share. Twitter LinkedIn Facebook Email
Previous ArticleWaymo to establish autonomous ride hailing in Austin
Next Article MIPI Alliance and Automotive SerDes Alliance sign a liaison agreement to enable native MIPI CSI-2 implementation with ASA-ML PHY

Related Posts

Sensors

NXP unveils third-generation imaging radar processors

May 16, 20252 Mins Read
Safety

Elektrobit and Metoak partner on SDV safety ecosystem development

May 12, 20252 Mins Read
Expo

EXPO NEWS: Opens next week!

May 12, 20253 Mins Read
Latest News

NXP unveils third-generation imaging radar processors

May 16, 2025

Elektrobit and Metoak partner on SDV safety ecosystem development

May 12, 2025

Hyundai Motor and Plus unveil autonomous hydrogen freight ecosystem concept

May 12, 2025
FREE WEEKLY E-NEWSLETTER

Receive breaking stories and features in your inbox each week, for free


Enter your email address:


Our Social Channels
  • Facebook
  • LinkedIn
Getting in Touch
  • Free Weekly E-Newsletters
  • Meet the Editors
  • Contact Us
  • Media Pack
RELATED UKI TOPICS
  • Automotive Interiors
  • Automotive Testing
  • Automotive Powertrain
  • Professional Motorsport
  • Tire Technology
  • Media Pack
© 2025 UKi Media & Events a division of UKIP Media & Events Ltd
  • Terms and Conditions
  • Privacy Policy
  • Cookie Policy
  • Notice & Takedown Policy
  • Site FAQs

Type above and press Enter to search. Press Esc to cancel.

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Cookie settingsACCEPT
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.

CookieDurationDescription
cookielawinfo-checbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.

Functional

Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.

Performance

Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.

Analytics

Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.

Advertisement

Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.

Others

Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.

SAVE & ACCEPT