ADAS & Autonomous Vehicle International
  • News
    • A-L
      • ADAS
      • AI & Sensor Fusion
      • Business
      • Connectivity
      • Cybersecurity
      • Expo
      • HMI
      • Last-mile delivery
      • Legislation & Standards
      • Localization/GNSS
    • M-Z
      • Mapping
      • Off-Highway
      • Robo-Taxis
      • Sensors
      • Shared Mobility
      • Safety
      • Simulation
      • Testing
      • Trucks
      • V2X
  • Features
  • Online Magazines
    • January 2025
    • September 2024
    • April 2024
    • January 2024
    • Subscribe
  • Opinion
  • Videos
  • Supplier Spotlight
  • Events
LinkedIn Facebook Twitter
  • Automotive Interiors
  • Automotive Testing
  • Automotive Powertrain
  • Professional Motorsport
  • Tire Technology
  • Media Pack
LinkedIn Facebook
Subscribe
ADAS & Autonomous Vehicle International
  • News
      • ADAS
      • AI & Sensor Fusion
      • Business
      • Connectivity
      • Cybersecurity
      • Expo
      • HMI
      • Last-mile delivery
      • Legislation & Standards
      • Localization/GNSS
      • Mapping
      • Off-Highway
      • Robo-Taxis
      • Sensors
      • Shared Mobility
      • Safety
      • Simulation
      • Testing
      • Trucks
      • V2X
  • Features
  • Online Magazines
    1. April 2025
    2. January 2025
    3. September 2024
    4. April 2024
    5. January 2024
    6. Subscribe
    Featured
    April 15, 2025

    In this Issue – April 2025

    Online Magazines By Web Team
    Recent

    In this Issue – April 2025

    April 15, 2025

    In this Issue – January 2025

    November 29, 2024

    In this Issue – September 2024

    July 23, 2024
  • Opinion
  • Videos
  • Supplier Spotlight
  • Events
  • Awards
    • About
    • Shortlist
    • Judges
LinkedIn Facebook
Subscribe
ADAS & Autonomous Vehicle International
Sensors

Research group investigates standardized tests for lidar performance

Callum Brook-JonesBy Callum Brook-JonesJanuary 11, 20234 Mins Read
Share
LinkedIn Twitter Facebook Email

For autonomous vehicles and ADAS, lidar is crucial in providing a 3D map of all objects that surround the vehicle regardless of external lighting conditions. The 3D map is updated hundreds of times per second, enabling a vehicle to estimate its position, in real time, in relation to its surroundings.

At present, lidars do not have a standardized measure for describing their performance levels, meaning there is no widely accepted protocol for comparisons between differing lidar solutions. Despite some comparisons being possible through the use of a manufacturer’s own specifications, these could also be viewed as inaccurate due to varying performance metrics and confidential information.

To address the problem, Dr Paul McManamon of Exciting Technology formed a group in partnership with SPIE, the international society for optics and photonics (SPIE). The project is to run for three years and aims to develop tests and performance standards for lidars in AVs and ADAS.

During the project’s first year, tests were headed up by Dr Jeremy Bos, an associate professor at Michigan Technological University (MTU), supported by PhD student Zach Jeffries. Other authors included Charles Kershner from the National Geospatial-Intelligence Agency, who was responsible for setting up a ground truth Riegl lidar for the test, and Akhil Kurup from MTU.

The findings of the first-year test were recently published in an open-access paper in Optical Engineering, in addition to the team explaining what it plans to do over the remainder of the project.

“Lidar engineers make design trade-offs to gain competitive advantages in performance and cost in what is a rapidly growing, highly competitive market,” commented Jeffries. “Some of these trade-offs include operating wavelength (typically between 850Nm and 1,600Nm), range measurement based on either direct detection/time-of-flight (ToF) or coherent techniques, beam steering solutions (mechanically rotating components, MEMS mirrors, micro lenses), and laser source type [vertical cavity surface-emitting lasers (VCSELs), edge-emitting diodes]. These design choices have trade-offs of their own, with differences in scan patterns, sampling frequency, achievable ranges, susceptibility to interference from other lidars, etc.”

During these tests, the team’s objective was to evaluate the range, accuracy and precision of eight automotive-grade lidars using a survey-grade lidar as a reference. The team set up an array of targets along a 200m path in an open field in Kissimmee, Florida. A key aspect of the targets which made the tests stand out from previously conducted studies was that they were near-perfect matte surfaces with a calibrated 10% reflectivity across a wide spectrum. During testing the team also measured the ability of the lidars to detect a target among highly reflective road signs.

Generally, the subsequent test results were consistent and in keeping with the values written in the manufacturer’s datasheets. However, despite recording a mean precision of 2.9cm across all the devices that the team tested, the distribution of the measured values was not Gaussian.

The team stated there was a non-negligible probability for these devices to report very imprecise values (an error greater than 10cm). In some cases the measured range deviated from the real value by as much as 20cm. Additionally, other important results showed that the reflective road signs impaired the target detection performance of the lidars.

“The advertised range performance of lidars pertains to very specific conditions, and performance degrades significantly in the presence of a highly reflective adjacent object,” said Bos.

The first-round tests provided the researchers with valuable insights into the performance differences between different lidars. The results suggested that the metrics reported by each respective manufacturer were not reliable.

“The first-year tests were the simplest of them,” explained Bos. “In the second year, we will duplicate these tests for the characterized lidars while introducing confusion resulting from other automotive lidars approaching from the opposite direction. Additionally, we will measure the eye safety of the lidars. Finally, in the third year, we will include weather effects as a culmination of the complexity build-up.”

Share. Twitter LinkedIn Facebook Email
Previous ArticleRTI and Ansys to accelerate design, simulation and deployment of mission-critical distributed systems
Next Article LG and Magna partner on development of next-gen autonomous driving infotainment solution

Related Posts

Safety

Elektrobit and Metoak partner on SDV safety ecosystem development

May 12, 20252 Mins Read
Simulation

rFpro launches digital twin of rural UK road

May 2, 20253 Mins Read
Testing

Tier IV successfully tests autonomous trucks on highway priority lanes

May 2, 20251 Min Read
Latest News

Elektrobit and Metoak partner on SDV safety ecosystem development

May 12, 2025

Hyundai Motor and Plus unveil autonomous hydrogen freight ecosystem concept

May 12, 2025

EXPO NEWS: Opens next week!

May 12, 2025
FREE WEEKLY E-NEWSLETTER

Receive breaking stories and features in your inbox each week, for free


Enter your email address:


Our Social Channels
  • Facebook
  • LinkedIn
Getting in Touch
  • Free Weekly E-Newsletters
  • Meet the Editors
  • Contact Us
  • Media Pack
RELATED UKI TOPICS
  • Automotive Interiors
  • Automotive Testing
  • Automotive Powertrain
  • Professional Motorsport
  • Tire Technology
  • Media Pack
© 2025 UKi Media & Events a division of UKIP Media & Events Ltd
  • Terms and Conditions
  • Privacy Policy
  • Cookie Policy
  • Notice & Takedown Policy
  • Site FAQs

Type above and press Enter to search. Press Esc to cancel.

We use cookies on our website to give you the most relevant experience by remembering your preferences and repeat visits. By clicking “Accept”, you consent to the use of ALL the cookies.
Cookie settingsACCEPT
Manage consent

Privacy Overview

This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary
Always Enabled

Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.

CookieDurationDescription
cookielawinfo-checbox-analytics11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checbox-functional11 monthsThe cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checbox-others11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-necessary11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-performance11 monthsThis cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy11 monthsThe cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.

Functional

Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.

Performance

Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.

Analytics

Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.

Advertisement

Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.

Others

Other uncategorized cookies are those that are being analyzed and have not been classified into a category as yet.

SAVE & ACCEPT