The publication entitled "Automotive LiDAR Based Precipitation State Estimation Using Physics Informed Spatio-Temporal 3D Convolutional Neural Networks (PIST-CNN)" was developed as part of the "SAVeNoW" project funded by the Federal Ministry for Digital and Transport Affairs (BMDV) in cooperation with the Fraunhofer IVI Application Centre in Ingolstadt and Conti Temic microelectronic GmbH. To be able to virtually test the environmental detection of autonomous vehicles, sensor models are required that can record the influence of rain and snow as well as ageing on the sensors. Marcel Kettelgerdes is devoting himself to this research in his doctorate supervised by Professor Gordon Elger at the Institute for Innovative Mobility at THI.
Accompanied by a student project with AI students at THI, a neural network architecture enriched with prior physical knowledge was developed, which estimates the current weather situation in the form of precipitation characteristics (particle size distribution as well as precipitation type and rate) purely based on weather-related measurement artefacts in the LiDAR data. For its training, an extensive database of high-resolution weather and LiDAR data was used, which was recorded as part of the project to investigate and model weather influences on safety-relevant automotive environment sensors.
LiDAR sensors are considered a key sensor for future automated driving functions due to their high spatial resolution and measurement accuracy. Continuous recording of local weather conditions while driving could be used to provide the driver or neighboring vehicles with qualified weather information without the need for additional sensors. Furthermore, the driving dynamics and corresponding safety-relevant driving functions could be flexibly adapted based on the type and intensity of precipitation and the resulting condition of the driving surface.