Continental Cockpit Sensors: In-vehicle Sensor Systems for Sophisticated Design and Safety Enhancement

Continental has developed an integrated solution for in-vehicle sensor technology that already meets future safety standards and further enhances vehicle comfort. In the cockpit sensor solution, the technology company Continental has combined its in-vehicle camera expertise, which has been cultivated over many years in the field of human-machine interaction, with its radar sensor expertise. With comprehensive real-time object monitoring of the vehicle interior, Continental offers more than just pure driver monitoring and provides a key technological backbone for future mobility modes such as automated and driverless driving. The technology complies with future safety regulations from the European Commission and the consumer protection organisation Euro NCAP.

The cockpit sensor detects objects in the vehicle in real time.

"For the in-vehicle sensor, we have not only brought together expertise from various fields, but also tackled a number of technical challenges. For the first time ever, we are integrating a camera directly into the display instead of into the steering column or instrument cluster. To do this, we used miniaturisation technology, which offers us a whole new choice of mounting locations." Says Ulrich Lüders, Head of Product and Strategy at Continental's HMI Business Unit.

The complexity of the technology lies firstly in the integration of the optical and sensor system into the display, which is minimised to approximately 10 mm, precisely and completely integrated into the display for a high standard and aesthetically pleasing visual experience. The second is the precise positioning of the radar sensors, which must cover all areas of the vehicle equally. The combination of these two technologies, together with precise integration and positioning, makes it possible to develop a wide range of applications for cockpit sensors.

Cars are becoming smart watches

Continental solutions reliably detect live objects in vehicles, whether adults, children or animals. This is particularly important in order to comply with future safety standards. As Lüders explains, "Our cockpit sensor solutions fulfil the new requirements of the EU General Safety Regulation (GSR) and help car manufacturers to score well in the European New Car Safety Assessment."

From 2024. for newly registered models, the European Commission will add driver and vehicle monitoring specifications to the GSR system certification requirements. For example, vehicles will be required to have a function to detect driver fatigue or inattention. These far-reaching legislative changes are also aided by another regulatory system - the European Organisation of New Car Safety Assessment Societies (EOCSAAS) is encouraging the installation of in-vehicle camera systems from 2023. The voluntary scheme for assessing vehicle safety will set out assessment points on child presence detection (CPD) in the future. If a parent forgets that there is a child in the back seat, the cockpit sensor technology detects it via radar sensors and stored object classification algorithms, and an alert ensues.

The technology, which enables child signature recognition, will be awarded points by the European Organisation of New Car Safety Assessment Panels (Euro NCAP) from 2023.

"Our development focuses on biometrics. Among other things, the cockpit sensor recognises a child's breath, identifies it and sounds an alarm. Alarm failure is virtually impossible," explains Daniel Naujack, product manager for in-car cameras and cockpit sensors at Continental. "Based on image information from the in-car camera, the system can also detect leftover luggage and send a notification to the baggage owner's mobile phone, for example, if someone in a rental car leaves a briefcase, the system will send a timely notification."

In the future, cockpit sensors will not only be able to measure and assess the movement of objects, but also detect health parameters of the vehicle occupants, such as pulse rate, respiratory rate and body temperature. If the system detects an urgent health condition, it is able to stop the vehicle safely with minimal risk. "By recording a variety of important data through cockpit sensors, we will make the car a smartwatch for its passengers in the future." Naujack concludes.

The miniaturisation of in-car cameras enables new mounting location options, such as direct integration into the display.

Key elements for autonomous driving

In order to realise autonomous driving, in-vehicle sensors assume another important role. There will always be traffic situations that require the autonomous driving system to hand over control to the driver. Designing this handover safely becomes a key task that self-driving cars must master. In conjunction with sensor information and software, in-vehicle cameras are able to detect whether the driver is able to receive manual control. "Autonomous driving enables the driver to do other things in the car without having to focus on traffic. This requires the system to be able to detect the state of the driver, whether they are reading a book or have fallen asleep, in order for the system to successfully and safely hand over driving control." Naujack said. Cockpit sensors also play an important role in autonomous driving, for example, robotic taxis can keep tabs on passenger behaviour.