Conf42 Site Reliability Engineering (SRE) 2025 - Online

- premiere 5PM GMT

The Evolution of AI-Enhanced Automotive Infotainment Systems: Technical Innovations and Future Prospects

Video size:

Abstract

Discover how AI is revolutionizing automotive infotainment systems, enhancing safety, usability, and user experience. Explore groundbreaking advancements in voice recognition, predictive AI, and driver monitoring that reduce distractions, increase engagement, and pave the way for connected

Summary

Transcript

This transcript was autogenerated. To make changes, submit a PR.
Hello everyone. My name is Ravi Kala, and first of all thank you for giving an opportunity to introduce myself and then conference opportunity. So if you have any questions regarding this topic, you can reach out to me over the email or and link it in. So today I'm going to discuss in this conferences the evaluation of. A enhanced automotive infotainment system and that and as well as the, I'm going to discuss the technical innovations and then future prospects. So let's start with the, some basic things. So you are, automotive entertainment? Automotive entertainment is information plus entertainment is entertainment. When you are, when you sit in a car, you see the display in front of your old driving suite or in front of, in the console. That is the infotainment system. You can listen the songs and then, you can entertain the, things like you could do the video games or in a parking, in a park mode. And then as well as the, you can do vehicle a operations, like change settings or that is the info system. So hope you are, you know that. But yeah just wanted to give you brief overview, but in this topic I'm going to discuss how the AI. Is influential, the info interacting with the infotainment system, automotive infotainment system. So in this conference, I'm going to discuss the technical framework and challenges and as well as the breakthrough solutions driving the development of AA power automotive infotainment systems. So let's start with some basic thing like the market growth and technological evaluations. So if you see this there are the 2023. Around 21 part six, 3 billion revenue from infotainment a infotainment so that, that use that will be projected like 37 part 6 billion by 2023. A enhance system, which is currently accounted for like around 42.3 of the market. That is expected to dominate like, more dominate the future, grow future automotive industry. For the a. But the basic thing is bias recognition because of, you need to talk with you need to talk to the infotainment system or that is the easiest and more, more fastest way to communicate with your infotainment system. So in 2020 2020, the the wise accuracy, it used to be like an 82.4 percentage around around 20 wise commands. Almost three or two operations. Operations, like in a wise commands got failed able to process that command. But in 2023 that increase to 96.2, right now it's almost 99.99 percentage accuracy of the, of your wise commands. And then the, and the other thing is the fast response, the responses also very reduced a right now it's 2.7 seconds to get. Get your answers whatever you are asking to the entertainment system it'll respond like that. And then and then the there are so many things involved we will get into that things first of all computational architecture evolution. So in 2020 in 2080, let's start with the 20 28, 20 18. So we used to like in automotive industries, used 1, 2, 2 processing means we call the vehicle interface process. The vehicle is. Consisting of ecs, electronic control units, each con, each ECU consisting of specific set of operations BC body control module. It's specifically designed for braking system or lighting or some of the most critical operation. And then there are lightning module, especially for lights, lightning system. And then there are like, vehicle vehicle control units and then as well as the like you audio amplifier amplifier modules. Amplifier modules are like, audio systems. Those kind of things are like, it's consisting of the auto, the vehicle is consisting of number of, so in 20 20 18, it used to be one to two crossing limits, but 2020 we. It increase it to two to four processing units more demand, more more capabilities are introduced. And then 2023 and 2022 at used it was like, five to eight processing units. So imagine 5, 2, 8 is 1 trillion operations per second. The whatever the, the five to eight crossing units. It'll it'll operate 1 trillion operations. And right now we are almost triple that 3 trillion operations per second. That's how we increased the capabilities of the operations and then low power consumption. That is also another another thing we need to we need to consider. All, automotive is first priority is safety. Safety is when you are driving your car safety is the first priority for the automotive industry. That's why. Every automotive industry when they are implementing any. Any any capabilities or anything, the safety is the first reality for their for their operations. So that's the that's how they operating. So let's get into that. Drive driver monitoring and personalization things. Let's the AI is also uses not only for your voice recognization, but also camera. So how the, how you are whether you are sad, whether you are sick, whether you are, based on your eye movements, based on your facial expressions it'll recognize and then say, based on your command if you are a dull if you are, if you got into a trouble or anything, it automatically detect and directly connected to your when you are in got an accident any. Need anything any, any sudden movements, it automatically directly connected to the back office systems, and directly connected to your 9 1 1 to get get help as possible and then car your incidents. That's how this AI is added those capabilities and as well as the. I just I just your information like, your personal information whether it's saved saved, locally, saved in the back office, but it's but it's needs to be private. You. No, no need to be shared with someone. So that is our sort priority for the ai. And then there is an name. Neural networks. That is like analyzing multiple input. You are driving same location multiple times, and then a, recognize that one and then determine okay. You are going to this one you are going to this road, and then is there any traffic in that location? And then it'll give an in input, like no suggestions. Oh, hey you are going into this direction. We have some trouble. We are closing some roads or something like that. So then he, then you know you have any better better things and better schedule in your day. So that's how the, your your time is saved. And then you can, you can you can like in safety of your when you were driving safety is also considered. And then as, as well as the driver attention when you are driving telling me, traffic. We had you as like something. Then it'll recognize that. Then think, okay, hey, there is a traffic. You need to be alert. Then you can do that. That's how, yeah. These things are working. So let's predicting a and context context awareness. There are four things we need to be considered temporal analysis and then geo pattern intelligence and then behavioral pattern, the communication and feedback loop integration. These are designed for a different different, things like, day after week pattern recognization when you are when you are particular day, you, you are doing something like, you are able to do something, then a, predict that one then give the suggestions. And then there is another thing like, you were able to you are a AV. Electrical vehicle, your charging station, recommended charging stations. It'll give the recommended charging station. And then audio setting based on your mood, you can the a give, Hey, I'm going to set up this songs for you. Whether you agree or disagree, it's up to you. But yeah it'll give an suggestion and then behavior pattern based on your mood, based on your your preference based on your media preference. It'll it'll give an a, like an, okay, I'm playing this song and looking, okay I want to play this song, yes or no? Yes. Yeah, you could it will play then without your without, much thinking of your it automatically recognize your mood and then it'll, and then feedback. Look, that is another thing. When you are when you are like, when the a given in suggestion, but you don't like it, it's okay, but. It'll why it is rejected. It'll analyze the ai and then next time, don't repeat that. Mistakes. So that's how it yeah. This AI is working so. And then resource constraints and optimization. In the automotive industry so there are hardware limitations and then power efficiency requirements and body management and safety critical ation. So these are the main constraints for aa advancements right now there are, hardware limitations that like, one of the core hardware in the automotive industry it is to it used to be $1,200, but now it's almost three to $5,000 per need. So that's how and then the budget is also very important for the, and the space restrictions. Also, you need to be small. The electronic control unit, a CU is must be small, and as well as the doing more operation, trillions and trillions of power operation. And then second thing is battery efficiency. That in automotive industry EV ranges question for hey my, my company's doing six 50 miles per full charge. A my, my ev is like 300 miles per full charge within 15 minutes, something like that. No, power efficiency is after thing we need to consider. And then memory management then. So how many operations we are performing to the users, and then we need to show. We need to store and then deploy and then use that, those information, and then give it to the right feedback. Write write information to the try user. And then there is safety critical operation. That is the that is one of the performance determin performance guarantees. Oh, hey, my automotive industry is doing good with this operations. Something like that. So that's how it's it's working. And then there are privacy and data management. This is another thing. So privacy is the main important for for our automotive industry. Whether when you are introducing the a into the automotive industry, because of you share your personal data, because of, you shared your personal data, you shared your things to the, your car and. That needs to be stored somewhere personal. That's how and then there are different things we need to consider as an automotive automotive engineer. F first thing is. And device process only since two data are stored in locally, like in your vehicle, and then the remaining things are like, stored in cloud services and then reduce the privacy exposure to the remaining vendors. And then and the differential privacy. And then noise. Transmission and math mathematically guaranteed individual privacy while maintaining the static statistical usefulness document. These are the things, and then the federated learning that dis distributes model training across the vehicle. Keep the raw data in local, allowing the fleet wide AI operations without centralizing the personal data. So time limited storage hey I'm going to store this data like one month, three months, something like that. When you change the, it'll let automatically delete delete your data, delete your personal data, and then keep the vehicle three without any personal data. That's how privacy. We are going to introduce to the automatically systems. And then safety. As I mentioned before, automotive automotive's automotive is first thing is the safety and distraction. Distraction mitigation. So safety is the first priority. We never, we are implementing anything. Safety is the first degree reality. So what are the medications we are going to? First thing is workload. Adaptive interfaces. When the when the UI elements based, standard driving complexity, reducing the car, congregating calculating load by 43% during hiding, driving situations. And then multimodal interaction design. Whether you are using voice, a touch or architecture anything it need to be no, no need to be distract you and driving. That is another thing. There are there are couple of things we need to consider. Driver must be consultation on the road without without doing any further aggressions. Hey, touching something on the entertainment system. No. We are not doing that one 'cause of, safety is the first the first ity, and then attention and avail interruption. You, if you are talking to Thea, that's okay if you are like, if you are not concentrating and concentrating not concentrating on your driving things then that's the interruption comes into the picture and then we can notify the driver. Hey. We need to be ice on your road, ice on the road. So that's how different things mitigation we are going to implement into that safety structure, destruction, mitigation things. And then the further thing is testing and validation as, how the testing is conducted. So first thing is we are doing some basic basic testing the National Highway Traffic Safety at the administration whatever the guidelines they. They're provided. We do that some basic things and as well as the, some of the more generic principles principle verifications, and then brand specific interaction standards. And then I. Then there is a controlled environment test testing. We are like, we are tested like, only certain things and then certain behavioral analysis and then certain task we need to give to the entertainment system and then perform do observe the behavior. And then further we are we are going to develop that driving simulator validation that is just in in just in, in, in house driving. But you are giving all the feedback to the AA and then how the reaction time, and then how the it how it is working. And then the third, the fourth phase is realtime real world validation. We have in a certain drivers, we will give the vehicles to the owners. We call them test fleet owners, test fleet vehicles. And then the owners will give an a complex instruction to the AA and then how they interacted with that things. And then we can modify, and then we can rectify those things, and then we can improve our aa into the info system. And then future directions and technical group. So in the future, there are things need to be considered in our ai. So first thing is multi modern, deep deep learning. Integration of vision, audio and sensor data and unified AI model AI models, and then autonomous integration so when you are driving with hands free, hands, self driving. So you are, you don't need to be looking into the road or some like fully autonomous. You don't need to be, but semi-autonomous, yes, you need to be sometimes you don't need to be hands on the wheel like autonomous, but in that state, we need to be interacted with that aa to that autonomous inter interaction. So we have a better autonomous system. And then AI documentary reality integration. So that is that is another thing like, wind in the windshield. We can show hey. This is the information, this is the this is the weather, this is the speed you are, this is the, this is the traffic you are going to, in the, in 15 minutes or 10 minutes, something like that. And then emotionally based on your mood, based on your emotional state driver. The AA will give an advice and responded according to your modes. And then V two X vehicle to everything, communication, V two vehicle to network, vehicle to other vehicle to, a charging area, vehicle to interface. So this kind of communication is vehicle to another vehicle. Vehicle to vehicle is also another communication. So how that things are we need to looking into that one. So this is how a we we will use into that automotive industry and then we will focus more on the deep learning models and as well as the, how the. A is interacted with infotainment system and then as well as the autonomous integration into data infotainment system will achieve a better and bright automotive systems. Thank you so much and thank you.
...

Ravinder Katla

Advanced infotainment systems integration engineer @ General Motors

Ravinder Katla's LinkedIn account



Join the community!

Learn for free, join the best tech learning community for a price of a pumpkin latte.

Annual
Monthly
Newsletter
$ 0 /mo

Event notifications, weekly newsletter

Delayed access to all content

Immediate access to Keynotes & Panels

Community
$ 8.34 /mo

Immediate access to all content

Courses, quizes & certificates

Community chats

Join the community (7 day free trial)