At CES in Las Vegas, the three-pointed star unveils the new generation of the system which, thanks to artificial intelligence, the Mbux virtual assistant makes human-like interaction possible by exploiting vocal interaction and 3D graphics. Furthermore, in collaboration with will.i.am and Amazon, Mercedes redefines the sound signature of its cars and allows listening to podcasts and audiobooks in Dolby Atmos quality

MBUX Virtual Assistant transforms the car-driver relationship with natural, conversational interaction.

At the Consumer Electronics Show 2024 which opens today in Las Vegas, Mercedes presented its new vision of a hyper-personalized user experience via the proprietary mb.os car operating system. Announced last year, it is starting to take shape with several interesting innovations both from the point of view of human-machine interaction and from that of advanced audio functions. Among the innovations introduced, the most striking is certainly the Mbux virtual assistant, which is based on generative artificial intelligence and extended linguistic models (LLM) to communicate with the pilot in a natural and personalized way. This is not the implementation of ChatGpt, announced here in Las Vegas today by Volkswagen and in recent months by Stellantis through the DS brand, but a proprietary solution that allows Mercedes complete control. This development extends the Hey Mercedes voice assistant into a completely new visual dimension, created with the high-resolution graphics of the Unity graphics engine, initially created for the development of video games with advanced graphics.

MBUX SOUND DRIVE transforms an already exceptional Mercedes-AMG driving experience into an emotional, musical journey.

The key word of the new solution is “empathy”: Mercedes claims, in fact, that the effect is similar to a conversation with a friend. The assistant answers questions based on general knowledge and can also ask questions to clarify intentions and draw conclusions. By being predictive, she can also offer proactive suggestions and routines based on the context of the situation and learned behavior. The basic principle is, in fact, to offer a seamless interaction that exploits the best of vocal and graphic interfaces. The system can offer helpful suggestions based on learned behavior and the context of the situation. For example, in the morning it can play the latest news or, at the end of the day, start a massage program. And if we are late for a meeting on the calendar, the system itself recommends contacting whoever is waiting for us by dialing the number directly from the car. The experience can be further increased by integrating ambient lighting and vehicle audio: a massage will be even more relaxing if accompanied by warm light and ambient music. The Mercedes operating system will be introduced starting from vehicles of the upcoming Mercedes-Benz Modular Architecture (MMA) platform and is visible on the CLA-Class Concept, previewed here.

Navigation combines assistance with route guidance for a seamless driving experience.

In addition to music, Mercedes-Benz customers will be able to listen to podcasts, audiobooks and audio games in Dolby Atmos for the first time. The occupants will be projected into the center of the story being told, surrounded by immersive sound with an uncommon multidimensional spatiality and clarity, thanks to the integration of the Dolby Atmos immersive audio experience with Mercedes’ Burmester 4D and 3D surround sound system. The integration of the Audible and Amazon Music apps into the Mbux system will allow customers immediate access to the catalog of audiobooks, original songs, podcasts and music, with various titles in Dolby Atmos (subscription).

The car becomes a musical instrument thanks to Mbux Sound Drive

Thanks to the collaboration with rapper will.i.am (founder and producer of the Black Eyed Peas), Mercedes has developed software that allows music to react to driving style and thus make the car a sort of virtual musical instrument. Using a series of sensors and advanced software, Mbux Sound Drive interprets various driving dynamics, such as recovery, acceleration, steering and braking, and converts them into musical expressions, allowing the driver to “compose” in time real. Offering an immersive sound experience is only part of the story: the long-term goal is to transform this technology into an open music platform. Artists around the world could create songs in a new immersive audio format using Mbux Sound Drive software. The rollout of this original solution will begin in mid-2024 and will be available on Mercedes-AMG and Mercedes-Benz models equipped with the second generation Mbux system.