Google Introduces Native Audio Model in Gemini Live API Preview
Google has released a significant upgrade to its Gemini Live API, now featuring a native audio model in preview. This update is designed to make voice-based AI agents more natural and dependable during real-time conversations.
Key Improvements: Natural Conversations & Smarter Function Calling
In a recent social media announcement, Google highlighted two major advancements: improved function calling capabilities and enhanced support for more natural conversational flow.
Smarter Function Calling for Real-Time Use Cases
Function calling enables voice agents to access external services or real-time data—ideal for actions like scheduling appointments or retrieving live updates. With the latest model, the accuracy of individual function calls has been doubled, and multi-step function call scenarios have seen marked improvements. This upgrade is especially vital for real-time interactions, where speed and reliability are essential.
More Human-Like Interactions
The second major enhancement focuses on improving the fluidity and realism of conversations. The updated model is better at handling natural speech patterns, including interruptions, pauses, and background dialogues. For example, it can pause when background noise or side discussions occur, and then resume the conversation seamlessly—making the interaction feel less robotic and more intuitive.
Smarter Pause and Interruption Handling
Google noted that internal testing shows the model now avoids unnecessary interruptions when users pause briefly to think. Additionally, it can now accurately detect intentional interruptions by users, allowing the agent to respond appropriately in dynamic conversations.
What’s Coming Next: Thinking Time for Complex Queries
Looking ahead, Google plans to introduce a “thinking” feature—allowing the model to take a short pause when processing more complex or nuanced queries, mimicking how a human might take a moment before responding thoughtfully.
Among the early adopters is Ava, an AI-powered family assistant platform. According to Google, partners like Ava have reported better performance in noisy environments and fewer workarounds needed for prompting, thanks to this upgrade.know more
