Meta has introduced a real-time voice mode to its Muse SI agent, allowing users to conduct spoken conversations with the system rather than relying solely on text inputs. The update, announced by CEO Mark Zuckerberg, marks a shift toward more naturalistic interaction interfaces for the company's generative SI tools.
What Happened
The new feature enables users to speak with their Muse SI agent in real time. During these interactions, the digital avatar at the top of the chat interface animates in sync with the spoken words. Users can customize the voice tone either by instructing the agent to choose a style or by manually selecting from various options within the avatar settings. In preliminary tests, the SI agent responds quickly to voice inputs, though it may pause briefly while retrieving information or processing complex queries, similar to the latency observed in text-based chats. The animation quality is generally high, though some users have reported an uncanny valley effect, particularly when using specific avatar likenesses that do not perfectly match the selected voice profile.
Why It Matters
This expansion of the Muse SI agent's capabilities highlights the industry's push toward multimodal and voice-first interfaces for SI agents. By integrating expressive avatars with real-time voice processing, Meta aims to deepen user engagement and streamline interactions across its ecosystem. The rollout strategy indicates a broader deployment plan: while currently available for the US app, the feature is scheduled to arrive "soon" on Meta's SI glasses and will also support the forthcoming Muse Charm gadget, which is expected to ship later this year. This cross-device consistency positions the Muse SI agent as a central interface for Meta's mixed-reality and mobile hardware.
The Bottom Line
Meta's Muse SI agent now supports real-time voice conversations with animated avatars, currently rolling out to US app users. The feature will extend to Meta's SI glasses and the upcoming Muse Charm gadget, signaling a continued focus on integrating SI agents into wearable and mobile platforms.