Meta Expands Muse Assistant with Glasses Integration and New Features

What is Muse and How It Works

Meta’s Muse is a conversational assistant that lives across the company’s ecosystem. It can answer questions, manage schedules, and control connected devices using natural language. The assistant is built to understand context, remember preferences, and adapt to individual usage patterns.

New Features Unveiled at Connect

During the Connect keynote, Mark Zuckerberg highlighted several enhancements that will make Muse more capable and user friendly.

Expanded Voice Command Library

Developers have added hundreds of new phrases that cover everyday tasks such as setting reminders, searching for local events, and controlling media playback. Users can now ask Muse to "find a quiet café nearby" or "start a group video call" without needing to specify the app.

Richer Visual Responses

Muse will present information in richer visual cards that include images, maps, and interactive buttons. For example, when asked for flight details, the assistant will display a card with departure time, gate number, and a button to add the flight to the calendar.

Improved Context Retention

The assistant now retains conversational context across longer interactions. If a user asks "What’s the weather tomorrow?" followed by "Will I need an umbrella?", Muse can link the two queries without repeating the location.

Privacy‑Centric Controls

Meta introduced granular privacy settings that let users decide which data categories Muse can access. Options include limiting location sharing, disabling conversation history storage, and opting out of personalized suggestions.

• Location can be set to "always", "while using", or "never".
• Conversation logs can be auto‑deleted after a chosen period.
• Personalized recommendations can be turned off entirely.

Muse Integration with Meta Glasses

The headline announcement was that Muse will be available on Meta’s upcoming glasses. This integration means users can interact with the assistant hands‑free, seeing visual cards projected onto the lenses.

How Interaction Works

Users will activate Muse by tapping the side of the frame or using a voice trigger. The assistant’s responses appear as floating overlays that stay in the user’s field of view. Simple gestures, such as a quick blink, can dismiss a card.

Use Cases for Glasses

1. Navigation assistance while walking or cycling.
2. Quick access to calendar events during meetings.
3. Real time translation of spoken language displayed as subtitles.

These scenarios illustrate how Muse on glasses could become a natural extension of daily routines.

Privacy and Safety Measures

Meta emphasized that the glasses will process voice input locally whenever possible, reducing the amount of data sent to the cloud. When cloud processing is required, the data will be encrypted in transit and stored only with user consent.

Additional safety layers include:

• On‑device keyword detection that never records audio unless the wake phrase is spoken.
• Transparent logs that show exactly what information was accessed.
• Regular third‑party audits to verify compliance with privacy standards.

Developer Opportunities

Meta opened its Muse platform to third‑party developers, offering new APIs that let creators build custom skills for the assistant. These skills can be published in a marketplace that users can browse from their phones or glasses.

Key API Enhancements

• Access to the visual card rendering engine for richer UI.
• Event‑driven triggers that allow skills to respond to sensor data from the glasses.
• Fine‑grained permission scopes that align with the new privacy controls.

Developers interested in building for Muse can find documentation on Meta’s official developer portal.

What Users Can Expect Next

Meta plans to roll out the glasses integration in phases. Early adopters will receive a beta version of Muse on the device, followed by a broader release later in the year. Feedback collected during the beta will shape final refinements.

In parallel, Meta will continue to add new voice commands and visual templates, ensuring that the assistant remains relevant as user needs evolve.

For more details, see the Meta official blog and the Connect event page. Coverage of the announcement can also be found in The Verge. Academic perspectives on conversational assistants are discussed in a recent study from Stanford University.