Muse AI Integration
Just a couple of weeks after launching Muse, Meta announced that it is working on bringing the agent to its smart glasses, including the new models unveiled at Meta Connect. Users will be able to activate Muse from their glasses by saying its name and ask it to handle tasks like guiding a workout, logging meals, or helping them shop for products they are looking at.
New Accessibility and Audio Updates
Meta's AI agent is arriving on its glasses alongside a wave of new accessibility, camera, and navigation features.
Muse is just one of several major updates coming to Meta's glasses. They are also getting new accessibility features, like a Hearing Enhancement feature Meta says is FDA-cleared software for adults with perceived mild to moderate hearing loss. It will be available later this year with a Meta One subscription or as a $149 add-on for compatible glasses. Meta AI will also be able to give more context-rich answers when users ask the glasses what they are looking at, potentially making Meta's glasses more effective for helping blind and low-vision users interpret their surroundings. A new audio customization feature will also allow users to shift their smart glasses' volume between their left and right ears, including sending all audio to one side.
Capture and Hologram Features
Meta is introducing new audio and photo features as well, including Dolby Atmos Capture, which will allow users to record videos with 360-degree spatial audio. A new Dynamic Photo feature automatically captures multiple frames when you take a photo with Meta's glasses, then uses Meta AI to suggest the best frame from each batch.
The Meta Ray-Ban Display glasses are getting the new Hologram feature Meta announced for its new VR Glasses, which it describes as a photorealistic digital version of your face for calls from Meta Ray-Ban Display that infers your expression using your voice. The feature is rolling out in Early Access on WhatsApp to Meta Ray-Ban Display users in the US later this fall.
Heads-Up Navigation
A couple of new heads-up navigation features are coming to the Meta Ray-Ban Display as well. Starting later this month, users in the US and Canada will have an option to use their voice to ask for real-time cycling or public transit directions. The Meta Ray-Ban Display will also start using the world in front of you rather than street signs in turn-by-turn walking directions, like referencing a house, car, or landmark the glasses detect. A few other new features are on the way for the Display glasses, including an option for editing photos directly on the glasses' display, a new Explore app for finding new apps, an improved calendar, and mirroring for phone notifications.
