Meta AI Gets Voice Mode, Celebrity Voices, and Translation for Reels

Meta AI Enhances User Interaction with Voice Mode and Translation Features

Meta is significantly upgrading its AI assistant, Meta AI, introducing a new voice mode and advanced translation capabilities, as announced at the Meta Connect 2024 developer conference. These updates aim to make Meta AI more interactive and accessible across its platforms, including Instagram, Messenger, WhatsApp, and Facebook.

Voice Mode and Celebrity Voices

Meta AI can now respond to user queries audibly. A key highlight of this new feature is the integration of AI-generated voices from several well-known celebrities, including Awkwafina, Dame Judi Dench, John Cena, Keegan-Michael Key, and Kristen Bell. This move is intended to enhance user engagement and provide a more personalized experience. However, unlike OpenAI's ChatGPT Advanced Voice Mode, which focuses on emotional expressiveness, Meta AI's voice mode is described as being more akin to Google's Gemini Live, which transcribes speech and then provides an AI-generated spoken response.

Meta has reportedly invested millions in securing the likenesses and voices of these celebrities, a strategy aimed at drawing users to its AI offerings. While the effectiveness of this strategy remains to be seen, the company is betting on the star power to make a difference.

Image Analysis Capabilities

In addition to voice features, Meta AI has been enhanced with the ability to analyze images. Users can now upload photos and ask Meta AI to identify objects, such as a type of flower, or provide instructions on how to prepare a dish. This visual understanding capability leverages upgrades to the underlying AI models powering the assistant.

AI-Powered Translation for Instagram Reels

A significant new feature being piloted is an AI translation tool for Instagram Reels. This tool automatically translates a creator's speech, dubs it into another language, and crucially, auto-lip-syncs the translated audio to match the creator's original lip movements. This aims to break down language barriers and make content more globally accessible.

Meta is currently conducting small-scale tests of this Reels translation feature on Instagram and Facebook. Initially, it will be available for select creators' videos from Latin America within the U.S., supporting both English and Spanish.

Strategic Context and Future Implications

These advancements position Meta AI as a more versatile and engaging digital assistant. The integration of celebrity voices and advanced translation tools reflects a broader trend in the AI industry towards more human-like and context-aware interactions. The company's investment in AI, particularly in areas like voice and translation, underscores its commitment to shaping the future of social media and digital communication.

Event Promotion

The article also includes promotional content for "TechCrunch All Stage," an event in Boston on July 15, 2025, offering insights from founders and VCs. Attendees can save up to $475 on passes, with the event focusing on strategies, workshops, and networking opportunities for various stages of startups.

Key Takeaways:

Voice Mode: Meta AI now offers an audible response feature.
Celebrity Voices: AI voices of Awkwafina, Judi Dench, John Cena, Keegan-Michael Key, and Kristen Bell are integrated.
Image Analysis: Meta AI can now identify objects and provide information from uploaded images.
Reels Translation: A new tool auto-translates and lip-syncs audio for Instagram Reels.
Global Accessibility: These features aim to enhance user interaction and break down language barriers.
Strategic Investment: Meta is investing heavily in AI, including celebrity voice partnerships.