The Summary AI
Posts
🚀 Meta Debuts Voice & Llama 3.2 Vision

🚀 Meta Debuts Voice & Llama 3.2 Vision

PLUS: OpenAI CTO Mira Murati Quits

The Summary AI
September 26, 2024

Welcome back!

At its Connect event, Meta released Llama 3.2 with multimodal capabilities, alongside new models optimized for smartphones and real-time voice mode for Meta AI, enabling natural conversations across its platforms. Meanwhile, OpenAI faces a leadership shakeup, with CTO Mira Murati and two key research leaders departing. Let’s dive in…

Today’s Summary:

🎤 Meta AI gets voice mode
🤖 Meta launches Llama 3.2 multimodal models
🚪 OpenAI loses CTO Mira Murati, McGrew, and Zoph
🎵 Spotify unveils AI Playlists
📱 Google adds Gemini to Workspace
🎬 James Cameron joins Stability AI Board
✨ Snap My AI powered by Gemini
🛠️ 2 new tools

TOP STORY

Meta AI gets voice mode

The Summary: At its Connect event, Meta unveiled several AI advancements, including real-time voice mode for Meta AI, enabling natural conversations across its platforms. Other updates include AI Studio for building custom AI personas and automatic video dubbing for Reels.

Source: Meta

Key details:

Meta Al now supports voice conversations across Instagram, WhatsApp, Messenger, and Facebook
Meta AI can answer questions about your photos and edit them
Al Studio enables creators to develop personalized Al assistants
Automatic video dubbing for Reels includes lip-syncing technology

Why it matters: Just one day after OpenAI’s worldwide release of Voice Mode for paying users, Meta launched its own version to all its free users, instantly reaching hundreds of millions globally. By offering these features for free, Meta is positioning itself as a key player in AI accessibility for the general public, directly challenging other competitors.

Demo

Meta unveils Llama 3.2 multimodal open-source AI

The Summary: Meta has released Llama 3.2, expanding its open-source AI model family with vision capabilities. The update includes 11B and 90B vision models that rival closed-source alternatives, as well as lightweight versions for smartphones. Meta also introduced Llama Stack, to simplify development and deployment of AI applications.

Source: Meta

Key details:

Llama 3.2 includes 11B and 90B vision models for image understanding tasks, reaching GPT-4o-mini level (not available in the EU)
New 1B and 3B text-only models optimized for on-device use with 128K token context length
Models are available on HuggingFace
Llama Stack introduced for easier deployment across cloud, on-prem, and edge environments
Llama Guard 3 model for content safety classification released with vision capabilities and a lightweight 1B version for on-device safety checks

Why it matters: Meta's focus on open-source AI models challenges competitors like OpenAI and Google, driving further innovation. By freely releasing open-source powerful multimodal models with vision support, Meta is empowering the developer community to build versatile AI applications that can run securely on local devices.

Try Llama 3.2 11B Multimodal in HuggingFace

OPENAI

OpenAI loses CTO Mira Murati, research leaders McGrew and Zoph

The Summary: OpenAI faces a major leadership shakeup as three top executives departed within hours. CTO Mira Murati, Chief Research Officer Bob McGrew, and Research VP Barret Zoph have all announced their resignations. CEO Sam Altman revealed plans for leadership transitions, emphasizing the moves were independent and amicable. This exodus comes amid rumors of a potential restructuring of OpenAI from a nonprofit to a for-profit entity.

Key details:

Murati, McGrew, and Zoph exits follow recent departures of other high-profile executives
VP of research Mark Chen promoted to SVP, leading with Jakub Pachocki as chief scientist
Reports suggest OpenAI may restructure as a for-profit benefit corporation
Altman could receive a 7% equity stake in OpenAI if restructuring occurs

Why it matters: The repeated leadership changes at OpenAI could affect the company’s trajectory. Shifts in OpenAI’s structure and funding may influence the broader AI ecosystem. The potential move to a for-profit model raises questions about balancing commercial goals with OpenAI original mission.

Altman's transition announcement