Welcome back!

AI is reshaping industries, with several disruptive developments this week. OpenAI's GPT-4o showed impressive vocal capabilities for customer service. Google is fundamentally reimagining its iconic Google Search with AI-generated results, potentially impacting the entire search marketing and advertising industry. Let's explore...

Today’s Summary:

• GPT-4o capabilities and applications

• Med-Gemini medical AI understands 3D scans

• Google Search fundamental changes

• Instagram co-founder joins Anthropic

• AWS chief steps down

• Elon Musk's xAI potential $10B deal with Oracle

• Nvidia's Blackwell AI Superchips $3M servers

• 3 new tools

TOP STORY

GPT-4o New Capabilities and Industry Impact

The Summary: New demos and insights about GPT-4o are unveiling more of its potential.

• This video shows GPT-4o's impressive skills in customer service conversations. Two agents fix a customer’s issue with a broken iPhone, showing GPT-4o's big potential for customer interactions. This feature is currently unavailable in ChatGPT.

• The following image shared today was generated by the new GPT-4o native image model. This feature is currently not available in ChatGPT, which still uses DALL-E 3 for image generation. But it shows what’s coming soon: perfect text rendering with accurate spelling and styling consistency.

• GPT-4o widens the IQ gap between closed models and open-source models again, based on Elo benchmark data of GPT-4o's text performance.

Why it matters: These insights show GPT-4o's expanded capabilities beyond text generation. Rendering images with perfectly legible text is a feat unmatched by previous models, and the customer service voice demo hints at potential to transform industries. However, these advanced features are still unreleased and will require thorough testing and scrutiny when they become available in the coming weeks. Meanwhile, this lead allows OpenAI to drive the narrative and set the agenda for the evolution of AI models.

MED-GEMINI

Med-Gemini Medical AI understands 3D Scans and Genomic Data

The Summary: New insights reveal the advanced capabilities of Google's Med-Gemini, the powerful medical AI that understands multimedia data. Upgraded 2D and 3D multimodal encoders allow Med-Gemini to seamlessly interpret 3D medical scans like CT and MRI.

Key details:

• Enables understanding of volumetric radiological scans

• Over 50% of Med-Gemini's head CT reports matched radiologists' primary findings

• Achieves new state-of-the-art on chest X-ray visual Q/A

• First model to predict disease risk across 14 conditions from genomic data alone

• Outperforms linear polygenic risk scores by leveraging genetic correlations

• Uses web retrieval to access the latest medical information

Why it matters: The ability to understand 3D anatomy and genomics from raw data streams could open new frontiers in AI-assisted diagnosis, treatment, and research. While still investigational, Med-Gemini offers a powerful glimpse into multimodal AI medicine.

Source:
Yang, Lin, et al. Advancing Multimodal Medical Capabilities of Gemini

GOOGLE

Google Search Fundamental Changes

The Summary: Google is fundamentally reimagining its iconic Google Search with new AI features. The company is launching AI-generated overviews as reorganized result pages powered by custom AI, moving away from the classic “10 blue links” for some categories of queries. Google aims to provide more direct answers to users while still sending traffic to websites. Many consider this a fundamental change that will have major implications for search marketing and advertising.

Key details:

• The new AI content will appear at the top of search pages for “complex queries”

• Search results may be reorganized into sub-categories like "dine-in" or "open now" based on the query

• The changes will begin to roll out this week to US users first, expanding to more countries later

• Google says the AI overviews still link to websites, aiming to drive traffic

• A new “Web” filter in the top bar allows users to go back to the old links-only page

Why it matters: Google Search is being fundamentally reshaped by AI to provide more personalized results. Google will leverage AI to directly provide answers, rather than just a list of links. This could impact traditional search traffic to websites and reshape the search advertising industry. It represents a turning point for Google's most crucial product.

QUICK NEWS

Quick news

• Instagram co-founder Mike Krieger joins Anthropic, the company behind Claude 3, as Chief Product Officer

• AWS chief steps down as Amazon navigates AI integration and competitive pressures

• Elon Musk's startup xAI is reportedly in talks with Oracle about a $10 billion cloud-computing deal. Oracle stock rose by 5.3%

• Nvidia's next-gen Blackwell AI Superchips could cost up to $70,000 a piece and up to $3M for a full server rack.

TOOLS

🥇 New tools

• Lune AI - Learn a new language with an AI tutor in your pocket

• Glitter AI - Create written documentation just by speaking