ChatGPT levels up with 'Canvas'

PLUS: Automate video analysis with AI

Welcome, AI enthusiasts.

OpenAI just painted a new picture of AI collaboration with its ‘Canvas’ feature — and ChatGPT may be about to level up in a major way.

Is this new feature a glimpse at the next stage for AI assistants? Let’s get into it…

In today’s AI rundown:

  • ChatGPT gets a collab boost with Canvas

  • Google rolls out ads in AI Overviews

  • Automate video analysis with Gemini AI

  • Black Forest Labs unveils Flux 1.1 Pro

  • 5 new AI tools & 4 new AI jobs

  • More AI & tech news

Read time: 4 minutes

LATEST DEVELOPMENTS

OPENAI

Image source: OpenAI

The Rundown: OpenAI just launched Canvas, a new ChatGPT interface release that enables more collaborative writing and coding projects beyond simple chat interactions with new editing features, shortcuts, and added contextual knowledge.

The details:

  • Canvas opens in a separate window alongside the chat, allowing users to directly edit and refine specific aspects of an output.

  • New features include inline feedback, targeted editing, and shortcuts for tasks like adjusting text length, changing reading levels, or debugging code.

  • In tests, using GPT-4o with Canvas led to a 30% accuracy and 16% quality boost compared to using the model without the interface.

  • Canvas is rolling out in beta to Plus and Team users, with a broader release expected later.

Why it matters: ChatGPT’s first major UI change takes a leap towards more nuanced, moldable interactions — while also inheriting novice-friendly features seen in other rivals with easy-to-use shortcuts. The simple chatbox was a good first step for human-AI interactions, but more power and capabilities require new collaborative processes.

TOGETHER WITH DECIDR

The Rundown: Decidr boosts conversions and efficiency by automating 80% of processes in finance, marketing, sales, HR, and more. Its AI solution helps businesses drive conversions and streamlines operations across industries.

Attend Decider’s Product Launch Day on Oct. 23 to learn how to:

  • Implement AI quickly with fast deployment options Optimize costs by streamlining operations with AI

  • Apply AI across every aspect of your business

  • Add real world-value through proven success stories across industries

Register now to start transforming your business with AI.

GOOGLE

Image source: Google

The Rundown: Google just announced the introduction of ads to its AI Overview search summaries and the launch of several new AI-powered search capabilities, such as video understanding and voice input.

The details:

  • Ads will now appear within and alongside AI Overviews for ‘relevant queries’ on searches in the United States.

  • The redesigned AI Overview format will now add prominent in-text links to better source websites for the curated information.

  • New AI-organized search results pages are rolling out that surface relevant, more diverse content — starting with recipe and meal inspiration queries.

  • Google Lens is getting video understanding capabilities and voice input options for visual searches.

  • The Android ‘Circle to Search’ feature also lets users identify songs playing in videos or streaming content.

Why it matters: Google’s first AI Overview experience didn’t exactly go as planned. However, with heavy competition from Perplexity and chatbot rivals, Google’s search future clearly has AI at its core, regardless of the bumps along the way. But infusing paid ads into AI Overviews could be a slippery slope – will Gemini be next?

AI TRAINING

The Rundown: Google Gemini on AI Studio can analyze videos and provide transcripts, tags, subtitles, and translations to simplify and speed up your content creation workflow.

Step-by-step:

  1. Access Google Gemini on AI Studio and select "Gemini 1.5 Pro 002" from the Models menu.

  2. Upload your video and use this prompt: "Analyze this video and provide the transcript, 5 title ideas, and categorized tags."

  3. Follow up for improvements: "Suggest 5 content improvements, 3 promo clip ideas with timestamps, reach expansion tips."

  4. Implement insights to optimize SEO, create promo clips, and expand your audience reach through translation.

Pro tip: Regularly analyze your video content with Gemini to track improvements and identify trends in your content over time.

PRESENTED BY POSTMAN

The Rundown: Postman is hosting a free webinar on Oct. 24th to help you navigate the explosive growth of APIs and the crucial role they will play in shaping the AI revolution.

In this session, you'll learn to:

  • Understand the critical role APIs play in the AI landscape

  • Build high-quality APIs at scale

  • Maximize the success of your API products

BLACK FOREST LABS

Image source: Black Forest Labs

The Rundown: Black Forest Labs just released Flux 1.1 Pro, a significantly upgraded version of the startup’s text-to-image AI model, and a new API for developers.

The details:

  • Flux 1.1 Pro generates images six times faster than Flux 1 Pro while improving quality and prompt output adherence.

  • The model tops the Artificial Analysis image arena leaderboard against rivals like Midjourney, Ideogram, and DALL-E, tested under the codename ‘blueberry.’

  • 1.1 Pro will be a paid model available through partners like Together AI, Replicate, FAL AI, and Freepik, unlike the open-source Flux 1 that powers xAI’s Grok.

  • BFL’s API allows third parties to integrate the model into their apps, and the 1.1 Pro model costs .05c / image.

Why it matters: From OpenAI’s strawberry to BFL’s blueberry, fruit codenames are having a moment! 1.1 Pro looks to raise the already incredibly high text-to-image bar, continuing to push the boundaries of realism and image generation quality — now equipped with a turbocharged speed increase as well.

NEW TOOLS & JOBS

  • 🐝 Buzzabout - AI-driven insights from billions of discussions on social media

  • 🤖 Base AI - Build serverless, autonomous AI agents with memory

  • 💸 CostGPT - Estimate costs and time for your software project in less than 5 minutes

  • 👀 Lookie AI - Consume, organize, and manage knowledge from YouTube

  • ⏱️ Tackle AI - Automatic time tracking to align everyday actions with key priorities

QUICK HITS

OpenAI’s Sora research lead Tim Brooks announced on X that he is leaving the company to join Google DeepMind, where he will work on ‘video generation and world simulators.’

Google released Gemini 1.5 Flash 8B, a lightweight, cost-effective variation with a 50% cost reduction and 2x higher rate limits than 1.5 Flash.

Fourier launched GR-2, the company’s second-generation humanoid robot, which features improvements to battery life, hand dexterity, mobility, and a new developer kit.

The U.S. Commerce Department unveiled a plan to award $100M for AI semiconductor research, hoping to spur the development of more sustainable materials.

OpenAI secured a new $4B credit facility from major banks, boosting its total liquidity to over $10B to fuel future growth and innovation.

AI Coding startup Poolside announced a $500M Series B funding round to accelerate progress towards AGI, bringing the company’s valuation to $3B.

THAT’S A WRAP

That's it for today!

Before you go we’d love to know what you thought of today's newsletter to help us improve The Rundown experience for you.

Login or Subscribe to participate in polls.

See you soon,

Rowan, Joey, Zach, and Alvaro—aka The Rundown Team

Reply

or to participate.