- The Rundown AI
- Posts
- Meta's new AI video generator
Sign Up | Advertise | Podcast | AI University
Welcome, AI enthusiasts.
Meta just stepped into the AI video generation arena with a blockbuster release that's set to give OpenAI's Sora a run for its money.
But as ‘Movie Gen’ prepares to hit Instagram, is the world ready for the content creation revolution it might unleash? Let’s get into it…
In today’s AI rundown:
Meta unveils advanced AI video model
OpenAI and Altera create digital humans
Run Llama 3.2 locally on your phone
AI identifies drug candidates for pain relief
5 new AI tools & 4 new AI jobs
More AI & tech news
Read time: 4 minutes
LATEST DEVELOPMENTS
META
Image source: Meta
The Rundown: Meta just announced Movie Gen, a powerful new suite of AI models for generating and editing video and audio content, positioning itself as a direct competitor to OpenAI’s Sora and other industry leaders.
The details:
Movie Gen consists of four models: a 30B video generation model, a 13B audio model, a personalized video model, and a video editing model.
The system can generate HD videos up to 16 seconds long from text prompts, along with synchronized audio like sound effects and background music.
Movie Gen also features video editing via natural text prompts and the ability to upload a reference image to create personalized videos.
Meta claims the model outperforms rivals like Runway Gen3, Luma Labs, and OpenAI’s Sora in human video quality and consistency evaluations.
Meta CEO Mark Zuckerberg said that Movie Gen will be ‘coming to Instagram next year’ in a post displaying some of the model’s sample generations.
Why it matters: Meta’s Movie Gen separates itself from other video generators by not only generating videos from text, but also being able to perform precise video editing. With the models coming to Instagram, it could transform the content creation process and give the masses a powerful video editing suite—with only prompting required.
TOGETHER WITH INTERCOM
The Rundown: Join visionary customer service leaders on Oct.10 to explore the impact and opportunities of AI on the industry.
At Intercom’s customer service summit, you’ll discover:
Practical strategies to seamlessly integrate AI with your support team
An exclusive preview of Intercom’s advanced AI agent, Fin 2
Insights from companies successfully scaling support without added headcount
Register here to watch the summit live or on demand.
ALTERA
Image source: OpenAI
The Rundown: OpenAI just published a case study on Altera, a startup using GPT-4o to develop AI agents called "digital humans" capable of prolonged, natural interactions with people — significantly outperforming other rivals during testing in Minecraft.
The details:
Altera, founded by ex-MIT professor Dr. Robert Yang, uses GPT-4o to power AI agents that can play Minecraft autonomously for up to 4 hours.
Altera's system combines GPT-4o with a brain-inspired multi-module architecture to simulate cognitive functions and emotional processing.
OpenAI reports that Altera's agents outperform other models in Minecraft tasks, collecting 32% of items compared to 6.4% for the next best model.
The startup plans to expand beyond gaming to create AI ‘coworkers’ and more complex multi-agent simulations.
Why it matters: We’ve constantly heard from Sam Altman and others that AI agents are coming fast — and case studies like this (as well as a cryptic ‘Level 3’ tweet from an OpenAI researcher) might mean the capabilities have already arrived. We might ascend the ‘Stages of AI’ ladder faster than most are anticipating.
AI TRAINING
The Rundown: Meta’s new Llama 3.2 3B model can run directly on your smartphone, allowing you to have AI conversations privately and offline.
Step-by-step:
Download PocketPal AI from the App Store.
Open the app, tap the top-left menu, and select "Models.”
Under "Llama,” download "llama-3.2-3b-instruct q4_k" (2.2 GB).
Once downloaded, tap "Load" to activate the model.
Return to the main menu, select "Chat,” and start conversing with AI!
Pro tip: Create a local knowledge base that can be queried alongside the model, allowing you to supplement the AI’s knowledge with custom, up-to-date information without requiring an internet connection.
PRESENTED BY ASSEMBLY AI
The Rundown: AssemblyAI’s Speech-to-Text API unlocks industry-leading accuracy — allowing you to build voice bots, meeting transcribers, and more with unmatched quality and advanced AI features.
With AssemblyAI, you can:
Transcribe multiple languages with up to 95% accuracy
Detect speakers with precision
Integrate effortlessly with just 5 lines of code
Future-proof your applications. Start today and claim $50 in API credits.
AI RESEARCH
Image source: Midjourney
The Rundown: Researchers at Cleveland Clinic and IBM just developed an AI model to predict how drugs and gut microbes interact with pain receptors, potentially uncovering new non-addictive pain treatments.
The details:
LISA-CPI analyzes both the molecular structure of compounds and the 3D shape of pain receptors to predict their interactions.
The model identified FDA-approved drugs, like methylergometrine, that could potentially be repurposed for pain treatment by targeting specific receptors.
LISA-CPI also discovered gut microbes that may interact with pain receptors in beneficial ways.
The approach could accelerate drug discovery for pain and other conditions by more accurately screening potential compounds.
Why it matters: The current opioid crisis highlights the urgent need for effective, non-addictive pain medications, and this AI-driven approach could help researchers more quickly identify promising drug candidates while also opening new avenues for pain management.
NEW TOOLS & JOBS
👨💼 Cheatlayer - Automate your business using natural language
🤝 Mindpal’s SalesBox - Build your own AI sales OS with multi-agent workflows
🤑 Trillion - Track expenses, manage accounts and set financial goals with AI planning
🛒 BuyScout - Your AI copilot for online shopping
🗓️ Selfletter - Break complex goals into simple tasks with AI
🖥️ Amazon Web Services (AWS) - ML Data Associate
🧠 Meta - Research Scientist Intern
🔧 Shield AI - Mechanical Engineering Intern
📈 DeepL - Product Marketing Manager
QUICK HITS
Free event: The AI Bill of Rights with Section. How the White House’s Dr. Alondra Nelson is thinking about bias, ethical AI, and the future. RSVP now.*
Apple will reportedly release its Apple Intelligence features on Oct. 28 alongside the iOS 18.1 update, according to Bloomberg insider Mark Gurman.
Google began rolling out the new AI anti-theft features for Android devices showcased at Google I/O, including Theft Detection Lock, Offline Device Lock, and Remote Lock.
Cohere launched improved fine-tuning features for its Command R LLM, including longer context support and a ‘bring your own fine-tune’ option.
AI startup Otherside AI’s Reflection 70B model failed to match performance claims in tests published by the team in a post-mortem of the release after being initially touted as the ‘world’s best open-source model.’
North Carolina musician Michael Smith faces federal charges for allegedly using AI to generate thousands of songs and bots to stream them billions of times, netting over $10M in royalties.
*Sponsored listing
THAT’S A WRAP
That's it for today!Before you go we’d love to know what you thought of today's newsletter to help us improve The Rundown experience for you. |
See you soon,
Reply