AI Film News | January 27, 2024

Here’s the latest news in the world of AI Filmmaking.

AI Film News | January 27th, 2024

In this video, we talk about some of the latest new technology in AI Filmmaking and what you need to know. We also highlight some incredible AI Filmmaking projects. You can find the links shown in the video below.

Join Our Newsletter for the Latest AI Filmmaking News.
Check out our AI Filmmaking Course.

Here is a breakdown of the news from the video.

Google Demos Their New Video Tool - Google dropped a demo of their Lumiere model last week. The tool has most of the same features as Runway and Pika (text-to-video, image-to-video, inpainting, etc.). But the big difference is in how it creates video. While Runway and Pika use keyframe-driven generation approaches, this model interprets and predicts the entire scene using Space-Time architecture. TL;DR it looks better in most cases.

Motion Brush Madness - David on X pushed the new Motion Brush tool to the limit, Runway shared how you can create facial expressions with the tool, and they even showed you how to create a dolly zoom effect with the tool. I created a demo in the webshow on this technique as well. 

Runway Dropped New Mags - Runway's online store has a few different magazines and books all about AI and art. They are all (of course) beautiful and well-curated, but our favorite has to be 'A Dog's Guide to the Future of AI'. This will be handy because every time I talk to my dog about AI they seem to confuse Neural networks and Deep Learning. 

Enhance Your AI 3D Models - Martin Nebelong created a really cool demo showing how he takes simple AI 3D models and makes them photorealistic. I demo this in the webshow as well. 

Rendernet AI - This new tool does a great job of getting consistent faces with a good user interface. It basically unlocks Control Net for folks who are less technically inclined.

(Almost) Perfect Dubbing - Heygen demoed a dubbed version of a Javier Milei speech. The result was so realistic that it's easy to see that AI-generated dubbing is going to be the norm by the end of the year. 

Live-Translation - While we don't normally talk about hardware, a new announcement from Samsung came out last week showcasing the ability to do live translations using AI. Long story short, you can have convos with anyone in the world in your native language. 

Real-Time Gaussian Animation - A research team from China demoed live Gaussian splatting animation. Basically, it converts gaussian scans into live moving avatars.

TikTok Depth Maps - Researchers at TikTok unveiled a new depth mapping tool that looks very realistic. 

Watermark Remover is Bad News for Stock - This tool removes watermarks from images. That, when combined with AI upresers means that the stock photography industry is likely on its last leg.

How Stock Photography will Change - A stock photographer wrote a very interesting article this last week about how he is changing his mindset around his career. It's a good read if you have a few minutes. 

AI Graphic Design Tool - We played around with this AI Graphic Design tool this week and we’re loving some of the results. It's cool to use AI to generate, recolor, and edit vector designs.

ElevenLabs Raises $80M - Elevenlabs raised $80M this week with a valuation of over $1B. 

LiveChat with HeyGen - HeyGen demoed a new feature that allows users to chat with a trained subject from a video. It's like having a video call (minus the 'you're muted Greg' part).