YouTube is prepping new AI features to make passive video watching a lot more interactive, according to unreleased code found by Android Authority. The Talk Live features undergoing testing use Google Gemini‘s AI models to let you converse about YouTube videos and PDFs.
Imagine you’re watching a video on, say, the history of art movements, and halfway through, you’re scratching your head over what separates Impressionism from Post-Impressionism. Instead of pausing the video to dive into a Google rabbit hole, you could summon Gemini Live to clarify things for you right then and there. With a simple tap on a contextual “chip” that pops up, the AI assistant will be ready to answer questions, provide context, or summarize key points from the video.
The Talk Live PDF feature takes the same premise as the YouTube feature and applies it to PDF documents. You can get Gemini Live to discuss the document with you. That might mean summarizing it, explaining complicated terms, or answering specific questions about sections that don’t make sense when you read it. Whether you’re using the YouTube app or a PDF reader, you’ll be able to summon Gemini and get all your queries on videos and documents answered.
AI enhancement
Google has been pushing AI for YouTube for months now. The Talk Live tool fits right in with the likes of YouTube’s Brainstorm with Gemini feature for coming up with ideas. The same goes for the the AI tool for removing copyrighted music from your video without taking it down completely, or the one for making new, uncopyrighted music to fit the theme of your video. There’s also the useful auto-dubbing feature, which translates and dubs videos into multiple languages.
Still, the idea of remaking YouTube viewing as an engaging conversation on top of the more passive viewing experience is one that might appeal to a lot of people, especially if the video is really long and the viewer is impatient. And everyone from students trying to grasp a lecture, to creators looking to expand their audiences could benefit. It might make people more willing to engage with difficult content. Or, at the very least, the AI will make understanding Impressionism much easier.