- Google Gemini releases a feature to Pixel 9 that lets it discuss what’s on a screen in real time
- Gemini Live can discuss photos, files and YouTube videos
- The feature causes Gemini to live more attention to the context of the discussions
Google gives his Gemini AI assistant a new perspective, your view of what’s on a smartphone screen. Specifically, the Pixel 9 Series with Devices where Gemini Live is now able to “talk live about this” and have a real-time chat about photos, files and youtube videos that you see them first discovered by 9to5Google. It is ideal if you are eager to ask about a cooking guide mid-reciper or require an explanation of a meme that you are not hip enough to understand.
Gemini Live’s role so far has been much like any standard AI voting assistant, driven by the more conversation models in the form of chatgpt. But now it can look at specific content on your screen and add it to its discussions. Pixel 9 owners can access the feature by launching the floating gemini overlay, where a suggestion appears that suggests AI “Talk Live About Video” on YouTube, “Talk Live About PDF” in files by Google, and “Talk Live About this ”for photos on screen. It gives Gemini context without having to explain what’s there. It’s much faster than having to manually upload a photo from your gallery.
When you activate the feature, Gemini opens Live up with a preview of what’s on the screen you can discuss. AI may be offering destination ideas based on a YouTube journey video, summarizing a contract PDF or explains the allegory of a piece of rennaisance art you are investigating on your phone. If you find it all a bit intrusive, you can stop Gemini Live from automatically turning off what you are watching. If you don’t have a Pixel 9 don’t worry. Google has said it will soon release the feature of the Samsung Galaxy S24 and S25 smartphones, followed by other Android devices.
Gemini Alive
The feature fits nicely into the Google Gemini strategy. In the event that you haven’t noticed, Google dreams of cementing Gemini’s place in the center of people’s lives, especially on mobile devices, as shown in its ongoing integration with Android. And this feature will not be the end of Gemini Live’s upgrades. Google is ready for Project Astra, an ever -developing tool set to let users share their screen and stream video in real time while talking to Gemini Live.
Google leans hard in real time, assistance in context. Instead of just generating answers based on abstract queries, Gemini Live wants to be part of the moment and respond to what’s on your screen with (hopefully) useful insights. To keep in front of Apple’s plans for Apple Intelligence and no matter what Openai and Microsoft Plan, Google wants Gemini to be as ubiquitous as possible.
