- Google rolls new vision features for Gemini Live
- The AI assistant can now “see” your phone screen or camera sherings
- These upgrades are driven by Project Astra, Google’s AI R&D Umbrella
Google’s Gemini Live finally gets the gift of sight. The technology giant has quietly begun to roll out features that transform your humble smartphone into an all-emerging eye for his AI assistant.
The new abilities were uncovered by a Reddit user who later shared a video of the features of action. The upgrade lets Gemini Peer through your screen or camera lens and treat what it sees. The rolling marks the debut of Google’s much discussed and very much -long project Astra.
Based on the video, Gemini’s ‘Eyes’ can analyze your screen in real time through a “Share Screen with Live” button. Gemini has long been able to digest static screens, but the update maintains a continuous look at your screen and looks at what you are on your phone for better or for worse.
The second tool makes your phone’s camera Gemini’s eye. Google has demonstrated that AI can precisely distinguish colors and objects. Whether the final product matches the Platonic ideal demos is not yet clear.
A short demo of Project Astra (Share -Skærmen with Live) from R/BARD
Astra eyes
The new feature first arrives at the Gemini Advanced subscribers, paying $ 20 a month for the Google One plan with extra AI. The rolling is especially democratic where the function is displayed, but the rating from the Xiaomi phone shown by the Reddit user. Google had previously suggested that Pixel and Galaxy S25 owners would have faster or better access to Project Astra.
Other AI assistants with similar SE tools are available, but they are mostly linked to third-party apps such as Microsoft Copilot, Chatgpt, GROK and even Hugging Face’s New Huggingsnap app. Having a real-time screen and camera connection AI built into Android would certainly help entice users who are interested in an AI assistant to at least try Gemini.
And Google’s timing to release the feature is remarkable as it tries to separate a lead among AI assistants. Although Amazon has hyped its new “Alexa Plus” update, it has not yet arrived.
Meanwhile, Apple’s upgraded Siri has been delayed several times. That leaves Google with a temporary but very real lead in the AI assistant race. Gemini, for all his early hiccups and the marking of drama (RIP BARD), is now doing things that neither Alexa nor Siri can match for the moment.
Google has promised that Project Astra will be a “next generation assistant” that everyone wants to spend all day. So keep your (and Geminis) eyes peeled for new features to arrive in the coming weeks.
