- Google’s AI mode now allows users to upload images and photos to go with text requests
- The feature combines Google Gemini and Lens
- AI mode can understand whole scenes, not just objects
Google adds a new dimension to its experimental AI mode by connecting Google Lens’s visual abilities with Gemini.
AI mode is part of Google search that can break down complex topics, compare settings and suggest follow-up. Now the search includes uploaded images and photos taken on your smartphone.
The result is a way of searching through images that you would SMS, but with much more complex and detailed answers than just putting a picture in reverse image search.
You can literally snap a photo of a weird -looking kitchen tool and ask, “What is this and how do I use it?” And get a useful answer, complete with shoppinglink and YouTube demos.
Ai eyes
If you take a picture of a bookshelf, a plate of food or the chaotic interior of your junk drawer, AI does not just recognize individual items; It will also explain their relationship with each other.
You may get a suggestion about other dishes you can make with the same ingredients, whether your old phone charger is in the drawer or what order you need to read these books on the shelf. You can see how it works above.
Essenitally fires the function of several related questions in the background of the entire stage and each object. So when you upload a picture of your living room and ask how to oming it, you don’t just get a generic answer. You get a group of answers from Mini AI agents asking for everything in space.
Google is not unique in this persecution. Chatgpt, for example, includes image recognition. Google’s advantage, however, is decades of search data, visual indexing and other data storage and organization.
If you are a Google One AI -Premium subscriber or are approved to test it through search labs, you can test the feature on the Google Mobile app.