- Microsoft has upgraded copilot to make the AI assistant a proactive AI -Ledes case
- Advertised as part of Microsoft’s 50 -Year anniversary cup filot event, these new features start rolling out today
- Features include chatbot memory, a research tool and on-screen awareness just to name a few
Microsoft Copilot takes the plunge and transforms from a pure generative AI-Chatbot to a full-blown AI joint case. At least that’s what Microsoft promises in one of the most significant copilot updates to date.
The changes, which add a host of new capabilities and improved some existing ones, were announced on Friday, April 4 as part of Microsoft’s Copilot/50 -Year anniversary.
Granted, many of these features will be well known to those who run Google’s Gemini and Openai’s Chatgpt. In fact, there is a solid chance that some of these improvements will come directly from Microsoft’s partnership with Openai, giving it access to many of the AI company’s best generative models.
After all, Copilot is built on the basis of Openais GPT models.
Picture 1 of 3
Among the changes that copilot fans will find on Windows (and iOS and Android apps) is finally a memory. The current version of Copilot on Windows 11 can hold on to previous conversations, but it has no memory of what you discussed. A new prompt asking for a recipe or trip you planned with Copilot’s help days or weeks ago would draw a digital blank staring from the generative AI.
It changes with this update. When you chat it up, Copilot (with permission, of course) will collect key bits of info about you that not only indicate facts but preferences. Microsoft claims the new copilot will build “richer user profiles.” It now has the potential to “learn who you are deep.” While it may sound invasive, Microsoft says you can control exactly what you want copilot to learn and maintain.
Picture 1 of 3
Personalization and memory are significant benefits, but they may be exceeded by Copilot’s new agent capabilities that Microsoft calls “actions.” Where the former copilot can help you grab concert tickets and get a trip to the big show, or find a new apartment and even move to help you smell your stuff from one place to the next, copilot actions can take a quick time to rent an apartment or book storage and do all the leg work to make it happen. You go straight into a prompt.
Of course, it’s not that simple. Copilot’s action functions are not ubiquitous. Microsoft has a small collection of launch partners that include, Opentable, Priceline, VRBO, Viator, Kayak, Expedia, TripAdvisor, Skyscanner, Booking.com and 1-800-Flowers. It seems that actions currently only work if you want it to take actions through these apps and services.
Now see this
Picture 1 of 2
The update also makes copilot on Windows and Mobile Apps more attentive. While the current version can look at photos and screens uploaded to AI, the new version can use your mobile phone camera to see what you see (it will look at photos or live video).
Perhaps more interesting is that Copilot’s Windows app will be able to view on -screen activity. Finally, it lives up to its name, acts as a copilot on file control, Windows settings and works on projects. It is the kind of system awareness that Apple has promised by Apple Intelligence and Siri for almost a year, but has not yet delivered. It will be interesting to see if what Microsoft delivers here with Copilot is as good as they advertise.
The new pages of capacities can take different project files and organize them in a single canvas. But pages seem to be more than an organizer, it can help you brainstorm ideas and then change and incorporate them into your own projects.
Go deep
If pages do not get your project there, you may be able to appreciate the new deep research. I know everyone calls the research part of their generative AI platforms “deeply [something]”. This one seems to work in a similar way, as it can help you perform multi-step research that acts as a kind of very intelligent research assistant.
Copilot even covers podcasts. Similar to what we have seen with Spotify Generative AI Podcasts and Google Notebooklm, it can generate podcasts based on topics of interest or other discussions you’ve had with AI. Microsoft claims that the podcast can play, even if you continue to feed Copilot new prompt. It sounds a little confusing, but also powerful and exciting.
There is also a shopping update that transforms copilot into a proactive personal shopper that can look for offers, perform product surveys and even handle purchases.
Finally, Copilot Bing is taking on what can best be described as a Google AI Overview, but in a subtle and perhaps more tasty way. From the appearance of things, Bing -seeking results will allow you to take a generatively deeply dive in traditional search results. It looks pretty good in the demo video, but we’re eager to see how it works on Live Bing results.
Not all of these updates appear at once across Windows, iOS and Android, but many start rolling out today. If you already have Windows 11 running Copilot, you can download the latest update and give your copilot a radical AI joint case upgrade.
Picture 1 of 2
