- AI PCs are emerging as a viable option for running local AI without unpredictable costs
- One-time PC costs ease the need to pay for skytoken fees
- Wider research confirms the increasing popularity of smaller models
New Gartner data has claimed that now might actually be a good time to buy AI PCs, as cloud computing faces several challenges in a rapidly changing business world.
Data center construction is lagging behind demand as agile chains strain and communities oppose new projects, meaning metering could end up costing some companies more than they bargained for.
By moving some of their AI processing locally, companies could be able to avoid some of these extra monthly costs with a one-time purchase of a more powerful PC as part of their regular refresh cycles.
AI PCs present an ideal hybrid computing model
While AI PC adoption started rather slowly with companies struggling to understand the benefits, they are now seen as a cloud backup option rather than a primary benefit in itself.
With the use of artificial intelligence becoming increasingly sharp and unpredictable token consumption hitting businesses hard, predicting monthly costs is a new big challenge that many are facing.
Small language and reasoning models, including specially trained models for individual business applications, ultimately need fewer resources than leading edge models, making it possible to run them locally as part of a broader hybrid approach.
Gartner predicts that voice and chat, text generation, image and audio generation and more may soon shift to workers’ PCs, with only the most intensive tasks routed through hyperscaler data centers.
As early as 2029, the company’s researchers expect that about a third (30%) of companies could use AI PCs to reduce cloud AI token costs. By 2030, 70% of enterprise PCs could be able to run some GenAI tasks locally.
Omdia researchers also noted a shift in the use of AI models, with smaller and medium-sized models proving popular, with domain-specific tasks that did not need the full computational breadth.
“Legacy GPUs retain value and remain operational as they continue to offer a cost-effective option for small and medium model inference and disaggregation,” said Senior Principal Analyst for Advanced Computing Alexander Harrowell.
Via The register
Follow TechRadar on Google News and add us as a preferred source to get our expert news, reviews and opinions in your feeds.
