Show the actual use case in a convincing way and people will line up around the block. Generating some funny pictures or making generic suggestions about your calendar won’t cut it.
I completely agree. There are some killer AI apps, but why should AI run on my OS? Recall is a complete disaster of a product and I hope it doesn’t see the light of day, but I’ve no doubt that there’s a place for AI on the PC.
Whatever application there is in AI at the OS level, it needs to be a trustless system that the user has complete control of. I’d be all for an Open source AI running at that level, but Microsoft is not going to do that because they want to ensure that they control your OS data.
Machine learning in the os is a great value add for medium to large companies as it will allow them to track real productivity of office workers and easily replace them. Say goodbye to middle management.
I think it could definitely automate some roles where you aren’t necessarily thinking and all decisions are made based on information internally available to the PC. For sure these exist but some decisions need human input, I’m not sure how they automate out those roles just because they see stuff happening on the PC every day.
If anything I think this feature is used to spy on users at work and see when keystrokes fall below a certain level each day, but I’m sure that’s already possible for companies to do (but they just don’t).
Pay more for a shitty chargpt clone in your operating system that can get exploited to hack your device. I see no flaw in this at all.
The biggest surprise here is that as many as 16% are willing to pay more…
Acktually it’s 7% that would pay, with the remainder ‘unsure’
I mean, if framegen and supersampling solutions become so good on those chips that regular versions can’t compare I guess I would get the AI version. I wouldn’t pay extra compared to current pricing though
Let me put it in lamens terms… FUCK AI… Thanks, have a great day
FYI the term is “layman’s”, as of you were using the language of a layman, or someone who is not specifically experienced in the topic.
Sounds like something a lameman would say
Well, when life hands you lémons…
Unless you’re doing music or graphics design there’s no usecase. And if you do, you probably have high end GPU anyway
I could see use for local text gen, but that apparently eats quite a bit more than what desktop PCs could offer if you want to have some actually good results & speed. Generally though, I’d rather want separate extension cards for this. Making it part of other processors is just going to increase their price, even for those who have no use for it.
There are local models for text gen - not as good as chatGPT but at the same time they’re uncensored - so it may or may not be useful
Yes, I know - that’s my point. But you need the necessary hardware to run those models in a performative way. Waiting a minute to produce some vaguely relevant gibberish is not going to be of much use. You could also use generative text for other applications, such as video game NPCs, especially all those otherwise useless drones you see in a lot of open world titles could gain a lot of depth.
The dedicated TPM chip is already being used for side-channel attacks. A new processor running arbitrary code would be a black hat’s wet dream.
It will be.
IoT devices are already getting owned at staggering rates. Adding a learning model that currently cannot be secured is absolutely going to happen, and going to cause a whole new large batch of breaches.
The “s” in IoT stands for “security”
Do you have an article on that handy? I like reading about side channel and timing attacks.
That’s insane. How can they be doing security hardware and leave a timing attack in there?
Thank you for those links, really interesting stuff.
It’s not a full CPU. It’s more limited than GPU.
That’s why I wrote “processor” and not CPU.
A processor that isn’t Turing complete isn’t a security problem like the TPM you referenced. A TPM includes a CPU. If a processor is Turing complete it’s called a CPU.
Is it Turing complete? I don’t know. I haven’t seen block diagrams that show the computational units have their own cpu.
CPUs also have co processer to speed up floating point operations. That doesn’t necessarily make it a security problem.
Tbh this is probably for things like DLSS, captions, etc. Not necessarily for chatbots or generative art.
AI-en{hanced,shittified}
The other 16% do not know what AI is or try to sell it. A combination of both is possible. And likely.
Okay, but here me out. What if the OS got way worse, and then I told you that paying me for the AI feature would restore it to a near-baseline level of original performance? What then, eh?
One word. Linux.
I already moved to Linux. Windows is basically doing this already.
I would pay extra to be able to run open LLM’s locally on Linux. I wouldn’t pay for Microsoft’s Copilot stuff that’s shoehorned into every interface imaginable while also causing privacy and security issues. The context matters.
That’s why NPU’s are actually a good thing. The ability to run LLM local instead of sending everything to Microsoft/Open AI for data mining will be great.
I hate to be that guy, but do you REALLY think that on-device AI is going to prevent all your shit being sent to anyone who wants it, in the form of “diagnostic data” or “usage telemetry” or whatever weasel-worded bullshit in the terms of service?’
They’ll just send the results for “quality assurance” instead of doing the math themselves and save a bundle on server hosting.
I replied to the person above “locally on Linux”.
Even in Windows, local queries give the possibility of control. Set your firewall and it cannot leak.
All your unattended date will be taken (and some of the attended one). This doesn’t mean you should stop to attend your data. Even of you’re somehow forced to use Windows instead open alternative, it doesn’t mean you can’t dual boot or use other privacy conscious devices when dealing with your sensitive data.
Closed/proprietary OS and hardware driver can’t be considered safe by design)
but do you REALLY think that on-device AI is going to prevent all your shit being sent to anyone who wants it
Yes, obviously, especially if you are running all open source software.
Who in the heck are the 16%
I would if the hardware was powerful enough to do interesting or useful things, and there was software that did interesting or useful things. Like, I’d rather run an AI model to remove backgrounds from images or upscale locally, than to send images to Adobe servers (this is just an example, I don’t use Adobe products and don’t know if this is what Adobe does). I’d also rather do OCR locally and quickly than send it to a server. Same with translations. There are a lot of use-cases for “AI” models.
I’m interested in hardware that can better run local models. Right now the best bet is a GPU, but I’d be interested in a laptop with dedicated chips for AI that would work with pytorch. I’m a novice but I know it takes forever on my current laptop.
Not interested in running copilot better though.
-
The ones who have investments in AI
-
The ones who listen to the marketing
-
The ones who are big Weird Al fans
-
The ones who didn’t understand the question
- The nerds that care about privacy but want chatbots or better autocomplete
I would pay for Weird-Al enhanced PC hardware.
Those Weird Al fans will be very disappointed
-
Maybe people doing AI development who want the option of running local models.
But baking AI into all consumer hardware is dumb. Very few want it. saas AI is a thing. To the degree saas AI doesn’t offer the privacy of local AI, networked local AI on devices you don’t fully control offers even less. So it makes no sense for people who value convenience. It offers no value for people who want privacy. It only offers value to people doing software development who need more playground options, and I can go buy a graphics card myself thank you very much.
I am generally unwilling to pay extra for features I don’t need and didn’t ask for.
raytracing is something I’d pay for even if unasked, assuming they meaningfully impact the quality and dont demand outlandish prices.
And they’d need to put it in unasked and cooperate with devs else it won’t catch on quickly enough.
Remember Nvidia Ansel?
I don’t think the poll question was well made… “would you like part away from your money for…” vaguely shakes hand in air “…ai?”
People is already paying for “ai” even before chatGPT came out to popularize things: DLSS
Poll shows 84% of PC users are suckers.
You like having to pay more for AI?
I feel like the sarcasm was pretty obvious in that comment, but maybe I’m missing something.
