These AI PCs/Notebooks aren’t even able to run the really big models. For those you’d need a 5000$ card. And for the smaller models a good graphics card is often enough.
For a real AI PC we would need new technology or graphics cards with more ram (the last one would suprise me with current ram prices)
These AI PCs/Notebooks aren’t even able to run the really big models. For those you’d need a 5000$ card. And for the smaller models a good graphics card is often enough.
For a real AI PC we would need new technology or graphics cards with more ram (the last one would suprise me with current ram prices)
I’m still sanguine that 1.58 BITNET models take off. Those could plausibly run at good clip on existing CPUs, no GPU needed.
Super basic medium article for this not in know
https://medium.com/@kondwani0099/reimagining-ai-efficiency-a-practical-guide-to-using-bitnets-1-bit-llm-on-cpus-without-ef804d3fb875
Necessityspite is usually a good driver…though given BITNET is Microsoft IP…ehh…I won’t hold my breath for too long.