RandAlThor@lemmy.ca to Technology@lemmy.worldEnglish · 2 months agoElon Musk’s Grok Goes Haywire, Boasts About Billionaire’s Pee-Drinking Skills and ‘Blowjob Prowess’www.mediaite.comexternal-linkmessage-square157fedilinkarrow-up1980arrow-down126cross-posted to: politics@lemmy.world
arrow-up1954arrow-down1external-linkElon Musk’s Grok Goes Haywire, Boasts About Billionaire’s Pee-Drinking Skills and ‘Blowjob Prowess’www.mediaite.comRandAlThor@lemmy.ca to Technology@lemmy.worldEnglish · 2 months agomessage-square157fedilinkcross-posted to: politics@lemmy.world
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up1·2 months agoThat’s not strictly true. I have a Ryzen destkop, 7800, 3090, and 128GB DDR5. And I can run the full GLM 4.6 with quite acceptable token divergence compared to the unquantized model, see: https://huggingface.co/Downtown-Case/GLM-4.6-128GB-RAM-IK-GGUF If I had a EPYC/Threadripper homelab, I could run Deepseek the same way.
That’s not strictly true.
I have a Ryzen destkop, 7800, 3090, and 128GB DDR5. And I can run the full GLM 4.6 with quite acceptable token divergence compared to the unquantized model, see: https://huggingface.co/Downtown-Case/GLM-4.6-128GB-RAM-IK-GGUF
If I had a EPYC/Threadripper homelab, I could run Deepseek the same way.