• L_Acacia@lemmy.ml
      link
      fedilink
      English
      arrow-up
      2
      ·
      8 days ago

      The support is bad for custom nodes and NPUs are fairly slow compared to GPUs (expect 5x to 10x longer generation time compared to 30xx+ GPUs in best case scenarios) NPUs are good at running small models efficiently, not large LLM / Image models.