I haven’t been following much of the new developments of these self-hostable AI. Can you actually self-host anything decent?
I have played around these smaller models in the past and honestly anything smaller than LLama 4 Scout was just not very useful. Now Llama 4 Scout was “17B Active parameters, 16 experts and 109B Total parameters” so not sure what that even means.
I haven’t been following much of the new developments of these self-hostable AI. Can you actually self-host anything decent?
I have played around these smaller models in the past and honestly anything smaller than LLama 4 Scout was just not very useful. Now Llama 4 Scout was “17B Active parameters, 16 experts and 109B Total parameters” so not sure what that even means.