Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.
Also includes outtakes on the ‘reasoning’ models.
Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.
Also includes outtakes on the ‘reasoning’ models.
The funny thing is, in order to get it to the dumber model, they have to run people’s queries through a model that selects the appropriate model first. This is resulted in new headaches for AI fans
Yeah that’s also something that you have to train for, i’m not super aware of the technicals but model routing is definitely important to the AI companies. I suspect that’s part of why they can pretend that “inference is profitable” as they are already trying to squeeze it down as much as possible.
I wonder if the routing is actually going to decrease the overall costs or increase them… Routing looks like it introduces new, unavoidable factors that would cause the costs to increase.