Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • First_Thunder@lemmy.zip
    link
    fedilink
    English
    arrow-up
    20
    ·
    4 hours ago

    What this shows though is that there isn’t actual reasoning behind it. Any improvements from here will likely be because this is a popular problem, and results will be brute forced with a bunch of data, instead of any meaningful change in how they “think” about logic

    • MangoCats@feddit.it
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      9
      ·
      3 hours ago

      Plenty of people employ faulty reasoning every single day of their lives…