• cm0002@digipres.cafeOP
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    3 days ago

    Would you use a local open source LLM? (Assuming you have, or have the ability to acquire, a GPU or 2)

    • itkovian@lemmy.world
      link
      fedilink
      arrow-up
      7
      ·
      3 days ago

      Most likely no. I haven’t found them all that useful, tbh. Maybe I am just broken, but it really makes me wonder how people like it so much.

      • cm0002@digipres.cafeOP
        link
        fedilink
        arrow-up
        5
        ·
        edit-2
        3 days ago

        I find some utility in them, they’re VERY far from the end all be all tool that AI bros hype.

        I used it heavily to generate more cover letters for a recent job hunt than Ive ever done in my life and that’s in addition to generating pretty much all of my written communication. So it was of great help there to help me mass apply to shit (without using one of those dumb AI applying services (tried like 2 of em, utter dog shit lmao))

        Just yesterday I used my local LLM to process a pic I snapped of a handwritten birthday invite one of my kids got and it was inserted into my calendar accurately. Is GenAI 100%, no, but it’s more accurate than the previous solution for something like that I think.