• Shadow@lemmy.ca
    link
    fedilink
    English
    arrow-up
    22
    arrow-down
    1
    ·
    1 day ago

    I don’t know if a lot of people realize that LLM’s basically started from Google translate.

    • TheBlackLounge@lemmy.zip
      link
      fedilink
      English
      arrow-up
      14
      ·
      1 day ago

      Not in a meaningful sense. It used to be actual string-to-string translation, now it’s extracting the translation from a question-answer zero shot.

    • forrgott@lemmy.sdf.org
      link
      fedilink
      English
      arrow-up
      5
      arrow-down
      4
      ·
      1 day ago

      I wonder if they connect all the way back to Micro$oft’s neo Nazi charity from decades ago?

      • jacksilver@lemmy.world
        link
        fedilink
        English
        arrow-up
        24
        ·
        1 day ago

        Not sure if you really want to know, but a Google paper is where transformers (backbone of LLMs) were first mentioned (2016 I believe). Google initially used transformers for translations and eventually search, but OpenAI experimented with them for text generation (gpt 1+) eventually leading to chatgpt.