As the US military begins integrating AI technology, simulated wargames show how chatbots behave unpredictably and risk nuclear escalation
  • Ottomateeverything@lemmy.worldEnglish
    18·
    10 months ago

    Why even bother testing this? LLMs are not how you would want to run anything strategy related. And they’re trained of internet text data - pretty much all YouTube/Reddit comments about conflicts are full to the brim of people screaming about exterminating and nuking the “enemy” so of course that’s what LLMs would do.

    It’s scary how many people, even those in pretty high up positions of power, have no fucking clue how this shit works or what it can/will do. I used to think that AI wouldn’t be as dangerous as it is portrayed in books/movies because we would just keep it in line and have proper guard rails… But when people in the military etc seem to have no fucking clue as to how LLMs work… Yeah, we’re fucking doomed.

    • CanadaPlus@futurology.todayEnglish
      6·
      10 months ago

      Exactly. I bet they escalate because they’re more instinctively drawn to a dramatic story than to pragmatic victory or desirable outcomes.

      Western militaries, at least, have made it doctrine to always keep a human in the loop, so that’s good.

  • theodewere@kbin.social
    31·
    10 months ago

    i really doubt you’re going to successfully train a chatbot to care about future generations