• entwine@programming.dev
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    2 hours ago

    I’m not sure I understand what you’re saying. By “the commenter” do you mean the human or the AI in the screenshot?

    Also,

    For instance, many SoTA models are trained using reinforcement learning, so it’s plausible that its learned that spamming meaningless tokens can delay negative reward

    What’s a “negative reward”? You mean a penalty? First of all, I don’t believe this makes sense either way because if the model was producing garbage tokens, it would be obvious and caught during training.

    But even if it wasn’t, and it did in fact generate a bunch of garbage that didn’t print out in the Claude UI, and the explanation of “simulated progress” was the AI model coming up with a plausible explanation for the garbage tokens, it still does not make it sentient (or even close).