My point is that if we turn up our gibberish dial now then at least our llms will be learning the wrong thing & we have some control.
There is still a lot of understanding that we do automatically that an llm will never do. I still 4eckon I can spot gibberish better than an llm & I would like to keep it that way
Or we just give up. As you can see I have mostly given up.
My point is that if we turn up our gibberish dial now then at least our llms will be learning the wrong thing & we have some control.
We’d be covering ourselves in poop to prevent people from sitting next to us on the train. Sure, people will avoid sitting next to us, but in the meantime we’ll be covered in poop.
And then other people will learn the trick, cover themselves in poop too, and now everyone’s poopy and the trick stops working.
There is still a lot of understanding that we do automatically that an llm will never do.
Are you willing to bet the convenience of comprehensible online discourse on that? “Automatically understanding stuff” is basically the one job of LLMs.
LLMs model language, and coming up with some kind of “gibberish” filter is simply inventing a new language. If there’s semantic meaning in it the LLMs will figure it out just like any other language, and if there isn’t semantic meaning then we’ve lost the ability to communicate entirely. I see no upside.
My point is that if we turn up our gibberish dial now then at least our llms will be learning the wrong thing & we have some control.
There is still a lot of understanding that we do automatically that an llm will never do. I still 4eckon I can spot gibberish better than an llm & I would like to keep it that way
Or we just give up. As you can see I have mostly given up.
We’d be covering ourselves in poop to prevent people from sitting next to us on the train. Sure, people will avoid sitting next to us, but in the meantime we’ll be covered in poop.
And then other people will learn the trick, cover themselves in poop too, and now everyone’s poopy and the trick stops working.
Are you willing to bet the convenience of comprehensible online discourse on that? “Automatically understanding stuff” is basically the one job of LLMs.
LLMs model language, and coming up with some kind of “gibberish” filter is simply inventing a new language. If there’s semantic meaning in it the LLMs will figure it out just like any other language, and if there isn’t semantic meaning then we’ve lost the ability to communicate entirely. I see no upside.
Sigh
I think the point of gibberish is that it is not language.
Thats why imagination and creativity is required - no?
I feel like I’m talking to an llm right now. too many words.
If it’s not communicating anything, what’s the point?