The scary part is the mental state he was able to get into with only a randomly generated text. If you haven’t already seen it, I highly recommend the Down the Rabbit Hole video about it, although it’s pretty heartbreaking. So much wasted talent.

There’s people like him who are similarly psychotic, but couldn’t usually get to the point where they could access a tool that would trigger them. Personalized chatbots were mostly a niche non-tech savy person doesn’t really get to that easily.

Now, it’s everywhere. A lot of people will loose their sanity over this.

Depends on what the angel would say in his schizophrenia-induced converstions. Either they’d refuse it outright or insist on a custom-trained model on public domain religious texts (and there’s not enough of those to make a model with unique, coherent output, so not much better than the random word generator).