Yes and no. Definitely acro is way more deadly than casual flying but I’ve seen and heard about weird accidents happening to people without doing anything crazy. A friend of mine wanted to do a tandem flight. She took off with very experienced pilot on a very calm day and some totally random downdraft suddenly pulled them down and they landed hard in the middle of the mountain. By some miracle both were fine. A lot that happened in my area were foreign tourist not familiar with the terrain and not having enough experience trying to fly on normal days and simply making stupid mistakes.