I would guess the deletion hasn’t propagated to all server instances so it’s still showing up in those instances. I imagine that posts are truly deleted but just marked as such I the database. Therefore a down vote could still be attached to the now deleted post this incrementing the counter.

The good news is karma isn’t a thing here so don’t worry about getting extra down votes.