I use ext4, but the fix was just installing linux-headers. I simply was of the impression that I had already installed those. Most likely I had installed them on one of my laptops and simply just had that vivid memory still in my head. Once I installed them the problem solved itself after a reboot.