Just as a quite warning- retrobright will make the plastic of the dreamcast white, but it will also make it more brittle, and it’s not a permanent solution. It WILL yellow again, and repeated applications of retrobright will make it more and more brittle.
You are correct, it’s the plastic. Or rather, the fire retardant mixed into the plastic.