What you said is right , without industrialization there won’t be any rise in economic prosperity, but at the same time

if you look at present day Spanish colonies , much of the property , farmlands of high real estate value are majorly owned by descendants of white people over present generation of black slaves or native Americans tribes .

Another example would be australia, much of the wealthy real estate , farmlands and property are owned by white people , they got this wealth and property from there ancestors. How there ancestors got this were by displacement of aborginal people from fertile , beach side lands

That means present generation of white people in australia benefit from having high net worth properties , fertile farmlands whereas present day descendants of aborginal people only have dried land and have properties of low real estate value .

This is one of the Main thing causing disparity in australia, same thing would be applicable for usa where white people own majority of property, wealthy farmland . Also Black people were curbed via Jim crows law which were made by white supremists to curb rise of black traders eventually leads to more economic inequality