Open your mind. It is not about skin color, even though words of color are still used.
We American "Blacks" or "African-Americans' refer to our sub-culture of U.S. born descendants of the enslaved. It all gets twisted by the majority who usurp our adaptations of the language and make it what they want. It just so happens that our skin color ranges shades of brown that the colonizers called Negro or Black.