I think most people have this realization and question, probably as children.

It's probably impossible to know for sure. But I largely think we see them similarly, mainly because of favorite colors. Few people like orange, brown, tan, pea green, etc.

If we all saw colors differently, I feel like there'd be greater variety in favorites.