As a member of the ginger master race, I've never had any issues. Although there was a girl at work, who said I was 'one of the rare good looking gingers'.
I think I said something quite harsh like you're ugly for a brunette.
Anyway...