When does being different become unequal?
Different IS unequal, pretty much by definition. But it sounds like your asking something like “should people be deprived of equal rights just because they’re different” — for which the answer is NO, if the difference is something morally neutral (race, gender, sexual orientation, etc.) The answer is YES if the difference is not morally neutral, such as they’ve committed a murder.