[Technically, that's Marvel's fault more than it is Charles'. :v]

We're genetically different. "Lumping us in with the mallards" is precisely the problem we're trying to sort out because, as you said, people tend to fear those who are different from themselves.