Where did you get this info? If it were true, I'd say the reason is simply the difference in the nervous system - every brain is unique and who knows which reactions to stimuli differ.

There's also this story about a Buddhist monk who tried LSD and said that it didn't affect him at all, since he's able to control his mind to be able to enter and leave alternate states at will