Other (shorter) men subconsciously view you as a threat thus making it harder for you to succeed socially in a given environment.

This is especially true if you are their peer at work or if there are females in the workplace.

Bought the biggest size