I really dislike it when people call me "smart" when really I just have a special interest in communication and therefore communicate in a way that a lot of people understand... and people end up mistaking that understanding for "intelligence" on the part of the speaker.
Like, calling me "smart" is not really a compliment, as much as it is an indirect insult to people-who-are-not-me, and I do not think that it is justified
Also, even if this weren't a misperception, why would I want to be complimented for something that is just part of who I am? Something that I would've happened to get lucky with, and which required no special effort on my part?