Why does one assume that "small" equals "bad" ? If somebody asserts that Napoleon was tall, that offends nobody, even if it's incorrect. If somebody asserts that he was small, that's an immediate offense that needs to be addressed.
(I'm a six-footer, so I don't have a dog in this fight.)