This could work rather well if it is asymmetric: comment required to downvote, but downvote comments do not require additional comment before downvoting. It would rapidly punish people who are downvoting because they're just really passionate about their opinions, not so much understanding what others say.