What you're doing is subsidizing the technology. Without these incentives, it is more difficult for the Teslas of the world (of which there is really only one) to become viable and advance this technology. If Tesla wins here, we all win. It's just that the well off get to play with it first. That's not so bad to me. I've got a long list of areas that my tax dollars don't belong before this is a concern.
I'd rather subsidize technology that's going to make our lives more sustainable in the future, than continue to cover the externalities for gas driving car owners.
The flip side to this lament is that those who can afford it generally are subsidizing it a bit more than those who can't. More in taxes, and they actually buy the product, directly subsidizing it.