Yes, that's what I'm worried about. That kind of rumour quickly becomes 'law' and it doesn't help.

The thing is, your vote doesn't just help the one you upvote. If you place it on a good post, you reap the rewards too. Curation is what earns voters money.