But it's also effects the low ranked witnesses who are running the block chain with minimum profit or returns. The decreasing of witness votes will discourage or leave them hopeless.

Good thinking, I believe! That might be a collateral unexpected effect.