Obama says it's time for simple minded people to give up their rights