Probably because the people who believe that is what it means, are the loudest/most noticed - rather than wiser, older members.

In this case I do blame the Church, TV-evangelism and weird outsiders that read the text and go "If I could do anything I would eat babies and rape children... so these people must be doing that!" for that misunderstanding, Crowley's world-tour didn't help either.