Why do so many dislike Catholics?

I've noticed there is a considerable amount of hatred for Catholicism and it's followers, especially by atheists. Any particular reason why?