That's my sense, too. It's similar to how secular people dislike Christians, even when they aren't trying to enforce their beliefs in any way.