Agreed.
Disturbing is the right word.
It comes from an all-too-common stereotype, preached by many religious ministers, that, since atheists and agnostics don't believe or question the nature of a deity, there is nothing to prevent them from doing anything they darn well please.
These types ignore the concept of internal discipline.
"I'm not going to steal or damage property or harm or murder someone because I know it's wrong"
vs
"I'm not going to steal or damage property or harm or murder someone because my God will punish me".
Strange, I thought adults were supposed to act like adults and not need their parent(s) to scold them.