First, even if punishment is inevitable, it falls not on the owners at the time when the sin is committed, but on the owners at the time when the sin is discovered.
Punishment is never inevitable and only occurs when a sin is discovered at the time it is committed. 