The can ruin a dwelling in months if they get in.
They certainly should be trapped and removed.
Their feces and urine may not kill, but if you have ever smelled a building that has housed raccoons, you will remember it and it will likely have to be torn down.
City dwellers are usually clueless on the destruction raccoons can bring.