Harry knew he would have to explain himself after the heist. It was essentially a silent agreement they had. That to never harm innocent civilians. They might be their hostages, but they were just regular folks caught at the wrong place at the wrong time.