it is also true that at this time the south eastern railway was trying to build new access lines into downtown london , and this caused the displacement of many families and the destruction of their houses .