There was a short-lived plan to add 11 floors to the Empire State Building. Shortly after the World Trade Center towers were erected in the early 1970s, an architect at the firm Shreve, Lamb and Harmon concocted a scheme that would allow the Empire State Building to keep its crown as the worldâs tallest skyscraper.