Buildings with Sherlock Holmes connections Everyone knows that Sir Arthur Conan Doyle's famous detective lives at 221B Baker Street - but not everyone realises that when Conan Doyle started writing the stories, addresses in Baker Street didn't even extend as far as 221. When the street grew, the Abbey National Building Society took the 221 address, but the number was later given to the Sherlock Holmes museum - even though it's really at 237 and 241.