You take a left at the clock tower which is uphill from the jetty.
You can take a tour of the island on a fayton (carriage) to find the cab rank, walk uphill from the jetty to the clock tower in the square and turn left.