The samurai had feelings of betrayal that prevented them from getting behind the Sonno joi slogan.
The Tokugawa had successfully persuaded the samurai that traditional Japanese values might suffer, and now the samurai felt betrayed, rallying under the slogan  Sonno joi!  