For members of the president's own party to vote against him, the case against him should be strong enough to justify such a vote.
The case against the president should be strong enough to justify some members of his own party voting against him.