once washington had decided that the expeditionary force should be five thousand men , lee had graciously condescended to this more appropriate command-leaving la fayette in charge of his own smaller force , for the sake of the marquis 's amour-propre , but with lee in command overall .