Riding away from us comes across as manly and responsible.
Since both of you are newcomers " Rennie paused and then added: "Your riding away from here might appear to others that you had quit, were joining up with the mustangers on your own." 