My friend wants to leave on Sunday meanwhile I want to leave on Saturday because there's a snowstorm suppose to hit on Saturday night. Am I the asshole to say, "I'm leaving with or without you" to my friend?

I'm conflicted because I'm not sure how bad the roads will be on the eight hour journey and a good friend while also not wanting to drive in hazardous conditions.