If you've already tried talking to him and it's still not working out then just leave. For good. Obviously you two aren't compatible, and you'd be better off finding someone who is rather than hoping...