I'd agree that alt-right is used loosely but that imprecision is just what the neo-Nazis are counting on.  But I am inferring from your exposition of Breitbart's Jewish connection that you don't perceive them as racist.

Perhaps racist is too strong a term, but Breitbart is far from tolerant.  As only one example, they have run glowing pieces on Wilders, who is a racist by any definition; he actively fomented anti-Muslim sentiment and went as far as to say that Islam is possibly even more dangerous than Nazism.

No, Breitbart does not represent modern, college educated conservatives -- and I don't think the term alt right serves that demographic very well either.  The educated conservatives I know are highly supportive of (overly?) prudent fiscal policy and smaller government -- but they don't chase scapegoats or judge people based on faith or other arbitrary factors.