still , left to his own devices , he 'd do his nigger-buying over at the american exchange in the st. charles , where manners were less refined , english was spoken in place of french , and he felt less out of place .