Firstly, there were the freed slaves and/or their descendents from the U.S.A.. Secondly, there also was a group of freed slaves and/or their descendents from the Caribbean Islands (West Indies).
There was the group of recaptured Africans intercepted from slave vessels by the U.S. Navy after the abolishment of the slave trade (1806).