Slaves toiled in the fields and the boiling houses, supplying the huge amounts of labor that sugar required. Overall some four million slaves were brought to the Caribbean, and almost all ended up on the sugar plantations.