at the foot of the building , a small spice market rang and bustled , wafting up with a melange of nutmeg , cinnamon , vanilla , cloves , and countless other spices that had once lured sultans to this island and had fueled an active slave-trading industry .