Allspice has a sweet taste that's reminiscent of a number of different spices, including cloves, cinnamon and nutmeg. Because of its sweetness, it's commonly used in baked goods like spice cakes, dessert breads and cookies. It's also the primary flavor in Jamaican jerk seasoning.