As you might suspect from its name, allspice has a sweet taste that's reminiscent of a number of different spices, including cloves, cinnamon and nutmeg. Because of its' sweetness, it's commonly used in baked goods.