In a saucepan, combine the brown sugar, butter, brandy, and spices. Heat and stir until combined. Keep warm.
Coat a 2-quart square (8x8x2-inch) baking dish with nonstick cooking spray. Add bananas and pecans. Top with the brown sugar mixture.
Bake, uncovered, in a 350 degree F oven for 12 to 15 minutes or until heated through. (Or place bananas and pecans in a 2-quart square microwave-safe baking dish. Top with brown sugar mixture. Cover and microwave on 100 percent power (high) for 3 minutes, stirring gently once. Serve warm with ice cream or frozen yogurt, if you like. Makes 8 servings.