In a large mixing bowl, combine pumpkin, sugar, and pumpkin pie spice. Add eggs. Beat lightly with a rotary beater or fork till just combined. Gradually stir in milk, whipping cream, brandy, if you like, and vanilla; mix well. Stir in bread cubes till coated with pumpkin mixture. Pour mixture into an ungreased 2-quart square baking dish.