Beat sugars and butter in a bowl until they are creamy. Add egg, yogurt, milk, and vanilla and mix until smooth. In the other bowl, whisk flour, baking soda, and baking powder. Add to the butter mixture and use a spoon to mix.
Fold in peaches. Transfer the batter to your prepared pan. Sprinkle the nuts over the top Bake and allow to cool before serving.