Combine Dry Ingredients: In a medium bowl, whisk together the flour, sugar, baking powder, cinnamon, ginger, salt, and nutmeg. Set aside.
Combine Wet Ingredients: In a separate small bowl, beat together the heavy whipping cream, vanilla yogurt, and egg until smooth.
Mix the Batter: Pour the wet mixture into the dry mixture. Stir gently with a spatula only until combined. Do not overmix!
Add Peaches: Gently fold in the well-drained, diced peaches.
Heat the Oil: Fill a heavy-bottomed pot or deep skillet with about 2 inches of oil. Heat over medium heat until the oil reaches 375°F (190°C) on a thermometer.
Fry the Fritters: Using a ¼-cup measure or a large cookie scoop, carefully drop spoonfuls of batter into the hot oil. Do not crowd the pan. Fry for 2-4 minutes per side, until deep golden brown.
Check for Doneness & Cool: Transfer the cooked fritters to a wire rack lined with paper towels to drain excess oil. To test for doneness, insert a toothpick into the center; it should come out clean.
Make the Glaze: In a small bowl, combine the confectioners' sugar, vanilla, and 3 teaspoons of the reserved peach juice. Whisk until smooth. Add more juice, 1 teaspoon at a time, until a pourable consistency is reached.
Drizzle and Set: Drizzle the glaze over the warm fritters. Let them sit for a few minutes for the glaze to set before serving.