Preheat the oven to 350℉. Line a 9” x 9” with parchment paper and spray with cooking spray. Set aside.
Combine butter, sugar, and eggs in a large mixing bowl with a hand mixer.
Sift the flour, soda, and salt together in a separate bowl. Add the dry ingredients to the wet ingredients and mix. The batter will be very thick.
Add two large bananas, sour cream, and vanilla bean paste and mix until combined. Set aside.
To make the crumble topping, add sugar, brown sugar, cinnamon, and cubed butter to a medium bowl and combine with a pastry cutter until the mixture resembles coarse crumbs. Set aside.
Pour about half of the banana cake batter into the prepared pan and smooth it into a thin, even layer, spreading it to the sides of the pan with a rubber spatula.
Sprinkle about half of the crumb mixture on top of the batter.
Use a large spoon to place dollops of the remaining batter on top, and then spread it into a thin layer. It’s okay if some of the streusel pokes through.
Top with the remaining streusel. Bake for 40-45 minutes or until a toothpick inserted in the center comes out clean.
Cool the coffee cake completely before adding the glaze. To make the glaze whisk the powdered sugar and milk together in a small bowl until smooth. You can add more milk to achieve the desired consistency. Drizzle over cut pieces of coffee cake right before serving.