While the cake is baking, mix the powdered sugar and milk in a small bowl until smooth to create the glaze.