In a large bowl, whisk together the flour, sugar, baking powder, and salt. Cut in the butter with a pastry blender or two knives until the mixture resembles a coarse meal. Add the sweet potato mixture and fold gently to combine. If the mixture is too dry, add more milk a little at a time until all the flour is moistened. If it is too moist, add a little more flour.