In a saucepan, cover the potatoes with cold water and bring to a boil. Reduce the heat slightly and cook for 30 minutes until they are tender. Drain the potatoes well.
Place the potatoes in a large mixing bowl along with garlic, butter, milk, and yogurt. Beat until smooth and creamy, adding more yogurt or milk if necessary. Gently stir in the chile and season with the salt and pepper.