In a food processor, puree the potatoes. Add the garlic puree, bread crumbs, lemon juice, salt, and black pepper and process until combined. While processing, drizzle the oil into the potato mixture until well mixed.
Transfer the mixture to a medium-sized bowl and stir in the scallions and olives. Serve at room temperature with the flat bread. Makes 2 cups.