Preheat the oven to 425° F. Brush a 12-cup standard muffin pan with melted butter or oil.
Sift the flours and salt into a large bowl, stir in the olives, Parmesan and rosemary, and make a well in the center.
Whisk the eggs and milk together and pour into the well in the dry ingredients along with the butter. Stir with a metal spoon until just combined. Do not overmix-the mixture should be lumpy. Spoon the mixture into the muffin pan, filling each cup about three-quarters full.
Bake for 20 minutes, or until a skewer comes out clean when inserted into the center of a muffin. Cool the muffins in the pan for 5 minutes before lifting out onto a wire rack.