Actually that's one place where a gloved hand is clearly superior -- be it in golf, baseball, football, etc.
You're not manipulating relatively tiny controls with one finger in those sports, though. Pulling a 2 pound trigger (and a lot of other things we have to do to run a pistol) requires a level of dexterity that's just not necessary when swinging a stick or grasping a ball.