I have small hands by almost all glove sizing charts, and think the X5 grip isn't big enough.
The decision to move to remove the palm swell from the regular P320 is really the killer here. It moves your contact points to just the corners, which was a dumb decision on Sig's part IMHO. They said squaring it was to give you better indexing so you're pointed the right direction every time, but that should be solved with practice, not making the grip worse for actual shooting.