[2011 grip size question]

I bought a used Akai Custom 2011 this year and I have fat stubby hands and have been having issues with the grip. It feels too big in my hand and I keep switching the safety up during shooting. Am I to understand that the whole lower unit has to be changed out in order to change the grip?

[I’m new to competitive shooting and excited to come play]

I’ve been shooting steel challenge for a few years but I’m looking for more action and I’m excited to get into USPSA. I bought a used Akai Custom 2011 in .40 this year and have shot it a handful of times. I keep nudging  the safety up while shooting because I have fat hands and can’t figure out how change that. Any ideas?