That's a totally understandable and legit feeling. If you're going to go that route, now's probably the best time to do it since you have the least $ and emotion invested in the Sig, and you might start throwing money at it like many of us are.
I moved from CZ Shadow target guns to the P320 Legion platform. CZs are great guns, reliable, accurate, lots of aftermarket support. But in the end, three things caused me to move on: the double action trigger on the first shot (yes I know there's lots of guys that mastered it, I just didn't), the difficulty in fully cleaning it (yes I know people have figured it out...), and having to manually drop the hammer on a live round at the "make ready" signal. Each of those has it's solution, but when I added them up, the lure of the X5 Legion won out.
No regrets owning the CZs, and no regrets moving to this new platform. Exploring and tweaking and puttering is fun for me, and although I've spent too much money trying to get it as accurate as I want (taking up reloading thinking I needed a special load, buying a Barsto Barrel that turned out to make very little difference, and now buying a Gray Guns slide/barrel combo). But, I've certainly spent more money on stupider things, so I take comfort in that!