Yeah, I agree you should build up the sear block on the safety and learn how it interacts to block the sear
You'll need to take off your main spring housing and grip safety to observe function.
It isn't a friction wear area, it should never have more force applied than you pulling the trigger with the safety engaged, and you shouldn't be pulling the trigger while simultaneously disengaging the safety. Peening is basically deforming the material on your non functional safety because it's probably only out of spec a few hundred thousands.
In the end, when you're familiar with the safety and how it works I would order a new one and fit it.
Also a good example of why function checks are important. Pull the trigger with safety on, release and take off thumb safety. Hammer doesn't fall. Etc. continue with grip safety etc.