If an ammo was loaded on the hot side, it could cause additional wear and tear on a pistol, shorten the life overall, but I don't think that's a big problem.
The only case that I have heard of with too hot ammo really causing problems was in the K frame S&W revolvers, the K frame was originally for 38 special, then S&W came out with 357 magnum, it became common knowledge that you should not shoot a lot of full power 357 mag loads in the K frame guns, then in the 80's the 125 gr JHP became the popular load for 357, that load was particularly hard on K frames and S&W recommended that shooting the 125 gr loads be very limited, that's essentially why S&W came out with the new in between frame size for 357 mag.