Yes, There is a reason they make PVC and CPVC glue, and it is not just to sell another product. CPVC is not the same and won't hold with the PVC solvent.
PVC = PollyVinal Chloride
CPVC = Chlorinated PolyVinyl Chloride
The "glue" would be a different composition to solvent weld it.
Cut it out and change it.