Might be that you're not doing anything wrong. I've had the same experience, caused by improperly made parts. This was an $800. faucet/shower set, and
the supplier would not give satisfaction. There are clawfoot shower sets available where the shower riser has a swivel fitting at the bottom, so this problem
can not arise. You might want to ditch/return what you have and get one of those.