Tighten tub spout

I've installed a new tub spout that screws onto a male adapter. Problem is that when it's fully tight against that side of the tub surround, it's pointing up.

Are there any tips on getting this tight against the wall after backing it off 1/2 turn so it points down?

spout

You will either have to loosen the material around the pipe so it might be able to move as you tighten the spout the rest of the way, or leave it away from the wall and caulk the gap.