You're not going to break the solder connection, but you could bend the pipe. There should be a collar on the hose bib that has holes or slots for screws that would anchor the bib to the side of the house. If this is not what you have, you might go inside the house and fasten a clamp that would hold the bib tight against the house. A clamp that is normally used to attach a ground wire to a pipe would work. I'm not sure of the proper name for it, probably something like "grounding clamp" would give a clerk a clue.