One of three things will happen, and we cannot tell you which one because it depends on many factors which cannot be predicted.
1. The leak will remain constant.
2. The leak will evenually cause erosion of the joint and start leaking worse.
3. The water quality will be such that it causes the metal to corrode and stop the leak.
None of these is really desirable and you should do whatever it takes to stop the leak NOW.