Not sure about your pitless. On mine all I do is thread a pipe into the top of it and pull up the pump. What I can tell you a motor will not survive long continuously short cycling like that. You should have disconnected it the minute you noticed it. The fact that yours is still running after doing that for a month is kind of surprising to me. In any event when you do pull the pump you might as well replace it or expect to be pulling it again real soon.