It's a little more complicated... if your air system uses bleeders in the drop pipe, the drop pipe and pump will need to be pulled up and the bleeders removed from the pipe or plugged. Most would agree that this is something best left for a well/pump company to handle.
You didn't mention your location, but if your lateral is not well below the frost line, a bleeder system is commonly used to preventing the line from freezing. In this case, removing it might be an expensive mistake.
I recommend you start by positively diagnosing the cause of your symptoms.