Your post does not really tell us much.....Where exactly do you let air out? What do you mean by the pressure gets too high? What is the reading on the pressure gauge? What is the on/off pressures on the switch?
It is generally a bad idea to start arbitrarily adjusting the air in a pressure tank. Give us more info and maybe we can offer some constructive advise.