Is this guys last name Clampett?
I don't know about the fields being on his property, but if you bought your place and did a title search etc. If this is true, you should be able to go back on the title company.
I think this guy is just blowing smoke and if it were me, I would have cut the hose a long time ago.
Give him an inch and he'll take a mile.
If it were me, I would call code inforcement in your county. These people can't have a CO to live in that house which means they don't have power except for maybe a temporary pole for building purposes. Without a CO they can't live there. And the code folks would probably not look kindly at what is going on.
Good Luck, bob...