No, don't use plumbers putty. I don't know what you call what you are describing, but it is available in most big box stores. It comes as a 1"x2"x6" grey colored "brick" wrapped in heavy clear poly. I think you may find it in the electrical dept. as it's used to seal electrical conduit penetrations as well.