Are you saying the wood soffit is cover by vinyl, and you're dumping he exhaust in between? No good, especially in our climate. (I moved from Vestal in '83.)
There are vents designed for mounting in the soffit. Get the right product for the application. You can probably go through the hole you already cut and then throuh the vinyl, but follow the installation instructions on the soffit vent.