Depending on the caulk used, while it may skin over quickly, some can take a week to fully cure. But, assuming it is mounted well, you should not have to wait any time to finish the connections. It would only be an issue if it wasn't tight, then you'd want it to be set before mucking with it. And, if it was, you should fix it so it was tight first.