Honestly, the best idea is to get an electrician or the power compant out there right away. It does not sound like something you even want to think about doing yourself, and it could be serious.
I suspect the power company would send someone right away. This may result in being without power for a while, so I would line up some ice for the refrigerator, flashlights, etc. Depending on whether it is something the company may fix, they might just make it safe, and then you are in the dark....literally....until you can get an electrician out there. You may or may not want to pay weekend rates for this! The power company should not charge for their visit.
Do something right away!